00010000:00010000:0.0:1746065168.604764:0:21483:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7b7600/0x14b4f8542d4f999f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065168.610145:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262504832 00000100:00100000:0.0:1746065168.610153:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262504832 00002000:00100000:0.0:1746065168.610190:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88009fb12a00 x1830881262504832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:84/0 lens 488/0 e 0 to 0 dl 1746065179 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065168.610199:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12a00 with x1830881262504832 ext(4194304->4993023) 00002000:00010000:0.0:1746065168.610204:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12a00 00000100:00100000:0.0:1746065168.610225:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7475 00000100:00100000:0.0:1746065168.610233:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881262504832:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065168.627119:0:21484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5400/0x14b4f8542d4f9967 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.627133:0:21484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5400/0x14b4f8542d4f9967 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.627141:0:21484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5400/0x14b4f8542d4f9967 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.627147:0:21484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f1d5400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065168.627151:0:21484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5400/0x14b4f8542d4f9967 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.627158:0:21484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5400/0x14b4f8542d4f9967 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.627174:0:21484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5400/0x14b4f8542d4f9967 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.627189:0:21484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5400/0x14b4f8542d4f9967 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065168.627272:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:1961:x1830881262503552:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 31545us (32934us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065168.627281:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7470 00000100:00100000:0.0:1746065168.659686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.666455:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260149760:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065168.666468:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260149888:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065168.671964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.672013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.672979:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9665 00000100:00100000:0.0:1746065168.672989:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:31062:x1830881262506112:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:0.0:1746065168.673050:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cbe00/0x14b4f8542d4f99e5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065168.673061:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cbe00/0x14b4f8542d4f99e5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065168.673067:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cbe00/0x14b4f8542d4f99e5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065168.677338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065168.678901:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3fea00/0x14b4f8542d4f99d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065168.678907:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3fea00/0x14b4f8542d4f99d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00000040:00080000:0.0:1746065168.679633:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2910, 88 off245488 00000004:00080000:0.0:1746065168.679641:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767970825084ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679706:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2956, 88 off249720 00000004:00080000:0.0:1746065168.679711:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767970895650ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065168.679730:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2957, 88 off249808 00000004:00080000:0.0:1746065168.679734:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767970918851ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065168.679745:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2911, 88 off245576 00000004:00080000:0.0:1746065168.679748:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767970932997ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679761:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2912, 88 off245664 00000004:00080000:0.0:1746065168.679764:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767970948330ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679772:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2958, 88 off249896 00000004:00080000:0.0:1746065168.679776:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767970960734ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065168.679784:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2959, 88 off249984 00000004:00080000:0.0:1746065168.679787:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767970971884ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065168.679795:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2960, 88 off250072 00000004:00080000:0.0:1746065168.679797:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767970982036ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065168.679866:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2914, 88 off245848 00000004:00080000:0.0:1746065168.679872:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767971056412ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679884:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2961, 88 off250160 00000004:00080000:0.0:1746065168.679887:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767971072150ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065168.679897:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2915, 88 off245936 00000004:00080000:0.0:1746065168.679900:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767971084812ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679908:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2962, 88 off250248 00000004:00080000:0.0:1746065168.679911:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767971095844ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065168.679919:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2916, 88 off246024 00000004:00080000:0.0:1746065168.679921:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767971106107ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679957:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2917, 88 off246112 00000004:00080000:0.0:1746065168.679961:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767971146047ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679970:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2918, 88 off246200 00000004:00080000:0.0:1746065168.679973:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767971157732ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679981:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2919, 88 off246288 00000004:00080000:0.0:1746065168.679984:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767971168910ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065168.679994:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2963, 88 off250336 00000004:00080000:0.0:1746065168.679996:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767971180947ns, next at 737095943431ns, rc = 0 00000100:00100000:0.0:1746065168.711055:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260150528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065168.711086:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065168.711102:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260151168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065168.711115:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065168.711129:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065168.711133:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260150400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065168.711144:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065168.711152:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260151040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065168.711162:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065168.711181:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cbe00/0x14b4f8542d4f99e5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065168.711186:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cbe00/0x14b4f8542d4f99e5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00010000:0.0:1746065168.711330:0:20754:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008fc5b100 reply state ffff880134c21000 transno 8589943831 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cbe00/0x14b4f8542d4f99e5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065168.711337:0:20754:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065168.711391:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31062:x1830881262506112:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 38405us (39377us total) trans 8589943831 rc 0/0 00000100:00100000:0.0:1746065168.711405:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9665 00000100:00100000:0.0:1746065168.711450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.711498:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260150528 00000100:00100000:0.0:1746065168.711504:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260150528 00000100:00100000:0.0:1746065168.711525:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260151168 00000100:00100000:0.0:1746065168.711526:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260151168 00000100:00100000:0.0:1746065168.711534:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260150400 00000100:00100000:0.0:1746065168.711536:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260150400 00000100:00100000:0.0:1746065168.711542:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260151040 00000100:00100000:0.0:1746065168.711543:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260151040 00000100:00100000:0.0:1746065168.711551:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13360 00000100:00100000:0.0:1746065168.711556:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3298:x1830881260150528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065168.711660:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065168.711662:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.711664:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.711666:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.711668:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065168.711686:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3298:x1830881260150528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (601us total) trans 17179873388 rc 0/0 00000100:00100000:0.0:1746065168.711691:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13360 00000100:00100000:0.0:1746065168.711703:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13361 00000100:00100000:0.0:1746065168.711706:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3298:x1830881260151168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065168.711777:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065168.711779:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065168.711780:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065168.711782:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065168.711783:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065168.711802:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3298:x1830881260151168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (687us total) trans 21474840629 rc 0/0 00000100:00100000:0.0:1746065168.711807:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13361 00000100:00100000:0.0:1746065168.711830:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13362 00000100:00100000:0.0:1746065168.711834:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3298:x1830881260150400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065168.711896:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 4989376 -> 4989376 00002000:00010000:0.0:1746065168.711898:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.711900:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.711902:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.711903:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5729 -> 5729 00000100:00100000:0.0:1746065168.711917:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3298:x1830881260150400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (772us total) trans 21474840630 rc 0/0 00000100:00100000:0.0:1746065168.711921:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13362 00000100:00100000:0.0:1746065168.711937:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13363 00000100:00100000:0.0:1746065168.711941:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3298:x1830881260151040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065168.711997:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3298:x1830881260151040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (833us total) trans 21474840631 rc 0/0 00000100:00100000:0.0:1746065168.712001:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13363 00000004:00080000:0.0:1746065168.712033:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cddc00/2, rc 0, transno 21474840630 00000100:00100000:0.0:1746065168.712039:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260150400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065168.712044:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7ff100/2, rc 0, transno 21474840631 00000100:00100000:0.0:1746065168.712046:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260151040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065168.712052:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cd880/2, rc 0, transno 17179873388 00000100:00100000:0.0:1746065168.712055:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260150528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065168.712060:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fa680/2, rc 0, transno 21474840629 00000100:00100000:0.0:1746065168.712067:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260151168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065168.712078:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262506368 00000100:00100000:0.0:1746065168.712080:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262506368 00000100:00100000:0.0:1746065168.712096:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9666 00000100:00100000:0.0:1746065168.712100:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+6:31066:x1830881262506368:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065168.712112:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065168.712120:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4f99ec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ebe4 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.712148:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4f99ec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebe4 expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.712158:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0d400/0x14b4f8542d4f99ec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebe4 expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.712170:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065168.712173:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065168.712175:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0d400, rc 0) 00000100:00100000:0.0:1746065168.712194:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:31066:x1830881262506368:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 93us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065168.712199:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9666 00000100:00100000:0.0:1746065168.723886:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.724806:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262506496 00000100:00100000:0.0:1746065168.724827:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262506496 00000100:00100000:0.0:1746065168.724861:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4065 00000100:00100000:0.0:1746065168.724867:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31057:x1830881262506496:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065168.724970:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31057:x1830881262506496:12345-192.168.202.46@tcp:49:cat.0 Request processed in 102us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065168.724985:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4065 00000100:00100000:0.0:1746065168.726023:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.726063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.726112:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262506624 00000100:00100000:0.0:1746065168.726115:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262506624 00000100:00100000:0.0:1746065168.726134:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9668 00000100:00100000:0.0:1746065168.726138:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31062:x1830881262506624:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065168.726147:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065168.726153:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0x14b4f8542d4f9a16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ebeb expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.726176:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0x14b4f8542d4f9a16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebeb expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.726184:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0x14b4f8542d4f9a16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebeb expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.726193:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065168.726195:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065168.726197:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0ca00, rc 0) 00000100:00100000:0.0:1746065168.726214:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31062:x1830881262506624:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065168.726219:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9668 00000100:00100000:0.0:1746065168.726236:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262506752 00000100:00100000:0.0:1746065168.726239:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262506752 00000100:00100000:0.0:1746065168.726253:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13377 00000100:00100000:0.0:1746065168.726257:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+21:31066:x1830881262506752:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065168.726269:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065168.726277:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0d000/0x14b4f8542d4f9a1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ebf2 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.726292:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3fec00/0x14b4f8542d4f98fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb7b expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065168.726300:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c35c000/0x14b4f8542d4f9975 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebc1 expref: 28 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065168.726306:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801355a7800/0x14b4f8542d4f992f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eba5 expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065168.726312:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065168.726313:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065168.726316:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0d000/0x14b4f8542d4f9a1d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1728512->2097151] (req 1728512->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebf2 expref: 22 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065168.726339:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801355a7800/0x14b4f8542d4f992f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eba5 expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065168.726349:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801355a7800/0x14b4f8542d4f992f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eba5 expref: 22 pid: 21998 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065168.726360:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260152448:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065168.726407:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c35c000/0x14b4f8542d4f9975 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebc1 expref: 28 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065168.726423:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c35c000/0x14b4f8542d4f9975 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebc1 expref: 28 pid: 2463 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065168.726431:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260152576:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065168.726458:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3fec00/0x14b4f8542d4f98fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb7b expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065168.726465:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f3fec00/0x14b4f8542d4f98fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb7b expref: 11 pid: 8429 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065168.726472:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd80e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260152704:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065168.726487:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065168.729359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.729390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.729403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.729415:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.729441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.729461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.729480:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262507136 00000100:00100000:0.0:1746065168.729487:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262507136 00000100:00100000:0.0:1746065168.729512:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262507392 00000100:00100000:0.0:1746065168.729514:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262507392 00000100:00100000:0.0:1746065168.729522:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262507648 00000100:00100000:0.0:1746065168.729523:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262507648 00000100:00100000:0.0:1746065168.729530:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262507264 00000100:00100000:0.0:1746065168.729532:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262507264 00000100:00100000:0.0:1746065168.729548:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262507520 00000100:00100000:0.0:1746065168.729549:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262507520 00000100:00100000:0.0:1746065168.729554:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262507776 00000100:00100000:0.0:1746065168.729556:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262507776 00000100:00100000:0.0:1746065168.729563:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13378 00000100:00100000:0.0:1746065168.729568:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1959:x1830881262507136:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065168.729708:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065168.729711:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065167 -> 1746065169 00002000:00010000:0.0:1746065168.729713:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065167 -> 1746065169 00002000:00010000:0.0:1746065168.729714:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065167 -> 1746065169 00002000:00010000:0.0:1746065168.729716:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1823 -> 1823 00000100:00100000:0.0:1746065168.729751:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1959:x1830881262507136:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 181us (399us total) trans 21474840638 rc 0/0 00000100:00100000:0.0:1746065168.729757:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13378 00000100:00100000:0.0:1746065168.729774:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13379 00000100:00100000:0.0:1746065168.729778:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1959:x1830881262507392:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065168.729877:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065168.729879:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065168 -> 1746065169 00002000:00010000:0.0:1746065168.729880:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065168 -> 1746065169 00002000:00010000:0.0:1746065168.729882:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065168 -> 1746065169 00002000:00010000:0.0:1746065168.729883:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065168.729898:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1959:x1830881262507392:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 119us (508us total) trans 17179873396 rc 0/0 00000100:00100000:0.0:1746065168.729902:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13379 00000100:00100000:0.0:1746065168.729912:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13380 00000100:00100000:0.0:1746065168.729916:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1959:x1830881262507648:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065168.729988:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 4989376 -> 4989376 00002000:00010000:0.0:1746065168.729991:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.729992:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.729993:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.729995:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5729 -> 5729 00000100:00100000:0.0:1746065168.730010:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1959:x1830881262507648:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 93us (605us total) trans 21474840639 rc 0/0 00000100:00100000:0.0:1746065168.730014:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13380 00000100:00100000:0.0:1746065168.730025:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13381 00000100:00100000:0.0:1746065168.730029:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1959:x1830881262507264:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065168.730076:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065168.730078:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.730079:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.730081:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.730082:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065168.730096:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1959:x1830881262507264:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 67us (680us total) trans 17179873397 rc 0/0 00000100:00100000:0.0:1746065168.730101:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13381 00000100:00100000:0.0:1746065168.730111:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13383 00000100:00100000:0.0:1746065168.730115:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1959:x1830881262507776:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065168.730163:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065168.730166:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.730167:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.730169:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065168.730175:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746065168.731299:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1959:x1830881262507776:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 1178us (1832us total) trans 17179873398 rc 0/0 00000100:00100000:0.0:1746065168.731305:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13383 00000100:00100000:0.0:1746065168.731832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.731862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.733941:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.734681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.735326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.735369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.735392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.737267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.738077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.738358:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262509312 00000100:00100000:0.0:1746065168.738367:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262509312 00002000:00100000:0.0:1746065168.738395:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4988928->4993023) req@ffff88008fd83b80 x1830881262509312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:84/0 lens 488/0 e 0 to 0 dl 1746065179 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065168.738404:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd83b80 with x1830881262509312 ext(4988928->4993023) 00002000:00010000:0.0:1746065168.738408:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd83b80 00000100:00100000:0.0:1746065168.738421:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7476 00000100:00100000:0.0:1746065168.738425:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262509312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065168.739378:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262509312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 951us (1301us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065168.739384:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7476 00002000:00100000:0.0:1746065168.739389:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4988928->4993023) req@ffff88008fd83b80 x1830881262509312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746065179 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065168.739415:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd83b80 with x1830881262509312 ext(4988928->4993023) 00002000:00010000:0.0:1746065168.739418:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd83b80 00000100:00100000:0.0:1746065168.740343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.746471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.748790:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4068 00000100:00100000:0.0:1746065168.749644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.750036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.750478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.752800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.752855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.765902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.772436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.772473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.774434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.778363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.778453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.782267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.783940:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262512512 00000100:00100000:0.0:1746065168.783944:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262512512 00000100:00100000:0.0:1746065168.783965:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4069 00000100:00100000:0.0:1746065168.783970:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:31066:x1830881262512512:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065168.784125:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:31066:x1830881262512512:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 154us (445us total) trans 8589943836 rc 0/0 00000100:00100000:0.0:1746065168.784131:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4069 00000100:00100000:0.0:1746065168.797948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.804152:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.809245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.834605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.835151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.835189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.838052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.883603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.902104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065168.958324:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065168.987332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.996713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065168.996760:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.008243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065169.008533:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065169.011138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.014498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.014541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.015331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.024566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.026668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.026703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.026729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.096417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.098689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065169.099287:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065169.114906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.129601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.129652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.129688:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262517888 00000100:00100000:0.0:1746065169.129693:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262517888 00000100:00100000:0.0:1746065169.129718:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262518016 00000100:00100000:0.0:1746065169.129719:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262518016 00000100:00100000:0.0:1746065169.129730:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13391 00000100:00100000:0.0:1746065169.129735:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31085:x1830881262517888:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065169.129748:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.129761:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e87400/0x14b4f8542d4f9abe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ec4d expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.129782:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe12200/0x14b4f8542d4f98aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb2e expref: 19 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.129790:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801355a6800/0x14b4f8542d4f990c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb89 expref: 14 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.129796:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c358400/0x14b4f8542d4f98b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb35 expref: 34 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.129800:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.129802:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.129804:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e87400/0x14b4f8542d4f9abe lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2306048->3010559] (req 2306048->3010559) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec4d expref: 34 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.129841:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c358400/0x14b4f8542d4f98b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb35 expref: 34 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.129850:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c358400/0x14b4f8542d4f98b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb35 expref: 34 pid: 21235 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746065169.129861:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a20380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260154752:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.129906:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801355a6800/0x14b4f8542d4f990c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb89 expref: 14 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.129913:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801355a6800/0x14b4f8542d4f990c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb89 expref: 14 pid: 21998 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065169.129920:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260155008:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065169.140359:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262519168 00000100:00100000:0.0:1746065169.140362:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262519168 00002000:00100000:0.0:1746065169.140374:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45c000 x1830881262519168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:85/0 lens 488/0 e 0 to 0 dl 1746065180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.140380:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c000 with x1830881262519168 ext(3145728->4194303) 00010000:00010000:0.0:1746065169.140383:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c358400/0x14b4f8542d4f98b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb35 expref: 36 pid: 21235 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.140389:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c358400/0x14b4f8542d4f98b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb35 expref: 36 pid: 21235 timeout: 868 lvb_type: 0 00002000:00010000:0.0:1746065169.140394:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b45c000 00000100:00100000:0.0:1746065169.140960:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2301 00000100:00100000:0.0:1746065169.140966:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881262519168:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065169.147917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.150123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.150157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.157691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.166533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.171176:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881262519168:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 30209us (30900us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065169.171184:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2301 00002000:00100000:0.0:1746065169.171191:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45c000 x1830881262519168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:85/0 lens 488/440 e 0 to 0 dl 1746065180 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.171200:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c000 with x1830881262519168 ext(3145728->4194303) 00010000:00010000:0.0:1746065169.171205:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c358400/0x14b4f8542d4f98b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb35 expref: 35 pid: 21235 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.171217:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c358400/0x14b4f8542d4f98b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb35 expref: 35 pid: 21235 timeout: 868 lvb_type: 0 00002000:00010000:0.0:1746065169.171223:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b45c000 00000100:00100000:0.0:1746065169.182420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.186211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.188309:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.195222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.204495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.210809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.220517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.224545:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260156032:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065169.229417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.229492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.230410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.230437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.230465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.231000:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7500 00000100:00100000:0.0:1746065169.231007:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262523520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065169.270462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.270507:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.286022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.289510:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.304485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.310215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.316516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.424998:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.443229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.450474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.463044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.467123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.469450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.469467:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262526592 00000100:00100000:0.0:1746065169.469471:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262526592 00010000:00010000:0.0:1746065169.469492:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801330e1c00/0x14b4f8542d4f9aa9 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec3f expref: 258 pid: 14644 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746065169.469509:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6732 00000100:00100000:0.0:1746065169.469514:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1961:x1830881262526592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065169.469522:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065169.469533:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801330e1c00/0x14b4f8542d4f9aa9 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec3f expref: 258 pid: 14644 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.469542:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801330e1c00/0x14b4f8542d4f9aa9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec3f expref: 258 pid: 14644 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.469558:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065169.469562:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469570:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469576:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469586:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065169.469604:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1961:x1830881262526592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.469659:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6732 00010000:00010000:0.0:1746065169.469746:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801330e1c00/0x14b4f8542d4f9aa9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec3f expref: 257 pid: 14644 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746065169.469760:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d86300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260156672:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.469774:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469780:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469785:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065169.469836:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00000004:00200000:0.0:1746065169.469840:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065169.469851:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469859:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469866:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c600/0x14b4f8542d4f9b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469871:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c600/0x14b4f8542d4f9b74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469875:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c600/0x14b4f8542d4f9b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469880:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c35c600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065169.469883:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c600/0x14b4f8542d4f9b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469889:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c600/0x14b4f8542d4f9b74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469895:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065169.469897:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065169.469900:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c600/0x14b4f8542d4f9b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469905:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c600/0x14b4f8542d4f9b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469912:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c400/0x14b4f8542d4f9b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469920:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c400/0x14b4f8542d4f9b7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469935:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c400/0x14b4f8542d4f9b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469939:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c35c400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065169.469941:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c400/0x14b4f8542d4f9b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469945:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c400/0x14b4f8542d4f9b7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469951:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f400) 00010000:00010000:0.0:1746065169.469953:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065169.469954:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c400/0x14b4f8542d4f9b7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469958:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c400/0x14b4f8542d4f9b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.469984:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35c000/0x14b4f8542d4f9b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eca8 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.469993:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eca8 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.469998:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065169.470000:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065169.470002:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c35ce00, rc 0) 00000100:00100000:0.0:1746065169.470020:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31097:x1830881262526336:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6506us (6986us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.470029:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9676 00010000:00010000:0.0:1746065169.475056:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6146e00/0x14b4f8542d4f9a47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec1c expref: 24 pid: 4544 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746065169.475070:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260156928:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.475092:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c358e00/0x14b4f8542d4f9b89 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1372160->1482751] (req 1372160->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ecaf expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.475101:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c358e00, rc 0) 00000100:00100000:0.0:1746065169.475120:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31096:x1830881262526464:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7846us (8004us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.475125:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13401 00000100:00100000:0.0:1746065169.475372:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262526848 00000100:00100000:0.0:1746065169.475375:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262526848 00010000:00010000:0.0:1746065169.475387:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6146600/0x14b4f8542d4f9a71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec2a expref: 31 pid: 4544 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065169.475401:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6734 00000100:00100000:0.0:1746065169.475406:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881262526848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065169.475411:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065169.475420:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6146600/0x14b4f8542d4f9a71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec2a expref: 31 pid: 4544 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746065169.475428:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6146600/0x14b4f8542d4f9a71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec2a expref: 31 pid: 4544 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746065169.475449:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6146600/0x14b4f8542d4f9a71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec2a expref: 31 pid: 4544 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746065169.475456:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.475458:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.475463:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c358e00/0x14b4f8542d4f9b89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ecaf expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.475470:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c358e00/0x14b4f8542d4f9b89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ecaf expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.475492:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c358e00/0x14b4f8542d4f9b89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ecaf expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065169.475501:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260157056:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065169.478459:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262527104 00000100:00100000:0.0:1746065169.478464:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262527104 00000100:00100000:0.0:1746065169.478473:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262527232 00000100:00100000:0.0:1746065169.478475:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262527232 00000100:00100000:0.0:1746065169.478492:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262527360 00000100:00100000:0.0:1746065169.478493:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262527360 00000100:00100000:0.0:1746065169.478505:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13403 00000100:00100000:0.0:1746065169.478510:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1958:x1830881262527232:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065169.478517:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.478527:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55caa00/0x14b4f8542d4f9b97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ecc4 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.478549:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.478551:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.478557:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55caa00/0x14b4f8542d4f9b97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ecc4 expref: 16 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.478569:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55caa00/0x14b4f8542d4f9b97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ecc4 expref: 16 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.478578:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55caa00, rc 0) 00000100:00100000:0.0:1746065169.478613:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:1958:x1830881262527232:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 102us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.478619:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13403 00000100:00100000:0.0:1746065169.478634:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13404 00000100:00100000:0.0:1746065169.478638:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1958:x1830881262527360:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065169.478644:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.478651:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55ca000/0x14b4f8542d4f9b9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5eccb expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.478659:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.480003:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.480012:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55ca000/0x14b4f8542d4f9b9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eccb expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.480027:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55ca000/0x14b4f8542d4f9b9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eccb expref: 15 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.480046:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55ca000, rc 0) 00000100:00100000:0.0:1746065169.480093:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1958:x1830881262527360:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1452us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.480099:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13404 00000100:00100000:0.0:1746065169.480144:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13405 00000100:00100000:0.0:1746065169.480149:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1958:x1830881262527104:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065169.480158:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.480167:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cb800/0x14b4f8542d4f9ba5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ecbd expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065169.480199:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260157312:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065169.480247:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e720c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065169.492310:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262528128 00000100:00100000:0.0:1746065169.492317:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262528128 00000100:00100000:0.0:1746065169.492353:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9677 00000100:00100000:0.0:1746065169.492359:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31097:x1830881262528128:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065169.492374:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.492389:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55ca200/0x14b4f8542d4f9bac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ecd2 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.492462:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cba00/0x14b4f8542d4f9bb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.492474:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eca8 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.492493:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cba00/0x14b4f8542d4f9bb3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.492519:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eca8 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.492529:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eca8 expref: 12 pid: 14644 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746065169.492539:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d96680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260157440:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065169.493562:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e729c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065169.499895:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c35ce00/0x14b4f8542d4f9b82 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eca8 expref: 12 pid: 14644 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746065169.499916:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d96680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260157440:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.499939:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cba00/0x14b4f8542d4f9bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.499946:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cba00/0x14b4f8542d4f9bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.499951:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cba00/0x14b4f8542d4f9bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065169.499965:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065169.500067:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55ca200/0x14b4f8542d4f9bac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ecd2 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.500077:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cba00/0x14b4f8542d4f9bb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ecd2 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.500090:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065169.500092:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065169.500094:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cba00, rc 0) 00000100:00100000:0.0:1746065169.500124:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31097:x1830881262528128:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 7765us (9204us total) trans 8589943850 rc 0/0 00000100:00100000:0.0:1746065169.500129:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9677 00000100:00100000:0.0:1746065169.501967:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262528768 00000100:00100000:0.0:1746065169.501974:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262528768 00000100:00100000:0.0:1746065169.502000:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4077 00000100:00100000:0.0:1746065169.502006:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31096:x1830881262528768:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065169.502133:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31096:x1830881262528768:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 126us (456us total) trans 8589943851 rc 0/0 00000100:00100000:0.0:1746065169.502138:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4077 00000100:00100000:0.0:1746065169.503885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.507406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.510032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.515582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.516326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.517266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.519978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.520353:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.531157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.538148:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260158080:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.538170:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6147800/0x14b4f8542d4f9c1c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed03 expref: 25 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.538192:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6147800, rc 0) 00000100:00100000:0.0:1746065169.538225:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:31101:x1830881262530304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5112us (6893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.538231:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13409 00000100:00100000:0.0:1746065169.539375:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13413 00000100:00100000:0.0:1746065169.539381:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1960:x1830881262530688:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065169.539394:0:2463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.539401:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cac00/0x14b4f8542d4f98f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb6d expref: 17 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.539408:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3ff800/0x14b4f8542d4f993d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebb3 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.539414:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801355a7e00/0x14b4f8542d4f9928 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb97 expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.539419:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.539420:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.539421:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.539433:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801355a7e00/0x14b4f8542d4f9928 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb97 expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.539448:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801355a7e00/0x14b4f8542d4f9928 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb97 expref: 19 pid: 21998 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065169.539455:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260158720:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.539915:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f3ff800/0x14b4f8542d4f993d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebb3 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.539931:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f3ff800/0x14b4f8542d4f993d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebb3 expref: 34 pid: 25185 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065169.539938:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260159744:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.539956:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55cac00/0x14b4f8542d4f98f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb6d expref: 17 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.539962:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cac00/0x14b4f8542d4f98f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eb6d expref: 17 pid: 8427 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065169.539969:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260159872:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065169.539981:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065169.540554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.546089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.548028:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262531584 00000100:00100000:0.0:1746065169.548041:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262531584 00010000:00010000:0.0:1746065169.548053:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0d200/0x14b4f8542d4f9af6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec69 expref: 27 pid: 25185 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746065169.548170:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6739 00000100:00100000:0.0:1746065169.548176:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881262531584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065169.548182:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065169.548189:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e0d200/0x14b4f8542d4f9af6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec69 expref: 27 pid: 25185 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746065169.548196:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e0d200/0x14b4f8542d4f9af6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec69 expref: 27 pid: 25185 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746065169.548207:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e0d200/0x14b4f8542d4f9af6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec69 expref: 27 pid: 25185 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746065169.548225:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065169.548255:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881262531584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.548261:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6739 00000100:00100000:0.0:1746065169.553712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.553747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.553758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.553779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.553789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.553804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065169.554580:0:2463:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.554597:0:2463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.554608:0:2463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.554619:0:2463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.554624:0:2463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.554629:0:2463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55cb200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065169.554632:0:2463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.554637:0:2463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.554645:0:2463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.554651:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cb200/0x14b4f8542d4f9c38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065169.554678:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1960:x1830881262530688:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 15298us (15518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.554685:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13413 00000100:00100000:0.0:1746065169.569368:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881262531328:12345-192.168.202.46@tcp:4:cat.0 Request processed in 28567us (28812us total) trans 21474840645 rc 0/0 00000100:00100000:0.0:1746065169.569375:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2306 00002000:00100000:0.0:1746065169.569381:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (188416->1003519) req@ffff880093ba2d80 x1830881262531328/t21474840645(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:85/0 lens 488/448 e 0 to 0 dl 1746065180 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.569388:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2d80 with x1830881262531328 ext(188416->1003519) 00010000:00010000:0.0:1746065169.569394:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6147200/0x14b4f8542d4f9ac5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 188416->970751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec54 expref: 26 pid: 8851 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.569403:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6147200/0x14b4f8542d4f9ac5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 188416->970751) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ec54 expref: 26 pid: 8851 timeout: 868 lvb_type: 0 00002000:00010000:0.0:1746065169.569408:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba2d80 00000100:00100000:0.0:1746065169.577530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.586196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.586233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.586259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.586336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.588300:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7507 00000100:00100000:0.0:1746065169.588308:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b62c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881262534912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065169.622516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.622552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.623371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.623799:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262535680 00000100:00100000:0.0:1746065169.623810:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262535680 00000100:00100000:0.0:1746065169.624532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.624544:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262536192 00000100:00100000:0.0:1746065169.624546:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262536192 00010000:00010000:0.0:1746065169.624558:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6147800/0x14b4f8542d4f9c1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed03 expref: 28 pid: 2463 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746065169.624571:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6751 00000100:00100000:0.0:1746065169.624574:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881262536192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065169.624581:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065169.624601:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6147800/0x14b4f8542d4f9c1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed03 expref: 28 pid: 2463 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.624609:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6147800/0x14b4f8542d4f9c1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed03 expref: 28 pid: 2463 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.624620:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6147800/0x14b4f8542d4f9c1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed03 expref: 28 pid: 2463 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.624630:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.624632:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.624634:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0146600/0x14b4f8542d4f9c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.624641:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0146600/0x14b4f8542d4f9c3f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.624667:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065169.624808:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881262536192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 232us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.624813:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6751 00000100:00100000:0.0:1746065169.635340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.635398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.638719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.638738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.638752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.638781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.647232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.651223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.653513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.653659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.655911:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262538368 00000100:00100000:0.0:1746065169.655917:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262538368 00010000:00010000:0.0:1746065169.656696:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e87000/0x14b4f8542d4f99de lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebdd expref: 257 pid: 24350 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746065169.658200:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6756 00000100:00100000:0.0:1746065169.658213:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1961:x1830881262538368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065169.658225:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065169.658231:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e87000/0x14b4f8542d4f99de lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebdd expref: 257 pid: 24350 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.658242:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e87000/0x14b4f8542d4f99de lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebdd expref: 257 pid: 24350 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.658258:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e87000/0x14b4f8542d4f99de lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ebdd expref: 257 pid: 24350 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746065169.658282:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065169.658286:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4f9cd2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.658293:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4f9cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.658299:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4f9cd2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.658328:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065169.658364:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1961:x1830881262538368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 155us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.658369:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6756 00000100:00100000:0.0:1746065169.668338:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+28:1958:x1830881262537088:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29081us (29592us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065169.668348:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7511 00002000:00100000:0.0:1746065169.668357:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094ff6680 x1830881262537088/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:85/0 lens 488/440 e 0 to 0 dl 1746065180 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.668366:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6680 with x1830881262537088 ext(3145728->4194303) 00002000:00010000:0.0:1746065169.668371:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff6680 00000100:00100000:0.0:1746065169.692756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.692782:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262538624 00000100:00100000:0.0:1746065169.692789:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262538624 00000100:00100000:0.0:1746065169.692837:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9683 00000100:00100000:0.0:1746065169.692844:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:31101:x1830881262538624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065169.692872:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.692887:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a7e00/0x14b4f8542d4f9cd9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ed73 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.692942:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4f9cd2 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.692949:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a7e00/0x14b4f8542d4f9cd9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed73 expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.692962:0:14643:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4f9cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065169.692971:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a7e00/0x14b4f8542d4f9cd9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed73 expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.692982:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065169.692985:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065169.692988:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a7e00/0x14b4f8542d4f9cd9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed73 expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.692993:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355a7e00, rc 0) 00000100:00100000:0.0:1746065169.693029:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:31101:x1830881262538624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 185us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.693034:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9683 00000100:00100000:0.0:1746065169.697517:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260162432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.697540:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065169.697551:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260162944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.697575:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065169.697584:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065169.697588:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260162304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.697598:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065169.697603:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260162816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.697613:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065169.697629:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260162432 00000100:00100000:0.0:1746065169.697631:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260162432 00000100:00100000:0.0:1746065169.697644:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260162816 00000100:00100000:0.0:1746065169.697645:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260162816 00000100:00100000:0.0:1746065169.699060:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260162688 00000100:00100000:0.0:1746065169.699064:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260162688 00000100:00100000:0.0:1746065169.699076:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260162560 00000100:00100000:0.0:1746065169.699077:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260162560 00000100:00100000:0.0:1746065169.699083:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260163072 00000100:00100000:0.0:1746065169.699085:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260163072 00000100:00100000:0.0:1746065169.699093:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13438 00000100:00100000:0.0:1746065169.699099:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3298:x1830881260162432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.699169:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13440 00000100:00100000:0.0:1746065169.699174:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3298:x1830881260162304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065169.699251:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065169.699254:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.699256:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065169.699258:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.699259:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065169.699282:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3298:x1830881260162304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (1683us total) trans 21474840647 rc 0/0 00000100:00100000:0.0:1746065169.699294:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13440 00000100:00100000:0.0:1746065169.699305:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13442 00000100:00100000:0.0:1746065169.699309:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3296:x1830881260162688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.699511:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3296:x1830881260162688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (659us total) trans 21474840650 rc 0/0 00000100:00100000:0.0:1746065169.699516:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13442 00000100:00100000:0.0:1746065169.699527:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13445 00000100:00100000:0.0:1746065169.699531:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3296:x1830881260162176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065169.699600:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065169.699602:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.699604:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.699605:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.699607:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1823 -> 1823 00000100:00100000:0.0:1746065169.699626:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3296:x1830881260162176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (819us total) trans 21474840652 rc 0/0 00000100:00100000:0.0:1746065169.699631:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13445 00000004:00080000:0.0:1746065169.699653:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff7800/2, rc 0, transno 21474840647 00000100:00100000:0.0:1746065169.699657:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260162304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065169.699663:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff4700/2, rc 0, transno 21474840648 00000100:00100000:0.0:1746065169.699665:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260162816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065169.699672:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff4000/2, rc 0, transno 21474840646 00000100:00100000:0.0:1746065169.699674:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260162944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065169.700730:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff5880/2, rc 0, transno 21474840653 00000100:00100000:0.0:1746065169.700741:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260162432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065169.701247:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d86680/2, rc 0, transno 17179873402 00000100:00100000:0.0:1746065169.701251:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260161152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065169.704044:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d87480/2, rc 0, transno 17179873403 00000100:00100000:0.0:1746065169.704048:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260161664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065169.704056:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d85180/2, rc 0, transno 17179873400 00000100:00100000:0.0:1746065169.704058:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260161536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065169.704065:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f234700/2, rc 0, transno 17179873401 00000100:00100000:0.0:1746065169.704067:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260162048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065169.704445:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262538880 00000100:00100000:0.0:1746065169.704449:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262538880 00000100:00100000:0.0:1746065169.704483:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4078 00000100:00100000:0.0:1746065169.704488:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:31101:x1830881262538880:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065169.704571:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:31101:x1830881262538880:12345-192.168.202.46@tcp:49:cat.0 Request processed in 81us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.704576:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4078 00000100:00100000:0.0:1746065169.705223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.705256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.705360:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9685 00000100:00100000:0.0:1746065169.705367:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31097:x1830881262539008:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065169.705378:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.705384:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0x14b4f8542d4f9ce7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ed81 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.705428:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0x14b4f8542d4f9ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed81 expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.706209:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0ca00/0x14b4f8542d4f9ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed81 expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.706225:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065169.706227:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065169.706229:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e0ca00, rc 0) 00000100:00100000:0.0:1746065169.706257:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31097:x1830881262539008:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 891us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.706263:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9685 00000100:00100000:0.0:1746065169.710875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.710910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.710949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.746975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.751527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.751561:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.751589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.751605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.754505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.754943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.759225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.765652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.768809:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262542208 00000100:00100000:0.0:1746065169.768831:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262542208 00000100:00100000:0.0:1746065169.768853:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262542464 00000100:00100000:0.0:1746065169.768854:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262542464 00000100:00100000:0.0:1746065169.768863:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262543104 00000100:00100000:0.0:1746065169.768864:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262543104 00002000:00100000:0.0:1746065169.768875:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009f6d0000 x1830881262543104/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:85/0 lens 488/0 e 0 to 0 dl 1746065180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.768883:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d0000 with x1830881262543104 ext(2097152->3145727) 00002000:00010000:0.0:1746065169.768886:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6d0000 00000100:00100000:0.0:1746065169.768890:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262543232 00000100:00100000:0.0:1746065169.768892:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262543232 00002000:00100000:0.0:1746065169.768899:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f6d3480 x1830881262543232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:85/0 lens 488/0 e 0 to 0 dl 1746065180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.768906:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6d3480 with x1830881262543232 ext(3145728->4194303) 00002000:00010000:0.0:1746065169.768908:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6d3480 00000100:00100000:0.0:1746065169.768911:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262543744 00000100:00100000:0.0:1746065169.768913:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262543744 00002000:00100000:0.0:1746065169.768937:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012e8b5180 x1830881262543744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:85/0 lens 488/0 e 0 to 0 dl 1746065180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.768944:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5180 with x1830881262543744 ext(3145728->4194303) 00002000:00010000:0.0:1746065169.768947:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b5180 00000100:00100000:0.0:1746065169.768957:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262543616 00000100:00100000:0.0:1746065169.768959:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262543616 00002000:00100000:0.0:1746065169.768970:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012e8b4000 x1830881262543616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:85/0 lens 488/0 e 0 to 0 dl 1746065180 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.768976:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881262543616 ext(2097152->3145727) 00002000:00010000:0.0:1746065169.768978:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b4000 00000100:00100000:0.0:1746065169.768982:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7522 00000100:00100000:0.0:1746065169.768987:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+19:1958:x1830881262542208:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065169.769012:0:21486:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.769023:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.769025:0:21486:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.769030:0:21486:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.769040:0:21486:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065169.770402:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881262540544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15279us (18879us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065169.770408:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7515 00002000:00100000:0.0:1746065169.770414:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880095356a00 x1830881262540544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:85/0 lens 488/440 e 0 to 0 dl 1746065180 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.770421:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356a00 with x1830881262540544 ext(3145728->4194303) 00002000:00010000:0.0:1746065169.770424:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356a00 00000100:00100000:0.0:1746065169.770439:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7524 00000100:00100000:0.0:1746065169.770451:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881262543104:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065169.807438:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262544512 00000100:00100000:0.0:1746065169.807445:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262544512 00000100:00100000:0.0:1746065169.807496:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13453 00000100:00100000:0.0:1746065169.807503:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881262544512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065169.807518:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.807532:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a565b400/0x14b4f8542d4f9da4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5edc7 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.807552:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.807554:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.807560:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565b400/0x14b4f8542d4f9da4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edc7 expref: 27 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.807572:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a565b400/0x14b4f8542d4f9da4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edc7 expref: 27 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.807581:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a565b400, rc 0) 00000100:00100000:0.0:1746065169.807613:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881262544512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 111us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.807618:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13453 00010000:00010000:0.0:1746065169.814383:0:21486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.814398:0:21486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.814415:0:21486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.814421:0:21486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3d8600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065169.814424:0:21486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.814431:0:21486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.814445:0:21486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.814449:0:21486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8600/0x14b4f8542d4f9d5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065169.814508:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1958:x1830881262542208:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 45516us (48860us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065169.814516:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7522 00000100:00100000:0.0:1746065169.850640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.858553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.858852:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262543616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 80362us (90118us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065169.858860:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7527 00002000:00100000:0.0:1746065169.858869:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012e8b4000 x1830881262543616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:85/0 lens 488/440 e 0 to 0 dl 1746065180 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065169.858885:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881262543616 ext(2097152->3145727) 00002000:00010000:0.0:1746065169.858890:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b4000 00010000:00010000:0.0:1746065169.864560:0:21487:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009be75600/0x14b4f8542d4f9d96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.864572:0:21487:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009be75600/0x14b4f8542d4f9d96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.864579:0:21487:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009be75600/0x14b4f8542d4f9d96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.864585:0:21487:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be75600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065169.864588:0:21487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be75600/0x14b4f8542d4f9d96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.864595:0:21487:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be75600/0x14b4f8542d4f9d96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.864610:0:21487:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009be75600/0x14b4f8542d4f9d96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.864615:0:21487:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be75600/0x14b4f8542d4f9d96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065169.864670:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1958:x1830881262542720:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 79956us (95924us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065169.864678:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7528 00000100:00100000:0.0:1746065169.885021:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13456 00000100:00100000:0.0:1746065169.885026:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+85:3297:x1830881260163968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065169.885049:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13457 00000100:00100000:0.0:1746065169.885053:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3297:x1830881260164480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065169.885128:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+87:3297:x1830881260164480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (535us total) trans 17179873410 rc 0/0 00000100:00100000:0.0:1746065169.885138:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13457 00000100:00100000:0.0:1746065169.885151:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13458 00000100:00100000:0.0:1746065169.885155:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3295:x1830881260164096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065169.885213:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065169.885215:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.885217:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065169.885219:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.885221:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746065169.885239:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+87:3295:x1830881260164096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (620us total) trans 17179873411 rc 0/0 00000100:00100000:0.0:1746065169.885244:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13458 00000100:00100000:0.0:1746065169.885252:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13459 00000100:00100000:0.0:1746065169.885255:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3295:x1830881260164608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065169.885316:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+87:3295:x1830881260164608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (678us total) trans 17179873412 rc 0/0 00000100:00100000:0.0:1746065169.885321:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13459 00000100:00100000:0.0:1746065169.885332:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13460 00000100:00100000:0.0:1746065169.885336:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3295:x1830881260164224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065169.885407:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065169.885409:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065169.885410:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065169.885412:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065169.885413:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065169.885428:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3295:x1830881260164224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (768us total) trans 17179873413 rc 0/0 00000100:00100000:0.0:1746065169.885433:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13460 00002000:00010000:0.0:1746065169.885496:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065169.885498:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065169.885499:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065169.885501:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065169.885503:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065169.885518:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:3297:x1830881260163968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 492us (943us total) trans 17179873414 rc 0/0 00000100:00100000:0.0:1746065169.885523:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13456 00000004:00080000:0.0:1746065169.885546:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f235c00/2, rc 0, transno 17179873413 00000100:00100000:0.0:1746065169.885550:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260164224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065169.885556:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d97100/2, rc 0, transno 17179873411 00000100:00100000:0.0:1746065169.885558:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260164096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065169.885563:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b62f100/2, rc 0, transno 17179873412 00000100:00100000:0.0:1746065169.885565:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b62f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260164608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065169.885574:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260164992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.885590:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065169.885609:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d95f80/2, rc 0, transno 17179873414 00000100:00100000:0.0:1746065169.885612:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260163968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065169.885618:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b62ea00/2, rc 0, transno 17179873410 00000100:00100000:0.0:1746065169.885620:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260164480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065169.885625:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b62ed80/2, rc 0, transno 17179873409 00000100:00100000:0.0:1746065169.885627:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b62ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260164352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065169.885637:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260164992 00000100:00100000:0.0:1746065169.885639:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260164992 00000100:00100000:0.0:1746065169.885652:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13462 00000100:00100000:0.0:1746065169.885655:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+86:3297:x1830881260164992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065169.885734:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065169.885737:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.885739:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.885741:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065170 -> 1746065170 00002000:00010000:0.0:1746065169.885742:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1823 -> 1823 00000100:00100000:0.0:1746065169.885760:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+87:3297:x1830881260164992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (168us total) trans 21474840655 rc 0/0 00000100:00100000:0.0:1746065169.885764:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13462 00000100:00100000:0.0:1746065169.886629:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260165376 00000100:00100000:0.0:1746065169.886632:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260165376 00000100:00100000:0.0:1746065169.886647:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13463 00000100:00100000:0.0:1746065169.886651:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+87:3296:x1830881260165376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065169.886721:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065169.886723:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065169.886725:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065169.886727:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065169.886733:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065169.886750:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:3296:x1830881260165376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (391us total) trans 21474840656 rc 0/0 00000100:00100000:0.0:1746065169.886754:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13463 00000100:00100000:0.0:1746065169.886765:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13465 00000100:00100000:0.0:1746065169.886768:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3296:x1830881260165248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065169.886835:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 4989376 -> 4989376 00002000:00010000:0.0:1746065169.886837:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065169.886839:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065169.886841:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065169 -> 1746065169 00002000:00010000:0.0:1746065169.886842:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5729 -> 5729 00000100:00100000:0.0:1746065169.886858:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:3296:x1830881260165248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (449us total) trans 21474840658 rc 0/0 00000100:00100000:0.0:1746065169.886862:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13465 00000100:00100000:0.0:1746065169.886870:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13467 00000100:00100000:0.0:1746065169.886874:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3297:x1830881260166016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.886937:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+95:3297:x1830881260166016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (298us total) trans 21474840660 rc 0/0 00000100:00100000:0.0:1746065169.886941:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13467 00000100:00100000:0.0:1746065169.886948:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13469 00000100:00100000:0.0:1746065169.886951:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3297:x1830881260165632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065169.887020:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:3297:x1830881260165632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (335us total) trans 21474840661 rc 0/0 00000100:00100000:0.0:1746065169.887024:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13469 00000100:00100000:0.0:1746065169.889350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.892504:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262546176 00000100:00100000:0.0:1746065169.892511:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262546176 00000100:00100000:0.0:1746065169.892544:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4079 00000100:00100000:0.0:1746065169.892550:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:31109:x1830881262546176:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:0.0:1746065169.892639:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:31109:x1830881262546176:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 88us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.892644:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4079 00000100:00100000:0.0:1746065169.895058:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.895078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.895127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.895144:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262547456 00000100:00100000:0.0:1746065169.895148:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262547456 00000100:00100000:0.0:1746065169.895173:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 711 00000100:00100000:0.0:1746065169.895178:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1958:x1830881262547456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065169.895186:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065169.895202:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009118ea00/0x14b4f8542d4f9dd5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edea expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.895217:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065169.895221:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065169.895235:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:1958:x1830881262547456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.895240:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 711 00000100:00100000:0.0:1746065169.895255:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262547200 00000100:00100000:0.0:1746065169.895258:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262547200 00000100:00100000:0.0:1746065169.895269:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13477 00000100:00100000:0.0:1746065169.895273:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+20:31107:x1830881262547200:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065169.895288:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065169.895297:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4f9ddc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5edf1 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.895314:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3fee00/0x14b4f8542d4f9c77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed1f expref: 34 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.895322:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133003400/0x14b4f8542d4f9d03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed9d expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.895329:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a9800/0x14b4f8542d4f9caf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed50 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.895334:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.895336:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.895338:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4f9ddc lrc: 6/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1626112->1634303] (req 1626112->1634303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edf1 expref: 21 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.895360:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0a9800/0x14b4f8542d4f9caf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed50 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.895370:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a9800/0x14b4f8542d4f9caf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed50 expref: 21 pid: 21998 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746065169.895382:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260166144:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.895423:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133003400/0x14b4f8542d4f9d03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed9d expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.895440:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133003400/0x14b4f8542d4f9d03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed9d expref: 17 pid: 4545 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746065169.895447:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260166272:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.895469:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f3fee00/0x14b4f8542d4f9c77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed1f expref: 34 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065169.895476:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f3fee00/0x14b4f8542d4f9c77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed1f expref: 34 pid: 8429 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746065169.895482:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260166400:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065169.895496:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065169.897833:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260166144:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065169.897843:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260166272:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065169.897849:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260166400:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065169.897867:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4f9ddc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1626112->1634303] (req 1626112->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edf1 expref: 21 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.897879:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133003a00, rc 0) 00000100:00100000:0.0:1746065169.897899:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+21:31107:x1830881262547200:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2625us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.897904:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13477 00000100:00100000:0.0:1746065169.898085:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262547968 00000100:00100000:0.0:1746065169.898087:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262547968 00010000:00010000:0.0:1746065169.898100:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133003400/0x14b4f8542d4f9d03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed9d expref: 18 pid: 4545 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746065169.898113:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262547840 00000100:00100000:0.0:1746065169.898115:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262547840 00010000:00010000:0.0:1746065169.898122:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a9800/0x14b4f8542d4f9caf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed50 expref: 21 pid: 21998 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746065169.898616:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6763 00000100:00100000:0.0:1746065169.898622:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262547840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065169.898628:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065169.898635:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0a9800/0x14b4f8542d4f9caf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed50 expref: 21 pid: 21998 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065169.898643:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0a9800/0x14b4f8542d4f9caf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed50 expref: 21 pid: 21998 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065169.898659:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a9800/0x14b4f8542d4f9caf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ed50 expref: 21 pid: 21998 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065169.898667:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.898668:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065169.898675:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4f9ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edf1 expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.898681:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4f9ddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edf1 expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065169.898709:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4f9ddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edf1 expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065169.898720:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260166528:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065169.898770:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065169.898782:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262548352 00000100:00100000:0.0:1746065169.898785:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262548352 00000100:00100000:0.0:1746065169.903011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.903298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.903375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.905729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.908343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.913139:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7536 00000100:00100000:0.0:1746065169.913145:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262550400:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065169.931364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.935035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.935067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.937559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.940340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.951499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.951992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.960719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.960736:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262551936 00000100:00100000:0.0:1746065169.960740:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262551936 00010000:00010000:0.0:1746065169.960758:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801355c4600/0x14b4f8542d4f9d0a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edab expref: 18 pid: 2462 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746065169.960781:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6768 00000100:00100000:0.0:1746065169.960786:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:1960:x1830881262551936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065169.960794:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065169.960809:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801355c4600/0x14b4f8542d4f9d0a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edab expref: 18 pid: 2462 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065169.960831:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801355c4600/0x14b4f8542d4f9d0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edab expref: 18 pid: 2462 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065169.960846:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801355c4600/0x14b4f8542d4f9d0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5edab expref: 18 pid: 2462 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065169.960857:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065169.960873:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1960:x1830881262551936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065169.960878:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6768 00000100:00100000:0.0:1746065169.961945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.963982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.967613:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.971694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.987403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065169.997244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.000914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.007283:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.021256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.028694:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.028725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.028786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.038137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.040653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.044758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.046202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.046273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.046322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.050464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.054474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.054575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.055626:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262556032 00000100:00100000:0.0:1746065170.055629:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262556032 00010000:00010000:0.0:1746065170.055640:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4f9e45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee3e expref: 14 pid: 14643 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746065170.055664:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6772 00000100:00100000:0.0:1746065170.055669:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1961:x1830881262556032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065170.055674:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065170.055678:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4f9e45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee3e expref: 14 pid: 14643 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.055687:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4f9e45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee3e expref: 14 pid: 14643 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.055699:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4f9e45 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee3e expref: 14 pid: 14643 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.055724:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065170.055727:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0146400/0x14b4f8542d4f9eae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065170.055733:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0146400/0x14b4f8542d4f9eae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065170.055738:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0146400/0x14b4f8542d4f9eae lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065170.055757:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065170.055781:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881262556032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 112us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.055786:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6772 00000100:00100000:0.0:1746065170.059849:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6773 00000100:00100000:0.0:1746065170.059863:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1961:x1830881262556288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065170.059877:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065170.059896:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55ca000/0x14b4f8542d4f9e30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee37 expref: 17 pid: 8429 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065170.059906:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55ca000/0x14b4f8542d4f9e30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee37 expref: 17 pid: 8429 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065170.059932:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55ca000/0x14b4f8542d4f9e30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee37 expref: 17 pid: 8429 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065170.059943:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065170.059976:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:1961:x1830881262556288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 120us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.059981:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6773 00000100:00100000:0.0:1746065170.068527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.068542:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262556544 00000100:00100000:0.0:1746065170.068548:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262556544 00000100:00100000:0.0:1746065170.068569:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262556416 00000100:00100000:0.0:1746065170.068571:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262556416 00000100:00100000:0.0:1746065170.068582:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13490 00000100:00100000:0.0:1746065170.068587:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1961:x1830881262556544:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065170.068600:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.068610:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133002800/0x14b4f8542d4f9ebc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ee76 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.068645:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260169344:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065170.068694:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.068708:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262556672 00000100:00100000:0.0:1746065170.068710:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262556672 00000100:00100000:0.0:1746065170.068725:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13491 00000100:00100000:0.0:1746065170.068729:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1961:x1830881262556416:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065170.068736:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.068742:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133002600/0x14b4f8542d4f9ec3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ee6f expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.068762:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881260169600:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065170.068780:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.070673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.070691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.070760:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260169344:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065170.070777:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133002800/0x14b4f8542d4f9ebc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee76 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.070786:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133002800/0x14b4f8542d4f9ebc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee76 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.070794:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133002800, rc 0) 00000100:00100000:0.0:1746065170.071356:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1961:x1830881262556544:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2766us (2948us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065170.071362:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13490 00002000:00010000:0.0:1746065170.071402:0:21235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime: 1746065170 -> 1746065171 00000100:00100000:0.0:1746065170.071412:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881260169600:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065170.071427:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133002600/0x14b4f8542d4f9ec3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee6f expref: 19 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.071435:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133002600/0x14b4f8542d4f9ec3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee6f expref: 19 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.071442:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133002600, rc 0) 00000100:00100000:0.0:1746065170.071459:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:1961:x1830881262556416:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2729us (2932us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065170.071464:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13491 00000100:00100000:0.0:1746065170.071496:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d86d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260169472:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065170.071511:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065170.072050:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881262556800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3386us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.072057:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6775 00002000:00010000:0.0:1746065170.072388:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065170 -> 1746065171 00000100:00100000:0.0:1746065170.072398:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260169728:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065170.072411:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a565ba00/0x14b4f8542d4f9eca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee7d expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.072420:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a565ba00/0x14b4f8542d4f9eca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee7d expref: 17 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.072428:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a565ba00, rc 0) 00000100:00100000:0.0:1746065170.072443:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7541 00000100:00100000:0.0:1746065170.072448:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:1958:x1830881262557312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065170.074476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.074605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.074628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.078137:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:1961:x1830881262556672:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 9339us (9547us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065170.078147:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13492 00000100:00100000:0.0:1746065170.106238:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881262557312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 33781us (35536us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065170.106248:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7541 00002000:00100000:0.0:1746065170.106257:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009a4ead80 x1830881262557312/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:86/0 lens 488/440 e 0 to 0 dl 1746065181 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065170.106270:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ead80 with x1830881262557312 ext(1048576->2097151) 00002000:00010000:0.0:1746065170.106275:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ead80 00000100:00100000:0.0:1746065170.106485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.106539:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262558848 00000100:00100000:0.0:1746065170.106545:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262558848 00000100:00100000:0.0:1746065170.106575:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4087 00000100:00100000:0.0:1746065170.106581:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:31120:x1830881262558848:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065170.106751:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:31120:x1830881262558848:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 169us (266us total) trans 8589943869 rc 0/0 00000100:00100000:0.0:1746065170.106757:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4087 00000100:00100000:0.0:1746065170.108279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.108317:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262559104 00000100:00100000:0.0:1746065170.108322:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262559104 00000100:00100000:0.0:1746065170.108346:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4088 00000100:00100000:0.0:1746065170.108351:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31116:x1830881262559104:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065170.109242:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:31116:x1830881262559104:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 888us (965us total) trans 8589943870 rc 0/0 00000100:00100000:0.0:1746065170.109250:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4088 00000100:00100000:0.0:1746065170.140853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.140908:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262559232 00000100:00100000:0.0:1746065170.140926:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262559232 00000100:00100000:0.0:1746065170.140960:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13493 00000100:00100000:0.0:1746065170.140967:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:31122:x1830881262559232:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065170.140979:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.141008:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4f9edf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ee8b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.141033:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a565a000/0x14b4f8542d4f9df1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee06 expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.141041:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065170.141043:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065170.141046:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4f9edf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee8b expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.141071:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a565a000/0x14b4f8542d4f9df1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee06 expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.141082:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a565a000/0x14b4f8542d4f9df1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee06 expref: 32 pid: 4544 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746065170.141092:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260169856:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065170.141161:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a599b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.142872:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260169856:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065170.142904:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4f9edf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee8b expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.142929:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1cbc00, rc 0) 00000100:00100000:0.0:1746065170.142959:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:31122:x1830881262559232:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1992us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.142966:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13493 00000100:00100000:0.0:1746065170.144053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.144757:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2310 00000100:00100000:0.0:1746065170.144765:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881262559360:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065170.156964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.156988:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262559488 00000100:00100000:0.0:1746065170.156995:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262559488 00010000:00010000:0.0:1746065170.157021:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565a000/0x14b4f8542d4f9df1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee06 expref: 35 pid: 4544 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746065170.157265:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6776 00000100:00100000:0.0:1746065170.157273:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881262559488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065170.157284:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065170.157302:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a565a000/0x14b4f8542d4f9df1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee06 expref: 35 pid: 4544 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.157312:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a565a000/0x14b4f8542d4f9df1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee06 expref: 35 pid: 4544 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.157330:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a565a000/0x14b4f8542d4f9df1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee06 expref: 35 pid: 4544 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.157341:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.157342:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.157347:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4f9edf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee8b expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.157354:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4f9edf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee8b expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.157391:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4f9edf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ee8b expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.157401:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260169984:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065170.157468:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ebf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.173657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.173969:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.173983:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262560256 00000100:00100000:0.0:1746065170.173987:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262560256 00002000:00100000:0.0:1746065170.174002:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3178495) req@ffff8800a5882d80 x1830881262560256/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:86/0 lens 504/0 e 0 to 0 dl 1746065181 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065170.174009:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881262560256 ext(2097152->3178495) 00002000:00010000:0.0:1746065170.174012:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882d80 00000100:00100000:0.0:1746065170.174025:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7548 00000100:00100000:0.0:1746065170.174030:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262560256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065170.176409:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262560512 00000100:00100000:0.0:1746065170.176416:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262560512 00002000:00100000:0.0:1746065170.176441:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3178496->4194303) req@ffff88009bee1f80 x1830881262560512/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:86/0 lens 488/0 e 0 to 0 dl 1746065181 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065170.176450:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1f80 with x1830881262560512 ext(3178496->4194303) 00002000:00010000:0.0:1746065170.176454:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee1f80 00000100:00100000:0.0:1746065170.176468:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7549 00000100:00100000:0.0:1746065170.176473:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881262560512:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065170.204049:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881262560256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30012us (30073us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065170.204059:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7548 00002000:00100000:0.0:1746065170.204070:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3178495) req@ffff8800a5882d80 x1830881262560256/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:86/0 lens 504/440 e 0 to 0 dl 1746065181 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065170.204078:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881262560256 ext(2097152->3178495) 00002000:00010000:0.0:1746065170.204083:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882d80 00000100:00100000:0.0:1746065170.224337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.249421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.249513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.253166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.253198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.253222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.253240:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262561664 00000100:00100000:0.0:1746065170.253245:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262561664 00000100:00100000:0.0:1746065170.253276:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262561792 00000100:00100000:0.0:1746065170.253278:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262561792 00000100:00100000:0.0:1746065170.253287:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262561920 00000100:00100000:0.0:1746065170.253289:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262561920 00000100:00100000:0.0:1746065170.253298:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13494 00000100:00100000:0.0:1746065170.253303:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881262561664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065170.253315:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.253325:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b4a7600/0x14b4f8542d4f9f1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5eea0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.253359:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881260170112:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065170.253424:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.254575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.261206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.271936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.275210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.275258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.277258:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7552 00000100:00100000:0.0:1746065170.277267:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881262562816:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065170.283268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.319353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.333790:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.339547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.343647:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.347516:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.352932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.356069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.356109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.376325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.386533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.386569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.386585:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262565120 00000100:00100000:0.0:1746065170.386592:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262565120 00000100:00100000:0.0:1746065170.386617:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262565248 00000100:00100000:0.0:1746065170.386619:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262565248 00000100:00100000:0.0:1746065170.386639:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13499 00000100:00100000:0.0:1746065170.386646:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262565120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065170.386659:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.386679:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5eed1 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.386697:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.386699:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.386705:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eed1 expref: 12 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.386716:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eed1 expref: 12 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.386725:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f71a800, rc 0) 00000100:00100000:0.0:1746065170.386759:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881262565120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.386764:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13499 00000100:00100000:0.0:1746065170.386778:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13500 00000100:00100000:0.0:1746065170.386782:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881262565248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065170.386787:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.386792:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f71a600/0x14b4f8542d4f9f80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5eed8 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.386836:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260170880:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065170.386884:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.396877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.398295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.398939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.399405:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7559 00000100:00100000:0.0:1746065170.399421:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881262566016:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065170.403283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.405560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.417052:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881262566016:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17622us (18102us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065170.417068:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7559 00002000:00100000:0.0:1746065170.417077:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3620863) req@ffff88009f9cf100 x1830881262566016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:86/0 lens 504/440 e 0 to 0 dl 1746065181 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065170.417086:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf100 with x1830881262566016 ext(2097152->3620863) 00002000:00010000:0.0:1746065170.417091:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cf100 00000100:00100000:0.0:1746065170.440418:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262566656 00000100:00100000:0.0:1746065170.440426:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262566656 00000100:00100000:0.0:1746065170.440471:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13501 00000100:00100000:0.0:1746065170.440478:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:31133:x1830881262566656:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065170.440495:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.440508:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f08d400/0x14b4f8542d4f9f87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5eedf expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.440533:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f9f3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eebc expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.440540:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eed1 expref: 12 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.440546:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.440556:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.440559:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f08d400/0x14b4f8542d4f9f87 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eedf expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.440584:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eed1 expref: 12 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.440594:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eed1 expref: 12 pid: 2462 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746065170.440604:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260171008:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065170.440700:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f9f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eebc expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.440707:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f9f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eebc expref: 20 pid: 21998 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746065170.440714:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260171136:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065170.440730:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.443736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.443771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.443845:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260171008:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065170.443882:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260171136:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065170.443909:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f08d400/0x14b4f8542d4f9f87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1662976->2097151] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eedf expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.443942:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f08d400, rc 0) 00000100:00100000:0.0:1746065170.443986:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+12:31133:x1830881262566656:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3508us (3775us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.443993:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13501 00000100:00100000:0.0:1746065170.444019:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262567040 00000100:00100000:0.0:1746065170.444023:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262567040 00000100:00100000:0.0:1746065170.444042:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13502 00000100:00100000:0.0:1746065170.444046:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+12:31137:x1830881262567040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065170.444057:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.444068:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3fee00/0x14b4f8542d4f9f8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5eee6 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.444085:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b163c00/0x14b4f8542d4f9f33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2834431) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eeb5 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.444091:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065170.444093:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065170.444095:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3fee00/0x14b4f8542d4f9f8e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eee6 expref: 13 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.444116:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b163c00/0x14b4f8542d4f9f33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2834431) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eeb5 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.444125:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b163c00/0x14b4f8542d4f9f33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2834431) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eeb5 expref: 20 pid: 21998 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746065170.444143:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260171264:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065170.444184:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.447633:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6779 00000100:00100000:0.0:1746065170.447640:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881262567296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065170.447650:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065170.447667:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f9f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eebc expref: 22 pid: 21998 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.447675:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f9f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eebc expref: 22 pid: 21998 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.447691:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4f9f3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eebc expref: 22 pid: 21998 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.447706:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065170.447732:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262567296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.447738:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6779 00000100:00100000:0.0:1746065170.447775:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6780 00000100:00100000:0.0:1746065170.447780:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881262567168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065170.447786:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065170.447792:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eed1 expref: 13 pid: 2462 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065170.447809:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eed1 expref: 13 pid: 2462 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065170.447835:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f71a800/0x14b4f8542d4f9f79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eed1 expref: 13 pid: 2462 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746065170.447842:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.447844:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.447849:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f08d400/0x14b4f8542d4f9f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eedf expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.447857:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f08d400/0x14b4f8542d4f9f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eedf expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.447878:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f08d400/0x14b4f8542d4f9f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eedf expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.447888:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260171392:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065170.447928:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.459537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.469673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.469706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.470259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.482161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.484713:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.484765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.486065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.495670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.513191:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262569728 00000100:00100000:0.0:1746065170.513198:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262569728 00000100:00100000:0.0:1746065170.513242:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4091 00000100:00100000:0.0:1746065170.513249:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+19:31133:x1830881262569728:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065170.513426:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:31133:x1830881262569728:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 177us (429us total) trans 8589943877 rc 0/0 00000100:00100000:0.0:1746065170.513432:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4091 00000100:00100000:0.0:1746065170.524906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.529556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.529595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.529628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.529652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.529677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.534889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.538903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.538940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.538979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065170.540035:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801355c4400/0x14b4f8542d4f9ff0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065170.540041:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355c4400/0x14b4f8542d4f9ff0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065170.540055:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065170.540230:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355c5800/0x14b4f8542d4f9fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef2c expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.540258:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355c4400/0x14b4f8542d4f9ff0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef2c expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.540263:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065170.540265:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065170.540267:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355c4400, rc 0) 00000100:00100000:0.0:1746065170.540299:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31141:x1830881262570752:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5308us (5415us total) trans 8589943878 rc 0/0 00000100:00100000:0.0:1746065170.540304:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9706 00000100:00100000:0.0:1746065170.542803:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262571264 00000100:00100000:0.0:1746065170.542810:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262571264 00000100:00100000:0.0:1746065170.542871:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9707 00000100:00100000:0.0:1746065170.542876:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31141:x1830881262571264:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065170.542893:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.542904:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a200/0x14b4f8542d4f9ffe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ef33 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.545932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.555632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.555748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.556376:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13512 00000100:00100000:0.0:1746065170.556384:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262571520:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065170.556392:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.556400:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a565a200/0x14b4f8542d4fa013 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ef3a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.556427:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260173312:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065170.556445:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.564962:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.567388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.567943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.567969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.567980:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.567989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.568006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.578297:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881260173824:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065170.578310:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.578475:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.579278:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.579292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.579311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.579322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.579331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.579344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.580895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.585890:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065170.586707:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.586719:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.586736:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.586742:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.586748:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.586752:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a60a3c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065170.586755:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.586761:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.586770:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.586775:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fa03d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.586873:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881262572544:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 18360us (18901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.586881:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13515 00000100:00100000:0.0:1746065170.590514:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.593960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065170.594528:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.594536:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.594555:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.594561:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.594567:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.594572:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fd6400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065170.594576:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.594582:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.594591:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.594600:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fd6400/0x14b4f8542d4fa036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.594636:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881262572288:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 26226us (26693us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.594642:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13514 00000100:00100000:0.0:1746065170.601008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.601076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.603452:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262575616 00000100:00100000:0.0:1746065170.603457:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262575616 00000100:00100000:0.0:1746065170.603493:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4093 00000100:00100000:0.0:1746065170.603499:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:15426:x1830881262575616:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065170.603604:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:15426:x1830881262575616:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 105us (235us total) trans 8589943881 rc 0/0 00000100:00100000:0.0:1746065170.603610:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4093 00000100:00100000:0.0:1746065170.605393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.605428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.606542:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262576128 00000100:00100000:0.0:1746065170.606547:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262576128 00010000:00010000:0.0:1746065170.606563:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0x14b4f8542d4f9f6b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eeca expref: 17 pid: 14643 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746065170.606580:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6807 00000100:00100000:0.0:1746065170.606585:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262576128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065170.606591:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065170.606595:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0x14b4f8542d4f9f6b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eeca expref: 17 pid: 14643 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.606602:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0x14b4f8542d4f9f6b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eeca expref: 17 pid: 14643 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.606614:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e0c000/0x14b4f8542d4f9f6b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eeca expref: 17 pid: 14643 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746065170.606623:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880093f18e00) 00010000:00010000:0.0:1746065170.606626:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801355c4400/0x14b4f8542d4fa059 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065170.606631:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065170.606663:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881262576128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.606668:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6807 00000100:00100000:0.0:1746065170.607372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.643601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.654433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.657244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.657323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.657449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.658577:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13538 00000100:00100000:0.0:1746065170.658587:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262576896:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065170.658594:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.658601:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a565ae00/0x14b4f8542d4fa083 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ef6b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065170.658617:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d713, atime: 0x6812d713, ctime: 0x6812d713, blocks: 0x81d 00010000:00010000:0.0:1746065170.658625:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.658627:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.658631:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a565ae00/0x14b4f8542d4fa083 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef6b expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.658640:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a565ae00/0x14b4f8542d4fa083 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef6b expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.658647:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a565ae00, rc 0) 00000100:00100000:0.0:1746065170.658663:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262576896:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 81us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.658669:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13538 00000100:00100000:0.0:1746065170.660139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.661147:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262577152 00000100:00100000:0.0:1746065170.661151:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262577152 00000100:00100000:0.0:1746065170.661167:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262577280 00000100:00100000:0.0:1746065170.661169:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262577280 00000100:00100000:0.0:1746065170.661181:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13540 00000100:00100000:0.0:1746065170.661186:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262577152:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065170.661192:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.661200:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a565aa00/0x14b4f8542d4fa091 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ef79 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065170.661212:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 4989376, mtime: 0x6812d712, atime: 0x6812d712, ctime: 0x6812d712, blocks: 0x1663 00010000:00010000:0.0:1746065170.661219:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.661221:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.661225:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565aa00/0x14b4f8542d4fa091 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef79 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.661235:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a565aa00/0x14b4f8542d4fa091 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef79 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.661242:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a565aa00, rc 0) 00000100:00100000:0.0:1746065170.661259:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262577152:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.661264:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13540 00000100:00100000:0.0:1746065170.673348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.673388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.673413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.673426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.673766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.674281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.674333:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7568 00000100:00100000:0.0:1746065170.674340:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881262577792:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065170.674359:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a565a000/0x14b4f8542d4fa0a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.674370:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.674371:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.674375:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a565a000/0x14b4f8542d4fa0a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.674385:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a565a000/0x14b4f8542d4fa0a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065170.740745:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.744167:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.744188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.744499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.744706:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13543 00000100:00100000:0.0:1746065170.744715:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262579712:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065170.744803:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065170.744805:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065170 -> 1746065171 00002000:00010000:0.0:1746065170.744806:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065170 -> 1746065171 00002000:00010000:0.0:1746065170.744808:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065170 -> 1746065171 00002000:00010000:0.0:1746065170.744809:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1823 -> 1823 00000100:00100000:0.0:1746065170.744838:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262579712:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 126us (649us total) trans 21474840678 rc 0/0 00000100:00100000:0.0:1746065170.744842:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13543 00000100:00100000:0.0:1746065170.745452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.745659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.745693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.746149:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13547 00000100:00100000:0.0:1746065170.746155:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262580352:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065170.746219:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065170.746222:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065170.746224:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065170.746225:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065170.746227:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746065170.746243:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881262580352:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 89us (550us total) trans 17179873434 rc 0/0 00000100:00100000:0.0:1746065170.746248:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13547 00000100:00100000:0.0:1746065170.748179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.750566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:0.0:1746065170.781199:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7fc000/2, rc 0, transno 17179873441 00000100:00100000:0.0:1746065170.781203:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260178560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065170.781209:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49c380/2, rc 0, transno 17179873442 00000100:00100000:0.0:1746065170.781211:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260179072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065170.781216:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7ff480/2, rc 0, transno 17179873439 00000100:00100000:0.0:1746065170.781218:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260178688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065170.781223:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49ce00/2, rc 0, transno 17179873440 00000100:00100000:0.0:1746065170.781225:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260179200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065170.787127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.794561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.832550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.834307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.839567:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.839641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.840407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.840613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.840627:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262582400 00000100:00100000:0.0:1746065170.840630:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262582400 00000100:00100000:0.0:1746065170.840647:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262582272 00000100:00100000:0.0:1746065170.840649:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262582272 00000100:00100000:0.0:1746065170.840660:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9716 00000100:00100000:0.0:1746065170.840664:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31148:x1830881262582400:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065170.840674:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.840683:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090ba7400/0x14b4f8542d4fa140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5efb1 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.840744:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090ba7000/0x14b4f8542d4fa147 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065170.840753:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f1b400/0x14b4f8542d4fa101 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef8e expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.840758:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75e400/0x14b4f8542d4fa124 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef95 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.840763:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090ba7000/0x14b4f8542d4fa147 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065170.840785:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75e400/0x14b4f8542d4fa124 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef95 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.840794:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75e400/0x14b4f8542d4fa124 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef95 expref: 8 pid: 14643 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065170.840803:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260180480:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065170.840888:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093f1b400/0x14b4f8542d4fa101 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef8e expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.840895:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f1b400/0x14b4f8542d4fa101 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef8e expref: 250 pid: 14643 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065170.840902:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd80380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260180608:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065170.840929:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.847020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.847044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.847508:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.848268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.858630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.862244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.874348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.882309:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260180736:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065170.882320:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260180864:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065170.882341:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fa17f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065170.882896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.882945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.887560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.892164:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262584192 00000100:00100000:0.0:1746065170.892172:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262584192 00000100:00100000:0.0:1746065170.892206:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9721 00000100:00100000:0.0:1746065170.892212:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31153:x1830881262584192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065170.892230:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.892243:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9200/0x14b4f8542d4fa18d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5efd4 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.892291:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fa17f lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065170.892298:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9200/0x14b4f8542d4fa18d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efd4 expref: 251 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.892563:0:16767:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fa17f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065170.892575:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9200/0x14b4f8542d4fa18d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efd4 expref: 251 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.892584:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065170.892587:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065170.892589:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9200/0x14b4f8542d4fa18d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efd4 expref: 251 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.892595:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a9200, rc 0) 00000100:00100000:0.0:1746065170.892629:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31153:x1830881262584192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 417us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.892634:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9721 00000100:00100000:0.0:1746065170.900622:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.912157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.912182:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262584448 00000100:00100000:0.0:1746065170.912188:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262584448 00000100:00100000:0.0:1746065170.912218:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9722 00000100:00100000:0.0:1746065170.912225:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:31152:x1830881262584448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065170.912242:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.912258:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59400/0x14b4f8542d4fa19b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5efe2 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.912309:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59400/0x14b4f8542d4fa19b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efe2 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.912319:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59400/0x14b4f8542d4fa19b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efe2 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.912328:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065170.912330:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065170.912333:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a9200/0x14b4f8542d4fa18d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efd4 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.912339:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db59400, rc 0) 00000100:00100000:0.0:1746065170.912378:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:31152:x1830881262584448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 153us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.912384:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9722 00000100:00100000:0.0:1746065170.932199:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065170.934573:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260181120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065170.934599:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065170.934712:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260182016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065170.934729:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065170.934741:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260182528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065170.934794:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065170.934812:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065170.934829:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260181888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065170.934845:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065170.934857:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260182400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065170.934868:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065170.934886:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260182144 00000100:00100000:0.0:1746065170.934888:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260182144 00000100:00100000:0.0:1746065170.934904:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260182016 00000100:00100000:0.0:1746065170.934906:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260182016 00000100:00100000:0.0:1746065170.934925:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260180992 00000100:00100000:0.0:1746065170.934926:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260180992 00000100:00100000:0.0:1746065170.934932:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260181760 00000100:00100000:0.0:1746065170.934934:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260181760 00000100:00100000:0.0:1746065170.934939:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260182528 00000100:00100000:0.0:1746065170.934941:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260182528 00000100:00100000:0.0:1746065170.934946:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260181888 00000100:00100000:0.0:1746065170.934947:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260181888 00000100:00100000:0.0:1746065170.934957:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260182400 00000100:00100000:0.0:1746065170.934958:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260182400 00000100:00100000:0.0:1746065170.934966:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13570 00000100:00100000:0.0:1746065170.934971:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3298:x1830881260181120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065170.935079:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065170.935081:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065170.935083:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065170.935085:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065170.935086:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065170.935109:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3298:x1830881260181120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (510us total) trans 17179873443 rc 0/0 00000100:00100000:0.0:1746065170.935114:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13570 00000100:00100000:0.0:1746065170.935124:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13572 00000100:00100000:0.0:1746065170.935128:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881260182144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065170.936805:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260182144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1676us (2086us total) trans 21474840698 rc 0/0 00000100:00100000:0.0:1746065170.936960:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13572 00000100:00100000:0.0:1746065170.945077:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262584576 00000100:00100000:0.0:1746065170.945083:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262584576 00000100:00100000:0.0:1746065170.945110:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262584832 00000100:00100000:0.0:1746065170.945112:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262584832 00000100:00100000:0.0:1746065170.945123:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4096 00000100:00100000:0.0:1746065170.945328:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31153:x1830881262584576:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065170.945374:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31153:x1830881262584576:12345-192.168.202.46@tcp:49:cat.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.945697:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4096 00000100:00100000:0.0:1746065170.951078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.954475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.958729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.959483:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262585472 00000100:00100000:0.0:1746065170.959486:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262585472 00000100:00100000:0.0:1746065170.959504:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13587 00000100:00100000:0.0:1746065170.959509:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:31150:x1830881262585472:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065170.959516:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065170.959526:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f758800/0x14b4f8542d4fa1b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5eff7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.959541:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33e00/0x14b4f8542d4fa098 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef80 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.959551:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.959552:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065170.959554:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f758800/0x14b4f8542d4fa1b0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2707456->2973695] (req 2707456->2973695) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eff7 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.959569:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec33e00/0x14b4f8542d4fa098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef80 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065170.959577:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec33e00/0x14b4f8542d4fa098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef80 expref: 11 pid: 9716 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746065170.959584:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260183552:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065170.959620:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065170.960307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065170.965023:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33e00/0x14b4f8542d4fa098 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef80 expref: 12 pid: 9716 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746065170.965053:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260183552:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065170.965072:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f758800/0x14b4f8542d4fa1b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eff7 expref: 15 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065170.965081:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f758800, rc 0) 00000100:00100000:0.0:1746065170.965123:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:31150:x1830881262585472:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5612us (5903us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065170.965129:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13587 00000100:00100000:0.0:1746065170.973554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.977138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.983109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.983161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065170.988675:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262587008 00000100:00100000:0.0:1746065170.988686:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262587008 00002000:00100000:0.0:1746065170.988728:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880093ba0700 x1830881262587008/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:86/0 lens 488/0 e 0 to 0 dl 1746065181 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065170.988741:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0700 with x1830881262587008 ext(1048576->2097151) 00002000:00010000:0.0:1746065170.988746:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba0700 00000100:00100000:0.0:1746065170.988766:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7581 00000100:00100000:0.0:1746065170.988773:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881262587008:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065171.018335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.022936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.024657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.029697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.034089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.034117:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262588672 00000100:00100000:0.0:1746065171.034123:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262588672 00000100:00100000:0.0:1746065171.034169:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9724 00000100:00100000:0.0:1746065171.034176:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:31156:x1830881262588672:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065171.034195:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.034215:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9600/0x14b4f8542d4fa1d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f01a expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.034265:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4fa1da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.034279:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4fa1da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.034289:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9000/0x14b4f8542d4fa1da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.034300:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4fa1e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.034305:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4fa1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.034310:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e8c00/0x14b4f8542d4fa1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.034396:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4fa1e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.034404:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090ba7000/0x14b4f8542d4fa147 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efb1 expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.034410:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4fa155 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efaa expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.034416:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e9a00/0x14b4f8542d4fa1e8 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.034443:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4fa155 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efaa expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.034454:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3efe00/0x14b4f8542d4fa155 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efaa expref: 8 pid: 24350 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065171.034471:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260183936:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065171.034545:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090ba7000/0x14b4f8542d4fa147 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efb1 expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.034553:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090ba7000/0x14b4f8542d4fa147 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efb1 expref: 248 pid: 14644 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065171.034561:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260184064:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065171.034580:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065171.041451:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.041498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.041531:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262588928 00000100:00100000:0.0:1746065171.041538:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262588928 00000100:00100000:0.0:1746065171.041594:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262589184 00000100:00100000:0.0:1746065171.041597:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262589184 00000100:00100000:0.0:1746065171.041612:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4098 00000100:00100000:0.0:1746065171.041619:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:7711:x1830881262588928:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065171.043712:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:7711:x1830881262588928:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 2092us (2268us total) trans 8589943892 rc 0/0 00000100:00100000:0.0:1746065171.043721:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4098 00000100:00100000:0.0:1746065171.047036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.048409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.063487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.063787:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260184320:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065171.063805:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b6a2a00/0x14b4f8542d4fa1f6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f028 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.064766:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b6a2a00, rc 0) 00000100:00100000:0.0:1746065171.064796:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:31152:x1830881262589952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4692us (5094us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.064802:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13593 00000100:00100000:0.0:1746065171.067783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.070561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.078094:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.078188:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262590720 00000100:00100000:0.0:1746065171.078195:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262590720 00002000:00100000:0.0:1746065171.078239:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2707456->2973695) req@ffff88009f2c6300 x1830881262590720/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:87/0 lens 488/0 e 0 to 0 dl 1746065182 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065171.078247:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6300 with x1830881262590720 ext(2707456->2973695) 00010000:00010000:0.0:1746065171.078254:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f758800/0x14b4f8542d4fa1b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eff7 expref: 14 pid: 8427 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.078265:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f758800/0x14b4f8542d4fa1b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5eff7 expref: 14 pid: 8427 timeout: 870 lvb_type: 0 00002000:00010000:0.0:1746065171.078271:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c6300 00000100:00100000:0.0:1746065171.078292:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2317 00000100:00100000:0.0:1746065171.078299:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881262590720:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065171.084450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.089378:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.089424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.098233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.100589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.100633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.101218:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7589 00000100:00100000:0.0:1746065171.101226:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881262591872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065171.123994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.133216:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.133465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.133486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.148325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.155244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.155291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.155315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.155337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.155357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.173197:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881262593664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17714us (17955us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065171.173208:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7590 00002000:00100000:0.0:1746065171.173217:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd82d80 x1830881262593664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:87/0 lens 488/440 e 0 to 0 dl 1746065182 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065171.173225:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd82d80 with x1830881262593664 ext(2097152->3145727) 00002000:00010000:0.0:1746065171.173230:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd82d80 00000100:00100000:0.0:1746065171.200695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.209494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.244947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.249604:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262595584 00000100:00100000:0.0:1746065171.249611:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262595584 00000100:00100000:0.0:1746065171.249649:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13600 00000100:00100000:0.0:1746065171.249659:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+16:31161:x1830881262595584:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065171.249672:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.249686:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094630c00/0x14b4f8542d4fa29e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f07c expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.249709:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e38fe00/0x14b4f8542d4fa204 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f036 expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.249716:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55c2e00/0x14b4f8542d4fa289 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f075 expref: 17 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.249723:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c3f1e00/0x14b4f8542d4fa27b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f060 expref: 11 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065171.249728:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.249730:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.249733:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094630c00/0x14b4f8542d4fa29e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3543040->4182015] (req 3543040->4182015) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f07c expref: 17 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.249756:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c3f1e00/0x14b4f8542d4fa27b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f060 expref: 11 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065171.249767:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c3f1e00/0x14b4f8542d4fa27b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f060 expref: 11 pid: 2462 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746065171.249777:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260185216:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065171.249869:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55c2e00/0x14b4f8542d4fa289 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f075 expref: 17 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.249876:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55c2e00/0x14b4f8542d4fa289 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f075 expref: 17 pid: 4545 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065171.249884:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260185344:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065171.256618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.264046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.264093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.264616:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6823 00000100:00100000:0.0:1746065171.264624:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262596096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065171.264630:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065171.264639:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e38fe00/0x14b4f8542d4fa204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f036 expref: 23 pid: 4545 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.264646:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e38fe00/0x14b4f8542d4fa204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f036 expref: 23 pid: 4545 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.264657:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e38fe00/0x14b4f8542d4fa204 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f036 expref: 23 pid: 4545 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.264670:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065171.265550:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881262596096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 928us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.265556:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6823 00000100:00100000:0.0:1746065171.265985:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262596224 00000100:00100000:0.0:1746065171.265990:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262596224 00010000:00010000:0.0:1746065171.266006:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55c2e00/0x14b4f8542d4fa289 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f075 expref: 17 pid: 4545 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065171.266030:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6824 00000100:00100000:0.0:1746065171.266035:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262596224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065171.266042:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065171.266051:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55c2e00/0x14b4f8542d4fa289 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f075 expref: 17 pid: 4545 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.266060:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55c2e00/0x14b4f8542d4fa289 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f075 expref: 17 pid: 4545 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.266073:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55c2e00/0x14b4f8542d4fa289 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f075 expref: 17 pid: 4545 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.266083:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.266085:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.266090:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094630c00/0x14b4f8542d4fa29e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3543040->4182015) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f07c expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.266097:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094630c00/0x14b4f8542d4fa29e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3543040->4182015) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f07c expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.266122:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094630c00/0x14b4f8542d4fa29e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3543040->4182015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f07c expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065171.266135:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260185600:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065171.266183:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065171.273702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.289144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.296928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.425189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.431567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.445749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.445778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.445799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.445848:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597504 00000100:00100000:0.0:1746065171.445853:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597504 00010000:00010000:0.0:1746065171.445876:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e5800/0x14b4f8542d4fa1c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f00c expref: 18 pid: 2462 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065171.445893:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597760 00000100:00100000:0.0:1746065171.445895:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597760 00010000:00010000:0.0:1746065171.445912:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fa08a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef72 expref: 12 pid: 9716 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746065171.445924:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262597632 00000100:00100000:0.0:1746065171.445926:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262597632 00010000:00010000:0.0:1746065171.445934:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e5c00/0x14b4f8542d4fa1cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f013 expref: 11 pid: 2462 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065171.445945:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6825 00000100:00100000:0.0:1746065171.445951:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881262597504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065171.445961:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065171.445977:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e5800/0x14b4f8542d4fa1c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f00c expref: 18 pid: 2462 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.445984:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e5800/0x14b4f8542d4fa1c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f00c expref: 18 pid: 2462 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.446001:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e5800/0x14b4f8542d4fa1c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f00c expref: 18 pid: 2462 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.446017:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065171.446034:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881262597504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.446039:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6825 00000100:00100000:0.0:1746065171.446053:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6826 00000100:00100000:0.0:1746065171.446057:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1959:x1830881262597760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065171.446062:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065171.446067:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fa08a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef72 expref: 12 pid: 9716 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746065171.446074:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fa08a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef72 expref: 12 pid: 9716 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746065171.446083:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fa08a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef72 expref: 12 pid: 9716 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746065171.446093:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065171.446103:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881262597760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.446108:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6826 00000100:00100000:0.0:1746065171.446140:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6827 00000100:00100000:0.0:1746065171.446145:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881262597632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065171.446149:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065171.446155:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e5c00/0x14b4f8542d4fa1cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f013 expref: 11 pid: 2462 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.446163:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e5c00/0x14b4f8542d4fa1cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f013 expref: 11 pid: 2462 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.446173:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e5c00/0x14b4f8542d4fa1cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f013 expref: 11 pid: 2462 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746065171.446180:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.446182:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.446187:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c737400/0x14b4f8542d4fa2ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f083 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.446193:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c737400/0x14b4f8542d4fa2ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f083 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.446216:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c737400/0x14b4f8542d4fa2ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f083 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065171.446226:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260186112:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065171.446266:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065171.448256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.455640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.489968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.490017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065171.499256:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3f1200/0x14b4f8542d4fa266 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f052 expref: 10 pid: 2462 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746065171.500179:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260186240:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065171.500208:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55c3a00/0x14b4f8542d4fa282 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f06e expref: 18 pid: 4545 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065171.500219:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260186368:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065171.500227:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260186496:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065171.500254:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55c2e00/0x14b4f8542d4fa2c1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f091 expref: 17 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.500265:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55c2e00, rc 0) 00000100:00100000:0.0:1746065171.500289:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:31159:x1830881262598400:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9263us (10329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.500295:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13602 00000100:00100000:0.0:1746065171.503721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.503742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.503778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.503796:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599296 00000100:00100000:0.0:1746065171.503802:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599296 00000100:00100000:0.0:1746065171.503852:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599424 00000100:00100000:0.0:1746065171.503854:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599424 00000100:00100000:0.0:1746065171.503873:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599552 00000100:00100000:0.0:1746065171.503875:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599552 00000100:00100000:0.0:1746065171.503888:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13604 00000100:00100000:0.0:1746065171.503893:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881262599296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065171.503913:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.503927:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55c2200/0x14b4f8542d4fa2e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f0a6 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065171.503965:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260186752:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065171.504012:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065171.504055:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13605 00000100:00100000:0.0:1746065171.504059:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881262599424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065171.504065:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.504070:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c736800/0x14b4f8542d4fa2eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f0ad expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.504079:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.504086:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c736800/0x14b4f8542d4fa2eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0ad expref: 22 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065171.504094:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c736800/0x14b4f8542d4fa2eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0ad expref: 22 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065171.504107:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c736800, rc 0) 00000100:00100000:0.0:1746065171.504123:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881262599424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (381us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065171.504127:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13605 00000100:00100000:0.0:1746065171.504142:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13606 00000100:00100000:0.0:1746065171.504146:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881262599552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065171.504150:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.504157:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c736000/0x14b4f8542d4fa2f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f0b4 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065171.504173:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260186880:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065171.504186:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065171.512467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:0.0:1746065171.513891:0:2462:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime: 1746065171 -> 1746065172 00002000:00010000:0.0:1746065171.513895:0:2462:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime: 1746065171 -> 1746065172 00000100:00100000:0.0:1746065171.513919:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260186880:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065171.513936:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c736000/0x14b4f8542d4fa2f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0b4 expref: 23 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065171.513946:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c736000/0x14b4f8542d4fa2f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0b4 expref: 23 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065171.513955:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c736000, rc 0) 00000100:00100000:0.0:1746065171.513987:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881262599552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9840us (10208us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065171.513994:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13606 00000100:00100000:0.0:1746065171.520488:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262599936 00000100:00100000:0.0:1746065171.520494:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262599936 00002000:00100000:0.0:1746065171.520527:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f2c5500 x1830881262599936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:87/0 lens 488/0 e 0 to 0 dl 1746065182 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065171.520536:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5500 with x1830881262599936 ext(0->1048575) 00002000:00010000:0.0:1746065171.520541:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c5500 00000100:00100000:0.0:1746065171.520558:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7601 00000100:00100000:0.0:1746065171.520564:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262599936:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065171.525997:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262600192 00000100:00100000:0.0:1746065171.526004:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262600192 00002000:00100000:0.0:1746065171.526037:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2453504->2457599) req@ffff88009f2c6d80 x1830881262600192/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:87/0 lens 488/0 e 0 to 0 dl 1746065182 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065171.526046:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6d80 with x1830881262600192 ext(2453504->2457599) 00002000:00010000:0.0:1746065171.526051:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c6d80 00000100:00100000:0.0:1746065171.526077:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7602 00000100:00100000:0.0:1746065171.526084:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262600192:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065171.526216:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262600192:12345-192.168.202.46@tcp:3:cat.0 Request processed in 132us (300us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065171.526222:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7602 00002000:00100000:0.0:1746065171.526228:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2453504->2457599) req@ffff88009f2c6d80 x1830881262600192/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746065182 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065171.526234:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6d80 with x1830881262600192 ext(2453504->2457599) 00002000:00010000:0.0:1746065171.526237:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c6d80 00000100:00100000:0.0:1746065171.532570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.532654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.537744:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.539551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.544579:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.544613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.544628:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262601216 00000100:00100000:0.0:1746065171.544632:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262601216 00010000:00010000:0.0:1746065171.544658:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c315e00/0x14b4f8542d4fa227 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f044 expref: 9 pid: 16767 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746065171.545549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065171.546173:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fa300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.546179:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fa300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065171.546194:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065171.546297:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5b600/0x14b4f8542d4fa2f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0bb expref: 17 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.546329:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fa300 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0bb expref: 16 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.546335:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065171.546338:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065171.546339:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5a800, rc 0) 00000100:00100000:0.0:1746065171.546369:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:31173:x1830881262600832:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8225us (8626us total) trans 8589943903 rc 0/0 00000100:00100000:0.0:1746065171.546376:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9732 00000100:00100000:0.0:1746065171.551699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.559410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.572062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.577285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.585411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.596573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.602049:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.611116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.613576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.618050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.618079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.618298:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262603392 00000100:00100000:0.0:1746065171.618302:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262603392 00002000:00100000:0.0:1746065171.618322:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009c7adc00 x1830881262603392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:87/0 lens 488/0 e 0 to 0 dl 1746065182 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065171.618330:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7adc00 with x1830881262603392 ext(2097152->3145727) 00002000:00010000:0.0:1746065171.618333:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7adc00 00000100:00100000:0.0:1746065171.618344:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7607 00000100:00100000:0.0:1746065171.618349:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881262603136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065171.629179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.647221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.647382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.667889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.677431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.683203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.683241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.688440:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262605184 00000100:00100000:0.0:1746065171.688446:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262605184 00002000:00100000:0.0:1746065171.688474:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880134d87480 x1830881262605184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:87/0 lens 488/0 e 0 to 0 dl 1746065182 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065171.688482:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d87480 with x1830881262605184 ext(3145728->4194303) 00002000:00010000:0.0:1746065171.688487:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d87480 00000100:00100000:0.0:1746065171.688513:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7613 00000100:00100000:0.0:1746065171.688519:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881262605184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065171.713779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.717864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.727064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.731270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.734216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.737289:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262606208 00000100:00100000:0.0:1746065171.737293:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262606208 00000100:00100000:0.0:1746065171.737313:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13615 00000100:00100000:0.0:1746065171.737317:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881262606208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065171.737328:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.737336:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fa346 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f0fa expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065171.737358:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260188928:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065171.737377:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065171.743886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.749483:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.749528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.758161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.764935:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262607360 00000100:00100000:0.0:1746065171.764938:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262607360 00000100:00100000:0.0:1746065171.764967:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9733 00000100:00100000:0.0:1746065171.764972:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31176:x1830881262607360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065171.764989:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.765119:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61a00/0x14b4f8542d4fa354 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f108 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.765202:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765212:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765221:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765232:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765237:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765241:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765326:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fa369 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765334:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fa369 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765340:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fa369 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065171.765346:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065171.765403:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765408:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765413:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765417:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a61600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065171.765420:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765425:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765433:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065171.765435:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065171.765438:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765442:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fa35b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765464:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765468:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765475:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765480:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a60c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065171.765482:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765486:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765491:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e864600) 00010000:00010000:0.0:1746065171.765493:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065171.765495:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.765500:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60c00/0x14b4f8542d4fa362 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065171.766698:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61a00/0x14b4f8542d4fa354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f108 expref: 257 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.766710:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fa369 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f108 expref: 256 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.766716:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065171.766718:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065171.766720:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a60e00, rc 0) 00000100:00100000:0.0:1746065171.766758:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31176:x1830881262607360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1785us (2093us total) trans 8589943904 rc 0/0 00000100:00100000:0.0:1746065171.766764:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9733 00000100:00100000:0.0:1746065171.771811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.792322:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.798722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.802791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.812504:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260190336 00000100:00100000:0.0:1746065171.812507:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260190336 00000100:00100000:0.0:1746065171.812526:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1746065171.812530:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881260190336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065171.812555:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881260190336:12345-0@lo:400:kworker.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.812560:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1746065171.813727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.816131:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260190208 00000100:00100000:0.0:1746065171.816134:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260190208 00000100:00100000:0.0:1746065171.816152:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1746065171.816157:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260190208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065171.816182:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260190208:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.816187:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1746065171.816667:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260190720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065171.819979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.860084:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260190848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065171.860138:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065171.860850:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260190848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065171.885505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.900336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.914653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.914718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.946440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.946481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.946508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.947165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.947200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.948306:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260190976:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065171.948315:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260191104:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065171.948335:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900f8c00/0x14b4f8542d4fa3b6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f132 expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.948347:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900f8c00, rc 0) 00000100:00100000:0.0:1746065171.948374:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31176:x1830881262609920:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1775us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.948380:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13621 00000100:00100000:0.0:1746065171.950692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.983761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.983858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065171.983890:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262611200 00000100:00100000:0.0:1746065171.983896:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262611200 00000100:00100000:0.0:1746065171.983957:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9735 00000100:00100000:0.0:1746065171.983964:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31183:x1830881262611200:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065171.983981:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.983995:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4fa3bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f139 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065171.992593:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262611328 00000100:00100000:0.0:1746065171.992598:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262611328 00000100:00100000:0.0:1746065171.992622:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13622 00000100:00100000:0.0:1746065171.992627:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+15:31182:x1830881262611328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065171.992636:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065171.992649:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe12000/0x14b4f8542d4fa3d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f140 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.992666:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.992668:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065171.992675:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe12000/0x14b4f8542d4fa3d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f140 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.992686:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe12000/0x14b4f8542d4fa3d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f140 expref: 16 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065171.992695:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe12000, rc 0) 00000100:00100000:0.0:1746065171.992731:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+16:31182:x1830881262611328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065171.992742:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13622 00000100:00100000:0.0:1746065172.003030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.003083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.004248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.011835:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.015770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.019871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.019952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.020002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.020851:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.020888:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.023559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.023585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.023597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.023615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.024866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.024898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.025721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.031013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.032564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.035926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.045456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.049551:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.049806:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.052055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065172.052152:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065172.058672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.058720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.062869:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262617472 00000100:00100000:0.0:1746065172.062874:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262617472 00000100:00100000:0.0:1746065172.062919:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9739 00000100:00100000:0.0:1746065172.062925:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31190:x1830881262617472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065172.062939:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065172.062951:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b800/0x14b4f8542d4fa46c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f1a2 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.063043:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063051:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063059:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063068:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063073:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063077:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063161:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b400/0x14b4f8542d4fa481 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063168:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b400/0x14b4f8542d4fa481 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063172:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b400/0x14b4f8542d4fa481 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065172.063179:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065172.063236:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063241:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063248:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063254:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec4a800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065172.063256:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063261:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063269:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065172.063271:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065172.063274:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063278:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4a800/0x14b4f8542d4fa473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063297:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063302:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063306:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063309:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec4b600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065172.063311:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063315:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063323:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18600) 00010000:00010000:0.0:1746065172.063325:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065172.063326:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063330:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fa47a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.063355:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec4b800/0x14b4f8542d4fa46c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1a2 expref: 260 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.063363:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a11b400/0x14b4f8542d4fa481 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1a2 expref: 259 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.063367:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065172.063369:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065172.063370:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a11b400, rc 0) 00000100:00100000:0.0:1746065172.063401:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:31190:x1830881262617472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 477us (1118us total) trans 8589943913 rc 0/0 00000100:00100000:0.0:1746065172.063406:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9739 00000100:00100000:0.0:1746065172.069347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.069391:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.074964:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.078324:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.084314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.090943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.115125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.120074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.135034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.146363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.147383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.149414:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7630 00000100:00100000:0.0:1746065172.149422:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881262619904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065172.153528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.166236:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260193664:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065172.166261:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d01000/0x14b4f8542d4fa4b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065172.167073:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065172.168781:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d01000/0x14b4f8542d4fa4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065172.168787:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d01000/0x14b4f8542d4fa4b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065172.168802:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065172.168933:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9aa00/0x14b4f8542d4fa4ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1c5 expref: 24 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.168949:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d01000/0x14b4f8542d4fa4b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1c5 expref: 23 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.168954:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065172.168956:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065172.168958:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d01000, rc 0) 00000100:00100000:0.0:1746065172.168979:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:31194:x1830881262620288:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 14782us (15459us total) trans 8589943915 rc 0/0 00000100:00100000:0.0:1746065172.168988:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9740 00000100:00100000:0.0:1746065172.180369:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262620672 00000100:00100000:0.0:1746065172.180376:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262620672 00000100:00100000:0.0:1746065172.180422:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9741 00000100:00100000:0.0:1746065172.180429:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:31196:x1830881262620672:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065172.180448:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065172.180462:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c394a00/0x14b4f8542d4fa4c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f1cc expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.180550:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c394400/0x14b4f8542d4fa4c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065172.180566:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c394400/0x14b4f8542d4fa4c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065172.180577:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c394400/0x14b4f8542d4fa4c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065172.180588:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065172.180689:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c394a00/0x14b4f8542d4fa4c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1cc expref: 262 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.180920:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c394400/0x14b4f8542d4fa4c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1cc expref: 261 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.180928:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065172.180931:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065172.180933:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c394400, rc 0) 00000100:00100000:0.0:1746065172.180954:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31196:x1830881262620672:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 527us (741us total) trans 8589943916 rc 0/0 00000100:00100000:0.0:1746065172.180960:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9741 00000100:00100000:0.0:1746065172.202348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.219251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.246683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.254304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.261798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.266313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.266335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.266367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.266388:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622592 00000100:00100000:0.0:1746065172.266394:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622592 00010000:00010000:0.0:1746065172.266421:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fa3e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f147 expref: 11 pid: 8427 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746065172.266440:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622720 00000100:00100000:0.0:1746065172.266442:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622720 00010000:00010000:0.0:1746065172.266450:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fa2c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f098 expref: 16 pid: 8427 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746065172.266460:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262622848 00000100:00100000:0.0:1746065172.266462:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262622848 00010000:00010000:0.0:1746065172.266469:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75d600/0x14b4f8542d4fa30e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0c2 expref: 23 pid: 2462 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746065172.266481:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6860 00000100:00100000:0.0:1746065172.266487:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262622592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065172.266496:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065172.266514:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fa3e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f147 expref: 11 pid: 8427 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746065172.266522:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fa3e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f147 expref: 11 pid: 8427 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746065172.266540:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065172.266563:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262622592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065172.266568:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6860 00000100:00100000:0.0:1746065172.266583:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6861 00000100:00100000:0.0:1746065172.266587:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881262622720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065172.266592:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065172.266597:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fa2c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f098 expref: 16 pid: 8427 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746065172.266603:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fa2c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f098 expref: 16 pid: 8427 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746065172.266611:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065172.266619:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881262622720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065172.266623:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6861 00000100:00100000:0.0:1746065172.266650:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6862 00000100:00100000:0.0:1746065172.266654:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881262622848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065172.266658:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065172.266663:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d75d600/0x14b4f8542d4fa30e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0c2 expref: 23 pid: 2462 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746065172.266670:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d75d600/0x14b4f8542d4fa30e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0c2 expref: 23 pid: 2462 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746065172.266679:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d75d600/0x14b4f8542d4fa30e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f0c2 expref: 23 pid: 2462 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746065172.266690:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.266691:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.266696:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fa4f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1ef expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.266703:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fa4f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1ef expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.266723:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fa4f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1ef expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065172.266731:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260194816:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065172.266767:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065172.268711:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.270943:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260194816:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065172.270958:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065172.270983:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881262622848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4327us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065172.270993:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6862 00000100:00100000:0.0:1746065172.272228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.272266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.272712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.283467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.283502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.287585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.293486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.293575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.300084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.314746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.316371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.317331:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.333038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.342573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.342610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.342642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.349734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.354465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.354534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.357959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.362826:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881262626432:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7791us (8271us total) trans 17179873456 rc 0/0 00000100:00100000:0.0:1746065172.362837:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2333 00002000:00100000:0.0:1746065172.362847:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3563519) req@ffff880095357b80 x1830881262626432/t17179873456(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:88/0 lens 488/448 e 0 to 0 dl 1746065183 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065172.362861:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095357b80 with x1830881262626432 ext(3145728->3563519) 00010000:00010000:0.0:1746065172.362870:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b960200/0x14b4f8542d4fa506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f204 expref: 27 pid: 21998 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746065172.362880:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b960200/0x14b4f8542d4fa506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f204 expref: 27 pid: 21998 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746065172.362885:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095357b80 00000100:00100000:0.0:1746065172.367253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.367944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.371618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.371658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.372046:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7639 00000100:00100000:0.0:1746065172.372054:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881262627328:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065172.385400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.385776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.390582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.392945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.400080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.412775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.416676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.443727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.462771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.477630:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.491690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.492875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.492916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.492943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.492958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.492989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.494696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.494716:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630016 00000100:00100000:0.0:1746065172.494721:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630016 00000100:00100000:0.0:1746065172.494748:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630272 00000100:00100000:0.0:1746065172.494750:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630272 00000100:00100000:0.0:1746065172.494759:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630400 00000100:00100000:0.0:1746065172.494761:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630400 00000100:00100000:0.0:1746065172.494772:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262630528 00000100:00100000:0.0:1746065172.494773:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262630528 00000100:00100000:0.0:1746065172.494786:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13655 00000100:00100000:0.0:1746065172.494793:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+15:31208:x1830881262630016:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065172.494806:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065172.494838:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b93d000/0x14b4f8542d4fa56f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f258 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.494864:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b9aa00/0x14b4f8542d4fa50d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f20b expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.494872:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4fa522 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f220 expref: 24 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.494878:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.494879:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.494882:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b93d000/0x14b4f8542d4fa56f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2592768->3145727] (req 2592768->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f258 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.494921:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4fa522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f220 expref: 24 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.494932:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d75c200/0x14b4f8542d4fa522 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f220 expref: 24 pid: 4545 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746065172.494944:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260197504:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065172.495013:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b9aa00/0x14b4f8542d4fa50d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f20b expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.495021:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b9aa00/0x14b4f8542d4fa50d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f20b expref: 16 pid: 21998 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746065172.495029:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260197632:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065172.495047:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065172.495066:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13656 00000100:00100000:0.0:1746065172.495072:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881262630272:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065172.495079:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065172.495088:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x14b4f8542d4fa576 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f25f expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.495100:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.495101:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.495108:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x14b4f8542d4fa576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f25f expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.495120:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x14b4f8542d4fa576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f25f expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.495129:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467e00, rc 0) 00000100:00100000:0.0:1746065172.495147:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881262630272:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 75us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065172.495152:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13656 00000100:00100000:0.0:1746065172.495171:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13657 00000100:00100000:0.0:1746065172.495176:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881262630400:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065172.495181:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065172.495187:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd06e00/0x14b4f8542d4fa57d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f266 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.495197:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.495198:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.495202:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd06e00/0x14b4f8542d4fa57d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f266 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.495210:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd06e00/0x14b4f8542d4fa57d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f266 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.495217:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd06e00, rc 0) 00000100:00100000:0.0:1746065172.495230:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881262630400:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 54us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065172.495235:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13657 00000100:00100000:0.0:1746065172.495245:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13658 00000100:00100000:0.0:1746065172.495250:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881262630528:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065172.495255:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065172.495260:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd06c00/0x14b4f8542d4fa584 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f26d expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.495269:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.495270:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.495274:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd06c00/0x14b4f8542d4fa584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f26d expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.495282:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd06c00/0x14b4f8542d4fa584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f26d expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.495288:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd06c00, rc 0) 00000100:00100000:0.0:1746065172.495301:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881262630528:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 52us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065172.495305:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13658 00000100:00100000:0.0:1746065172.498784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.498875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.500144:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881262629632:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065172.509904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.512800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.517800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.521056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.521359:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881262629632:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25365us (29675us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065172.521369:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7643 00002000:00100000:0.0:1746065172.521375:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009f235f80 x1830881262629632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:88/0 lens 488/440 e 0 to 0 dl 1746065183 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065172.521382:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f235f80 with x1830881262629632 ext(2097152->3145727) 00002000:00010000:0.0:1746065172.521386:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f235f80 00000100:00100000:0.0:1746065172.523732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.523952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.528508:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.528532:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262631808 00000100:00100000:0.0:1746065172.528539:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262631808 00010000:00010000:0.0:1746065172.528570:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25c000/0x14b4f8542d4fa49d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f1b7 expref: 29 pid: 8851 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746065172.536661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.536705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.536744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.536763:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262632576 00000100:00100000:0.0:1746065172.536766:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262632576 00002000:00100000:0.0:1746065172.536797:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1097728->1101823) req@ffff8800900c1880 x1830881262632576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:88/0 lens 488/0 e 0 to 0 dl 1746065183 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065172.536806:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1880 with x1830881262632576 ext(1097728->1101823) 00002000:00010000:0.0:1746065172.536810:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c1880 00000100:00100000:0.0:1746065172.536859:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262632832 00000100:00100000:0.0:1746065172.536862:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262632832 00002000:00100000:0.0:1746065172.536874:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2592768->2596863) req@ffff8800900c1c00 x1830881262632832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:88/0 lens 488/0 e 0 to 0 dl 1746065183 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065172.536886:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1c00 with x1830881262632832 ext(2592768->2596863) 00010000:00010000:0.0:1746065172.536891:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b93d000/0x14b4f8542d4fa56f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f258 expref: 15 pid: 2462 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746065172.536913:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b93d000/0x14b4f8542d4fa56f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f258 expref: 15 pid: 2462 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746065172.536919:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900c1c00 00000100:00100000:0.0:1746065172.537586:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2337 00000100:00100000:0.0:1746065172.537593:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881262632832:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065172.537701:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881262632832:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 109us (957us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065172.537707:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2337 00002000:00100000:0.0:1746065172.537712:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2592768->2596863) req@ffff8800900c1c00 x1830881262632832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746065183 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065172.537719:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1c00 with x1830881262632832 ext(2592768->2596863) 00010000:00010000:0.0:1746065172.537724:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b93d000/0x14b4f8542d4fa56f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f258 expref: 15 pid: 2462 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746065172.537733:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b93d000/0x14b4f8542d4fa56f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f258 expref: 15 pid: 2462 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746065172.537739:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900c1c00 00000100:00100000:0.0:1746065172.541721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.543527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.543557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.544586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.549998:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.550422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.550456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.554236:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.554259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.559606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.564713:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4112 00000100:00100000:0.0:1746065172.564736:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31210:x1830881262634880:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065172.564946:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:31210:x1830881262634880:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 223us (5340us total) trans 8589943919 rc 0/0 00000100:00100000:0.0:1746065172.564953:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4112 00000100:00100000:0.0:1746065172.565919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.570372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.591788:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.596140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.602516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.609920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.623466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.640959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.640999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.641041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.649570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.653423:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.666420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.680334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.680428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.680465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.690672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.703293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.704854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.704878:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.704926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.712198:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.715902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065172.717212:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094883200/0x14b4f8542d4fa656 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.717217:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094883200/0x14b4f8542d4fa656 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065172.717225:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065172.717272:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094883000/0x14b4f8542d4fa64f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f300 expref: 15 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.717285:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094883200/0x14b4f8542d4fa656 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f300 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.717290:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065172.717292:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065172.717294:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094883200, rc 0) 00000100:00100000:0.0:1746065172.717309:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31220:x1830881262639488:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 819us (1423us total) trans 8589943922 rc 0/0 00000100:00100000:0.0:1746065172.717313:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9748 00000100:00100000:0.0:1746065172.722806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.723383:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262640128 00000100:00100000:0.0:1746065172.723386:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262640128 00000100:00100000:0.0:1746065172.723411:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9749 00000100:00100000:0.0:1746065172.723417:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31220:x1830881262640128:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065172.723431:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065172.723445:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4800/0x14b4f8542d4fa66b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f307 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.723505:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4a00/0x14b4f8542d4fa672 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.723518:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a800/0x14b4f8542d4fa648 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2f9 expref: 24 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.723524:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094883200/0x14b4f8542d4fa656 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f300 expref: 15 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.723529:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4a00/0x14b4f8542d4fa672 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.723552:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094883200/0x14b4f8542d4fa656 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f300 expref: 15 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.723561:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094883200/0x14b4f8542d4fa656 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f300 expref: 15 pid: 20754 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065172.723571:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260200448:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065172.723631:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a800/0x14b4f8542d4fa648 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2f9 expref: 24 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.723638:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a800/0x14b4f8542d4fa648 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2f9 expref: 24 pid: 16767 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065172.723645:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260200576:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065172.723662:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065172.728191:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260200448:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065172.729005:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7657 00000100:00100000:0.0:1746065172.729012:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881262640768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065172.735347:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260200576:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065172.735368:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4a00/0x14b4f8542d4fa672 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.736016:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4a00/0x14b4f8542d4fa672 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.736022:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4a00/0x14b4f8542d4fa672 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065172.736054:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00000004:00200000:0.0:1746065172.736058:0:20754:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065172.736071:0:20754:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4a00/0x14b4f8542d4fa672 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.736095:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4800/0x14b4f8542d4fa66b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f307 expref: 15 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.736122:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4a00/0x14b4f8542d4fa672 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f307 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.736128:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065172.736130:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065172.736133:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093fc4a00, rc 0) 00000100:00100000:0.0:1746065172.736156:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31220:x1830881262640128:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 12739us (12824us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065172.736162:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9749 00000100:00100000:0.0:1746065172.755008:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262641280 00000100:00100000:0.0:1746065172.755015:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262641280 00000100:00100000:0.0:1746065172.755055:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9750 00000100:00100000:0.0:1746065172.755062:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31220:x1830881262641280:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065172.755076:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065172.755090:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3000/0x14b4f8542d4fa679 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f30e expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.755161:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755173:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755181:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755190:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755195:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755204:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755208:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130dd3c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065172.755211:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755217:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755224:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065172.755227:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065172.755230:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755234:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3c00/0x14b4f8542d4fa680 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065172.755357:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3000/0x14b4f8542d4fa679 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f30e expref: 15 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.755364:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130dd3000/0x14b4f8542d4fa679 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f30e expref: 15 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.755371:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130dd3000, rc 0) 00000100:00100000:0.0:1746065172.755409:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31220:x1830881262641280:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 348us (440us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065172.755414:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9750 00000100:00100000:0.0:1746065172.761567:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.761850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.781354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.792935:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.796427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.798651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.817589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.818313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.875539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.881749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.881786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.881864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.881984:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6892 00000100:00100000:0.0:1746065172.881993:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881262643456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065172.881999:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065172.882084:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d75c800/0x14b4f8542d4fa530 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f22e expref: 29 pid: 21998 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065172.882094:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d75c800/0x14b4f8542d4fa530 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f22e expref: 29 pid: 21998 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065172.882106:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d75c800/0x14b4f8542d4fa530 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f22e expref: 29 pid: 21998 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065172.882118:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065172.882135:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881262643456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 145us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065172.882140:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6892 00000100:00100000:0.0:1746065172.885570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.890077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.892424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.893082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065172.893481:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd06c00/0x14b4f8542d4fa584 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f26d expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065172.893489:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd06c00/0x14b4f8542d4fa584 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f26d expref: 11 pid: 4545 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746065172.893497:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260201600:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065172.893519:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d75d600/0x14b4f8542d4fa537 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f235 expref: 24 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.893526:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d75d600/0x14b4f8542d4fa537 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f235 expref: 24 pid: 21998 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065172.893533:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260201728:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065172.893547:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065172.895445:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260201472:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065172.897451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.897469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.897504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.897606:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6895 00000100:00100000:0.0:1746065172.897853:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881262644352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065172.897860:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065172.898074:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fa545 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f243 expref: 18 pid: 21998 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065172.898083:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fa545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f243 expref: 18 pid: 21998 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065172.898095:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fa545 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f243 expref: 18 pid: 21998 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065172.898342:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.898344:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.898350:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf29400/0x14b4f8542d4fa6c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f331 expref: 17 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.898358:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf29400/0x14b4f8542d4fa6c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f331 expref: 17 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.898381:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf29400/0x14b4f8542d4fa6c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f331 expref: 17 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065172.898391:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260201856:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065172.898444:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065172.902365:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.902718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.902759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.906015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.906655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.909074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.912316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.917464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.961172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065172.965944:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065172.973874:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.973912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.973948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.973981:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262646656 00000100:00100000:0.0:1746065172.973985:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262646656 00010000:00010000:0.0:1746065172.976344:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094882a00/0x14b4f8542d4fa633 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2f2 expref: 11 pid: 8428 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746065172.977182:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6901 00000100:00100000:0.0:1746065172.977195:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881262646656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065172.977207:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065172.977227:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094882a00/0x14b4f8542d4fa633 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2f2 expref: 11 pid: 8428 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065172.977239:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094882a00/0x14b4f8542d4fa633 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2f2 expref: 11 pid: 8428 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065172.977258:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.977260:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065172.977267:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf29c00/0x14b4f8542d4fa6fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f354 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.977275:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf29c00/0x14b4f8542d4fa6fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f354 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065172.977311:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf29c00/0x14b4f8542d4fa6fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f354 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065172.977321:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260202752:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065172.977381:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065172.985376:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065172.992048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.000458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.000614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065173.001119:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065173.001514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.001543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.001573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.001736:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6902 00000100:00100000:0.0:1746065173.001743:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262647552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.001751:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.001769:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fa63a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2eb expref: 11 pid: 8851 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.001778:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fa63a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2eb expref: 11 pid: 8851 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.001791:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fa63a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2eb expref: 11 pid: 8851 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.001806:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.001841:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262647552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 99us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.001847:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6902 00000100:00100000:0.0:1746065173.001878:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6903 00000100:00100000:0.0:1746065173.001883:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881262647808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.001888:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.001907:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092775a00/0x14b4f8542d4fa5c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f290 expref: 25 pid: 2462 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.001914:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092775a00/0x14b4f8542d4fa5c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f290 expref: 25 pid: 2462 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.001924:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092775a00/0x14b4f8542d4fa5c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f290 expref: 25 pid: 2462 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.001931:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.001945:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881262647808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 62us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.001949:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6903 00000100:00100000:0.0:1746065173.012074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.015222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.015292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.018677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.028202:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881262648576:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11806us (12899us total) trans 0 rc 540672/540672 00000100:00100000:0.0:1746065173.028213:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7667 00002000:00100000:0.0:1746065173.028222:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1556480->2097151) req@ffff88009baa3800 x1830881262648576/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:89/0 lens 488/440 e 0 to 0 dl 1746065184 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.028232:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3800 with x1830881262648576 ext(1556480->2097151) 00002000:00010000:0.0:1746065173.028238:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa3800 00000100:00100000:0.0:1746065173.049114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.049147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.049206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.049245:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262649216 00000100:00100000:0.0:1746065173.049251:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262649216 00000100:00100000:0.0:1746065173.049280:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262649344 00000100:00100000:0.0:1746065173.049281:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262649344 00000100:00100000:0.0:1746065173.049293:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13683 00000100:00100000:0.0:1746065173.049299:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881262649216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.049313:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.049326:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130dd2800/0x14b4f8542d4fa71a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f377 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065173.049364:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260203520:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065173.049427:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065173.049442:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13684 00000100:00100000:0.0:1746065173.049446:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881262649344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.049452:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.049460:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130dd3200/0x14b4f8542d4fa721 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f37e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065173.049481:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260203648:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065173.049495:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065173.062240:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262649600 00000100:00100000:0.0:1746065173.062247:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262649600 00002000:00100000:0.0:1746065173.062278:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4640767) req@ffff88009f2c5c00 x1830881262649600/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.062287:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5c00 with x1830881262649600 ext(4194304->4640767) 00010000:00010000:0.0:1746065173.062293:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf28600/0x14b4f8542d4fa705 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f35b expref: 24 pid: 21998 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.062305:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf28600/0x14b4f8542d4fa705 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f35b expref: 24 pid: 21998 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746065173.062310:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c5c00 00000100:00100000:0.0:1746065173.062331:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2341 00000100:00100000:0.0:1746065173.062337:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881262649600:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065173.076804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.087259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.100948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.100986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.101015:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.111905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.119355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.126225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.133174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.142526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.150065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.155366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.165775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.165907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.165931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.165944:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.165960:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652032 00000100:00100000:0.0:1746065173.165967:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652032 00002000:00100000:0.0:1746065173.166000:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012f10c000 x1830881262652032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.166008:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f10c000 with x1830881262652032 ext(1048576->2097151) 00002000:00010000:0.0:1746065173.166013:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f10c000 00000100:00100000:0.0:1746065173.166035:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652160 00000100:00100000:0.0:1746065173.166037:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652160 00002000:00100000:0.0:1746065173.166045:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012f10fb80 x1830881262652160/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.166052:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f10fb80 with x1830881262652160 ext(2097152->3145727) 00002000:00010000:0.0:1746065173.166054:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f10fb80 00000100:00100000:0.0:1746065173.166061:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652288 00000100:00100000:0.0:1746065173.166062:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652288 00002000:00100000:0.0:1746065173.166070:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012f10f100 x1830881262652288/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.166076:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f10f100 with x1830881262652288 ext(3145728->4194303) 00002000:00010000:0.0:1746065173.166078:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f10f100 00000100:00100000:0.0:1746065173.168032:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262652544 00000100:00100000:0.0:1746065173.168037:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262652544 00002000:00100000:0.0:1746065173.168057:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800a0085c00 x1830881262652544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.168065:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085c00 with x1830881262652544 ext(3145728->4194303) 00010000:00010000:0.0:1746065173.168070:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fa73d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f385 expref: 17 pid: 8428 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.168079:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fa73d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f385 expref: 17 pid: 8428 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746065173.168085:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0085c00 00000100:00100000:0.0:1746065173.168096:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2344 00000100:00100000:0.0:1746065173.168101:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881262652544:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065173.169349:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7669 00000100:00100000:0.0:1746065173.169358:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881262652032:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065173.193880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.197794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.204992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.208932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.208975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.216169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.216234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.242400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.243440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.243475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.243503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.243526:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654080 00000100:00100000:0.0:1746065173.243531:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654080 00000100:00100000:0.0:1746065173.243560:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654208 00000100:00100000:0.0:1746065173.243563:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654208 00000100:00100000:0.0:1746065173.243579:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654336 00000100:00100000:0.0:1746065173.243582:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654336 00000100:00100000:0.0:1746065173.243602:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13695 00000100:00100000:0.0:1746065173.243610:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881262654080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.243625:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.243638:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf29800/0x14b4f8542d4fa798 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f3d2 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.243653:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.243655:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.243671:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf29800/0x14b4f8542d4fa798 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3d2 expref: 28 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.243683:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf29800/0x14b4f8542d4fa798 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3d2 expref: 28 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.243690:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf29800, rc 0) 00000100:00100000:0.0:1746065173.243711:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881262654080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.243718:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13695 00000100:00100000:0.0:1746065173.243733:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13697 00000100:00100000:0.0:1746065173.243738:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262654336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.244435:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.244445:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf28200/0x14b4f8542d4fa7a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f3e0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.244464:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf28200/0x14b4f8542d4fa7a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3e0 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.244473:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf28200/0x14b4f8542d4fa7a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3e0 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.244495:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf28200, rc 0) 00000100:00100000:0.0:1746065173.244517:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262654336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 778us (1015us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065173.244523:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13697 00000100:00100000:0.0:1746065173.244544:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262654464 00000100:00100000:0.0:1746065173.244548:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262654464 00000100:00100000:0.0:1746065173.251964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.252920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.253783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.279349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.279445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.279472:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262655616 00000100:00100000:0.0:1746065173.279478:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262655616 00000100:00100000:0.0:1746065173.279514:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262655488 00000100:00100000:0.0:1746065173.279516:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262655488 00000100:00100000:0.0:1746065173.279531:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13699 00000100:00100000:0.0:1746065173.279536:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881262655616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.279554:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.279567:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094883c00/0x14b4f8542d4fa7b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f3f5 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065173.279611:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260205696:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065173.279677:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065173.279692:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13700 00000100:00100000:0.0:1746065173.279697:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262655488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.279712:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.279720:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094883600/0x14b4f8542d4fa7bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f3ee expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.279735:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094883600/0x14b4f8542d4fa7bb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3ee expref: 20 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.279744:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094883600/0x14b4f8542d4fa7bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3ee expref: 20 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.279765:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094883600, rc 0) 00000100:00100000:0.0:1746065173.279782:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262655488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 85us (337us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065173.279787:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13700 00000100:00100000:0.0:1746065173.284181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.289001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.289046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.293783:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262656128 00000100:00100000:0.0:1746065173.293789:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262656128 00002000:00100000:0.0:1746065173.293829:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2957312->3145727) req@ffff88009f2c4e00 x1830881262656128/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.293842:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4e00 with x1830881262656128 ext(2957312->3145727) 00010000:00010000:0.0:1746065173.293848:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a003b800/0x14b4f8542d4fa77c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2957312->3145727] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3b6 expref: 28 pid: 21998 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.293858:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a003b800/0x14b4f8542d4fa77c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2957312->3145727] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3b6 expref: 28 pid: 21998 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746065173.293864:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c4e00 00000100:00100000:0.0:1746065173.293884:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2346 00000100:00100000:0.0:1746065173.293898:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881262656128:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065173.320877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.320910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.320923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.320938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.320956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.320977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.320996:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262657536 00000100:00100000:0.0:1746065173.321002:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262657536 00010000:00010000:0.0:1746065173.321032:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3b6400/0x14b4f8542d4fa132 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef9c expref: 29 pid: 4544 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065173.321051:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262657664 00000100:00100000:0.0:1746065173.321053:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262657664 00010000:00010000:0.0:1746065173.321061:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094a28200/0x14b4f8542d4fa075 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef5d expref: 10 pid: 21235 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746065173.321076:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262657792 00000100:00100000:0.0:1746065173.321078:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262657792 00010000:00010000:0.0:1746065173.321085:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75f000/0x14b4f8542d4fa139 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efa3 expref: 21 pid: 8851 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065173.321203:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6913 00000100:00100000:0.0:1746065173.321211:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881262657536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.321222:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.321246:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f3b6400/0x14b4f8542d4fa132 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef9c expref: 30 pid: 4544 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.321256:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f3b6400/0x14b4f8542d4fa132 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ef9c expref: 30 pid: 4544 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.321276:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.321423:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881262657536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 213us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.321463:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6913 00000100:00100000:0.0:1746065173.323611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.324067:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262657408 00000100:00100000:0.0:1746065173.324072:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262657408 00002000:00100000:0.0:1746065173.324097:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3149824->4194303) req@ffff880095350700 x1830881262657408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.324106:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350700 with x1830881262657408 ext(3149824->4194303) 00002000:00010000:0.0:1746065173.324110:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350700 00000100:00100000:0.0:1746065173.324132:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7680 00000100:00100000:0.0:1746065173.324138:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262657408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065173.336023:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262658048 00000100:00100000:0.0:1746065173.336030:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262658048 00002000:00100000:0.0:1746065173.336066:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (372736->376831) req@ffff88009f2c5880 x1830881262658048/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.336075:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5880 with x1830881262658048 ext(372736->376831) 00002000:00010000:0.0:1746065173.336079:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c5880 00000100:00100000:0.0:1746065173.336253:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7681 00000100:00100000:0.0:1746065173.336261:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262658048:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065173.336401:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262658048:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 141us (431us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065173.336407:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7681 00002000:00100000:0.0:1746065173.336411:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (372736->376831) req@ffff88009f2c5880 x1830881262658048/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:89/0 lens 488/4536 e 0 to 0 dl 1746065184 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.336417:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5880 with x1830881262658048 ext(372736->376831) 00002000:00010000:0.0:1746065173.336420:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c5880 00000100:00100000:0.0:1746065173.362639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.362680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.371674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.383201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.390382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.392513:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262659072 00000100:00100000:0.0:1746065173.392517:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262659072 00000100:00100000:0.0:1746065173.392541:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13708 00000100:00100000:0.0:1746065173.392547:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881262659072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.392554:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.392563:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094883c00/0x14b4f8542d4fa7f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f42d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065173.392585:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260207232:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065173.392604:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065173.396577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.396621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.430173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.435563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.435603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.438501:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.439154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.442082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.442129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.449538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.451898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.456375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.459842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.466067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.466152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.466396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.467569:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13716 00000100:00100000:0.0:1746065173.467575:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262662016:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065173.467581:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.467588:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094882800/0x14b4f8542d4fa86a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f473 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065173.467606:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260208640:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065173.467627:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065173.471071:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260208640:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065173.471098:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094882800/0x14b4f8542d4fa86a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f473 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.471110:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094882800/0x14b4f8542d4fa86a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f473 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.471139:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094882800, rc 0) 00000100:00100000:0.0:1746065173.471175:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262662016:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3599us (4778us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065173.471183:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13716 00000100:00100000:0.0:1746065173.476067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.480654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.480758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.481253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.482268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.482328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.482363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.490254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.490352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.490386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.491966:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663936 00000100:00100000:0.0:1746065173.491971:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663936 00002000:00100000:0.0:1746065173.491996:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2101247) req@ffff8800a90afb80 x1830881262663936/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 4584/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.492003:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90afb80 with x1830881262663936 ext(2097152->2101247) 00010000:00010000:0.0:1746065173.492008:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130dd2000/0x14b4f8542d4fa791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3cb expref: 31 pid: 8428 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.492016:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130dd2000/0x14b4f8542d4fa791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3cb expref: 31 pid: 8428 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746065173.492021:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a90afb80 00000100:00100000:0.0:1746065173.492044:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2349 00000100:00100000:0.0:1746065173.492050:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262663936:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065173.492329:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262663936:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 278us (415us total) trans 17179873462 rc 0/0 00000100:00100000:0.0:1746065173.492335:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2349 00002000:00100000:0.0:1746065173.492341:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2101247) req@ffff8800a90afb80 x1830881262663936/t17179873462(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 4584/448 e 0 to 0 dl 1746065184 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.492347:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90afb80 with x1830881262663936 ext(2097152->2101247) 00010000:00010000:0.0:1746065173.492352:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130dd2000/0x14b4f8542d4fa791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3cb expref: 33 pid: 8428 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.492359:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130dd2000/0x14b4f8542d4fa791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3cb expref: 33 pid: 8428 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746065173.492369:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a90afb80 00000100:00100000:0.0:1746065173.496239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.496274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.499907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.499922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.499939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.499951:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664320 00000100:00100000:0.0:1746065173.499954:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664320 00010000:00010000:0.0:1746065173.499969:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50bbe00/0x14b4f8542d4fa7c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3fc expref: 30 pid: 4544 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065173.499981:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262663424 00000100:00100000:0.0:1746065173.499983:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262663424 00010000:00010000:0.0:1746065173.499990:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f201400/0x14b4f8542d4fa832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f442 expref: 14 pid: 21235 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746065173.499998:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664192 00000100:00100000:0.0:1746065173.499999:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664192 00010000:00010000:0.0:1746065173.500005:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a565b800/0x14b4f8542d4fa62c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2e4 expref: 15 pid: 4544 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746065173.500013:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6924 00000100:00100000:0.0:1746065173.500017:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262664320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.500024:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.500033:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50bbe00/0x14b4f8542d4fa7c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3fc expref: 30 pid: 4544 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.500045:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50bbe00/0x14b4f8542d4fa7c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3fc expref: 31 pid: 4544 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.500056:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50bbe00/0x14b4f8542d4fa7c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3fc expref: 31 pid: 4544 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.500066:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.500082:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262664320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.500086:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6924 00000100:00100000:0.0:1746065173.500098:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6925 00000100:00100000:0.0:1746065173.500103:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881262663424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.500108:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.500115:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f201400/0x14b4f8542d4fa832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f442 expref: 15 pid: 21235 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.500123:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f201400/0x14b4f8542d4fa832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f442 expref: 15 pid: 21235 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.500134:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f201400/0x14b4f8542d4fa832 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f442 expref: 15 pid: 21235 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.500141:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.500222:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881262663424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 119us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.500229:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6925 00000100:00100000:0.0:1746065173.500252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.500910:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664448 00000100:00100000:0.0:1746065173.500913:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664448 00010000:00010000:0.0:1746065173.500926:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a565a000/0x14b4f8542d4fa687 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f315 expref: 32 pid: 21998 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746065173.500941:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6927 00000100:00100000:0.0:1746065173.500946:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881262664448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.500952:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.500959:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a565a000/0x14b4f8542d4fa687 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f315 expref: 32 pid: 21998 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.500967:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a565a000/0x14b4f8542d4fa687 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f315 expref: 32 pid: 21998 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.500976:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a565a000/0x14b4f8542d4fa687 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f315 expref: 32 pid: 21998 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746065173.500984:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.500998:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262664448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.501003:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6927 00000100:00100000:0.0:1746065173.501040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.501049:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664576 00000100:00100000:0.0:1746065173.501051:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664576 00010000:00010000:0.0:1746065173.501060:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fa783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3bd expref: 20 pid: 21998 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065173.501071:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6929 00000100:00100000:0.0:1746065173.501074:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f236d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262664576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.501080:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.501087:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fa783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3bd expref: 20 pid: 21998 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.501095:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fa783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3bd expref: 20 pid: 21998 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.501105:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fa783 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3bd expref: 20 pid: 21998 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.501112:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.501114:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.501116:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f200800/0x14b4f8542d4fa894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.501122:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f200800/0x14b4f8542d4fa894 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.501134:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.501147:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f236d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881262664576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.501152:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6929 00000100:00100000:0.0:1746065173.501187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.501197:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664704 00000100:00100000:0.0:1746065173.501200:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664704 00010000:00010000:0.0:1746065173.501209:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1ca800/0x14b4f8542d4fa609 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2d6 expref: 26 pid: 2462 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065173.501236:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6930 00000100:00100000:0.0:1746065173.501240:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881262664704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.501245:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.501252:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f1ca800/0x14b4f8542d4fa609 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2d6 expref: 26 pid: 2462 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.501259:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f1ca800/0x14b4f8542d4fa609 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2d6 expref: 26 pid: 2462 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.501268:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1ca800/0x14b4f8542d4fa609 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f2d6 expref: 26 pid: 2462 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.501275:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.501276:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.501278:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fc4600/0x14b4f8542d4fa8a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.501284:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fc4600/0x14b4f8542d4fa8a9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.502005:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.502021:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881262664704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 780us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.502029:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6930 00000100:00100000:0.0:1746065173.502085:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.502097:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262664832 00000100:00100000:0.0:1746065173.502099:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262664832 00010000:00010000:0.0:1746065173.502110:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130dd2000/0x14b4f8542d4fa791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3cb expref: 31 pid: 8428 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065173.502140:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6931 00000100:00100000:0.0:1746065173.502145:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f236300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881262664832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.502151:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.502160:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130dd2000/0x14b4f8542d4fa791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3cb expref: 31 pid: 8428 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.502167:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130dd2000/0x14b4f8542d4fa791 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3cb expref: 31 pid: 8428 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.502177:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130dd2000/0x14b4f8542d4fa791 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f3cb expref: 31 pid: 8428 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.502184:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.502185:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.502187:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f201a00/0x14b4f8542d4fa8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.502193:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f201a00/0x14b4f8542d4fa8a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.502207:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.502221:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f236300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881262664832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.502225:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6931 00000100:00100000:0.0:1746065173.506207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065173.506718:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.506725:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.506742:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.506748:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.506754:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.506759:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f200c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065173.506762:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.506768:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.506781:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.506786:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fa89b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065173.506845:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262662912:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 23728us (24515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.506851:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13721 00000100:00100000:0.0:1746065173.512438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.515499:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665344 00000100:00100000:0.0:1746065173.515505:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665344 00000100:00100000:0.0:1746065173.515638:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9761 00000100:00100000:0.0:1746065173.515645:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:31255:x1830881262665344:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:0.0:1746065173.515690:0:20754:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.515710:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc5200/0x14b4f8542d4fa855 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f465 expref: 20 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.515722:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065173.515726:0:20754:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.516594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.516689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.516705:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665472 00000100:00100000:0.0:1746065173.516709:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665472 00000100:00100000:0.0:1746065173.517777:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665600 00000100:00100000:0.0:1746065173.517781:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665600 00000100:00100000:0.0:1746065173.518527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.518564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.518582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.518594:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665728 00000100:00100000:0.0:1746065173.518597:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665728 00000100:00100000:0.0:1746065173.518610:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665856 00000100:00100000:0.0:1746065173.518612:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665856 00000100:00100000:0.0:1746065173.518620:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262665984 00000100:00100000:0.0:1746065173.518622:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262665984 00000100:00100000:0.0:1746065173.518631:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13725 00000100:00100000:0.0:1746065173.518635:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881262665728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.518640:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.518648:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094882600/0x14b4f8542d4fa8c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f496 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065173.518658:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d716, atime: 0x6812d715, ctime: 0x6812d715, blocks: 0x81d 00010000:00010000:0.0:1746065173.518666:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.518667:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.518671:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094882600/0x14b4f8542d4fa8c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f496 expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.518679:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094882600/0x14b4f8542d4fa8c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f496 expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.518686:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094882600, rc 0) 00000100:00100000:0.0:1746065173.518701:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881262665728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.518706:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13725 00000100:00100000:0.0:1746065173.518717:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13726 00000100:00100000:0.0:1746065173.518721:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262665856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.518726:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.518732:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094883800/0x14b4f8542d4fa8cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f49d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065173.518742:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d716, atime: 0x6812d716, ctime: 0x6812d716, blocks: 0x81f 00010000:00010000:0.0:1746065173.518748:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.518749:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.518752:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094883800/0x14b4f8542d4fa8cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f49d expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.518760:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094883800/0x14b4f8542d4fa8cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f49d expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.518767:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094883800, rc 0) 00000100:00100000:0.0:1746065173.518780:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262665856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.518785:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13726 00000100:00100000:0.0:1746065173.518794:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13727 00000100:00100000:0.0:1746065173.518798:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881262665984:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.518802:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.518809:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094882400/0x14b4f8542d4fa8d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f4a4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065173.518834:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 4989376, mtime: 0x6812d716, atime: 0x6812d715, ctime: 0x6812d716, blocks: 0x1663 00010000:00010000:0.0:1746065173.518843:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.518844:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.518848:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094882400/0x14b4f8542d4fa8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4a4 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.518855:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094882400/0x14b4f8542d4fa8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4a4 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.518861:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094882400, rc 0) 00000100:00100000:0.0:1746065173.518872:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881262665984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 74us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.518876:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13727 00000100:00100000:0.0:1746065173.518926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.518939:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262666112 00000100:00100000:0.0:1746065173.518941:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262666112 00000100:00100000:0.0:1746065173.518955:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13728 00000100:00100000:0.0:1746065173.518959:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881262666112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.518964:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.518971:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094883000/0x14b4f8542d4fa8da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f4ab expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065173.518980:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d716, atime: 0x6812d716, ctime: 0x6812d716, blocks: 0x1029 00010000:00010000:0.0:1746065173.518986:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.518987:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.518991:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094883000/0x14b4f8542d4fa8da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4ab expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.518998:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094883000/0x14b4f8542d4fa8da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4ab expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.519005:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094883000, rc 0) 00000100:00100000:0.0:1746065173.519015:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881262666112:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.519019:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13728 00000100:00100000:0.0:1746065173.521290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.521362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.521375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.521386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.521397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.521409:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262666368 00000100:00100000:0.0:1746065173.521411:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262666368 00000100:00100000:0.0:1746065173.522066:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262666496 00000100:00100000:0.0:1746065173.522069:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262666496 00000100:00100000:0.0:1746065173.523453:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262667008 00000100:00100000:0.0:1746065173.523457:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262667008 00000100:00100000:0.0:1746065173.523482:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13734 00000100:00100000:0.0:1746065173.523488:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881262667008:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065173.523494:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.523502:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094883c00/0x14b4f8542d4fa904 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f4d5 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.523511:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.523513:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.523517:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094883c00/0x14b4f8542d4fa904 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4d5 expref: 33 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.523526:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094883c00/0x14b4f8542d4fa904 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4d5 expref: 33 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.523533:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094883c00, rc 0) 00000100:00100000:0.0:1746065173.523549:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262667008:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.523554:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13734 00000100:00100000:0.0:1746065173.524877:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262667648 00000100:00100000:0.0:1746065173.524880:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262667648 00010000:00010000:0.0:1746065173.524906:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fa17f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efc6 expref: 27 pid: 20754 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065173.524925:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262667264 00000100:00100000:0.0:1746065173.524927:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262667264 00010000:00010000:0.0:1746065173.524934:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d200/0x14b4f8542d4fa2ac lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f08a expref: 28 pid: 14644 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746065173.525152:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6938 00000100:00100000:0.0:1746065173.525159:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1958:x1830881262667392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065173.525166:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065173.525170:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59400/0x14b4f8542d4fa19b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efe2 expref: 28 pid: 16767 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.525178:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59400/0x14b4f8542d4fa19b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efe2 expref: 28 pid: 16767 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.525198:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59400/0x14b4f8542d4fa19b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5efe2 expref: 28 pid: 16767 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746065173.525399:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065173.525404:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094882200/0x14b4f8542d4fa8b0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065173.525410:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094882200/0x14b4f8542d4fa8b0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065173.525416:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094882200/0x14b4f8542d4fa8b0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065173.525431:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065173.525452:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881262667392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 289us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.525458:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6938 00000100:00100000:0.0:1746065173.525854:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000040:00080000:0.0:1746065173.526319:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3007, 88 off254216 00000004:00080000:0.0:1746065173.526325:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 772817509223ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065173.526353:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3008, 88 off254304 00000004:00080000:0.0:1746065173.526356:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 772817540383ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065173.526364:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3009, 88 off254392 00000004:00080000:0.0:1746065173.526366:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 772817551088ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065173.526374:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2968, 88 off250600 00000004:00080000:0.0:1746065173.526376:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 772817560631ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065173.526382:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3010, 88 off254480 00000004:00080000:0.0:1746065173.526385:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 772817569433ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065173.526392:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2969, 88 off250688 00000004:00080000:0.0:1746065173.526394:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 772817579101ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065173.526401:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3011, 88 off254568 00000004:00080000:0.0:1746065173.526403:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 772817587968ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065173.526410:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2970, 88 off250776 00000004:00080000:0.0:1746065173.526413:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 772817597330ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065173.526419:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2971, 88 off250864 00000004:00080000:0.0:1746065173.526421:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 772817605978ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065173.526428:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2972, 88 off250952 00000004:00080000:0.0:1746065173.526431:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 772817615723ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065173.526438:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2973, 88 off251040 00000004:00080000:0.0:1746065173.526440:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 772817624860ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065173.526452:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3012, 88 off254656 00000004:00080000:0.0:1746065173.526455:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 772817639686ns, next at 737095943431ns, rc = 0 00000100:00100000:0.0:1746065173.585464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.585500:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13736 00000100:00100000:0.0:1746065173.585507:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260211968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.585661:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881260211968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (884us total) trans 17179873463 rc 0/0 00000100:00100000:0.0:1746065173.585666:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13736 00000100:00100000:0.0:1746065173.585678:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13737 00000100:00100000:0.0:1746065173.585682:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260211584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065173.585743:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065173.585745:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065173.585747:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065173.585749:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065173.585751:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065173.585769:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881260211584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (963us total) trans 17179873464 rc 0/0 00000100:00100000:0.0:1746065173.585774:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13737 00000100:00100000:0.0:1746065173.585785:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13738 00000100:00100000:0.0:1746065173.585791:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260212096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.585920:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881260212096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (1068us total) trans 17179873465 rc 0/0 00000100:00100000:0.0:1746065173.585925:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13738 00000100:00100000:0.0:1746065173.586183:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260211200 00000100:00100000:0.0:1746065173.586189:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260211200 00000100:00100000:0.0:1746065173.586369:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260211712 00000100:00100000:0.0:1746065173.586373:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260211712 00000100:00100000:0.0:1746065173.586386:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260211328 00000100:00100000:0.0:1746065173.586388:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260211328 00000100:00100000:0.0:1746065173.586395:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260211840 00000100:00100000:0.0:1746065173.586397:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260211840 00000100:00100000:0.0:1746065173.586404:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260212480 00000100:00100000:0.0:1746065173.586406:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260212480 00000100:00100000:0.0:1746065173.586419:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13739 00000100:00100000:0.0:1746065173.586424:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881260211200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.586500:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13741 00000100:00100000:0.0:1746065173.586504:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260211328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.586513:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260212864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065173.586533:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065173.586592:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260213376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065173.586609:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065173.586618:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065173.586622:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260212736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065173.586633:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065173.586640:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260213248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065173.586654:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746065173.586687:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065173.586689:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065173 -> 1746065173 00002000:00010000:0.0:1746065173.586691:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065173 -> 1746065173 00002000:00010000:0.0:1746065173.586693:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065173 -> 1746065173 00002000:00010000:0.0:1746065173.586695:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065173.586714:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3297:x1830881260211200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 290us (593us total) trans 17179873466 rc 0/0 00000100:00100000:0.0:1746065173.586719:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13739 00000100:00100000:0.0:1746065173.586730:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260212864 00000100:00100000:0.0:1746065173.586733:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260212864 00000100:00100000:0.0:1746065173.586740:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260213376 00000100:00100000:0.0:1746065173.586742:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260213376 00000100:00100000:0.0:1746065173.586746:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260212736 00000100:00100000:0.0:1746065173.586747:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260212736 00000100:00100000:0.0:1746065173.586752:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260213248 00000100:00100000:0.0:1746065173.586753:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260213248 00000100:00100000:0.0:1746065173.586759:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13743 00000100:00100000:0.0:1746065173.586762:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260212480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065173.587197:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065173.587200:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.587201:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065173 -> 1746065173 00002000:00010000:0.0:1746065173.587203:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065173 -> 1746065173 00002000:00010000:0.0:1746065173.587204:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065173.587222:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3297:x1830881260211328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 718us (1042us total) trans 17179873469 rc 0/0 00000100:00100000:0.0:1746065173.587226:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13741 00000100:00100000:0.0:1746065173.587235:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13746 00000100:00100000:0.0:1746065173.587239:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881260213376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065173.587299:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3296:x1830881260213376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (689us total) trans 21474840714 rc 0/0 00000100:00100000:0.0:1746065173.587304:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13746 00000100:00100000:0.0:1746065173.587312:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13748 00000100:00100000:0.0:1746065173.587316:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881260213248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065173.587390:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065173.587392:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065173.587393:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065173.587394:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065173.587396:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065173.587414:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3296:x1830881260213248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (759us total) trans 21474840715 rc 0/0 00000100:00100000:0.0:1746065173.587419:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13748 00000100:00100000:0.0:1746065173.587426:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260212608 00000100:00100000:0.0:1746065173.587429:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260212608 00000100:00100000:0.0:1746065173.587438:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260213120 00000100:00100000:0.0:1746065173.587439:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260213120 00000100:00100000:0.0:1746065173.587445:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13749 00000100:00100000:0.0:1746065173.587449:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3298:x1830881260212608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065173.587533:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065173.587535:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.587537:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.587538:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.587540:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746065173.587561:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881260212608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (166us total) trans 21474840716 rc 0/0 00000100:00100000:0.0:1746065173.587569:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13749 00002000:00010000:0.0:1746065173.587632:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065173.587634:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.587636:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065173.587637:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.587639:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1823 -> 1823 00000100:00100000:0.0:1746065173.587655:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260212480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 892us (1254us total) trans 21474840717 rc 0/0 00000100:00100000:0.0:1746065173.587660:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13743 00000100:00100000:0.0:1746065173.597418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.597451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.597477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.597539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.597550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.597570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.597609:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262669184 00000100:00100000:0.0:1746065173.597611:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262669184 00000100:00100000:0.0:1746065173.597624:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262669056 00000100:00100000:0.0:1746065173.597625:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262669056 00000100:00100000:0.0:1746065173.597636:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13752 00000100:00100000:0.0:1746065173.597642:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262668672:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065173.597655:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.597668:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf29e00/0x14b4f8542d4fa92e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f4f8 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.597685:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.597687:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.597694:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf29e00/0x14b4f8542d4fa92e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4f8 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.597706:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf29e00/0x14b4f8542d4fa92e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4f8 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.597715:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf29e00, rc 0) 00000100:00100000:0.0:1746065173.597747:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262668672:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 105us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.597753:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13752 00000100:00100000:0.0:1746065173.597765:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13754 00000100:00100000:0.0:1746065173.597769:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262669184:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065173.597774:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.597779:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf28a00/0x14b4f8542d4fa93c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f514 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.597787:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.597788:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.597792:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf28a00/0x14b4f8542d4fa93c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f514 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.597799:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf28a00/0x14b4f8542d4fa93c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f514 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.597805:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf28a00, rc 0) 00000100:00100000:0.0:1746065173.597835:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262669184:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 66us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.597842:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13754 00000100:00100000:0.0:1746065173.597855:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13756 00000100:00100000:0.0:1746065173.597859:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262669056:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065173.597863:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.597868:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf28e00/0x14b4f8542d4fa94a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f50d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.597876:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.597877:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.597881:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf28e00/0x14b4f8542d4fa94a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f50d expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.597901:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf28e00/0x14b4f8542d4fa94a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f50d expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065173.597907:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf28e00, rc 0) 00000100:00100000:0.0:1746065173.597919:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262669056:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 60us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.597924:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13756 00000100:00100000:0.0:1746065173.600340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.602508:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7686 00000100:00100000:0.0:1746065173.602518:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262670208:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065173.604560:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670592 00000100:00100000:0.0:1746065173.604566:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670592 00002000:00100000:0.0:1746065173.604600:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880095350380 x1830881262670592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.604612:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350380 with x1830881262670592 ext(1048576->2097151) 00002000:00010000:0.0:1746065173.604617:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350380 00000100:00100000:0.0:1746065173.604629:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670464 00000100:00100000:0.0:1746065173.604630:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670464 00002000:00100000:0.0:1746065173.604639:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880095353b80 x1830881262670464/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.604642:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353b80 with x1830881262670464 ext(0->1048575) 00002000:00010000:0.0:1746065173.604644:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095353b80 00000100:00100000:0.0:1746065173.604649:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262670976 00000100:00100000:0.0:1746065173.604650:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262670976 00002000:00100000:0.0:1746065173.604775:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880095351500 x1830881262670976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.604780:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351500 with x1830881262670976 ext(1048576->2097151) 00002000:00010000:0.0:1746065173.604782:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351500 00000100:00100000:0.0:1746065173.604794:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7687 00000100:00100000:0.0:1746065173.604801:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881262670592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065173.606977:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7690 00000100:00100000:0.0:1746065173.606985:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881262671104:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065173.624897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.624924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.629403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.629447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.636236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.637830:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.649298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.652082:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881262671104:12345-192.168.202.46@tcp:3:cat.0 Request processed in 45091us (46915us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065173.652092:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7690 00002000:00100000:0.0:1746065173.652102:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880095350a80 x1830881262671104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:89/0 lens 488/440 e 0 to 0 dl 1746065184 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.652110:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350a80 with x1830881262671104 ext(1048576->2097151) 00002000:00010000:0.0:1746065173.652115:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350a80 00000100:00100000:0.0:1746065173.668324:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.668362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.670354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.674666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.674767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.711644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000001:00080000:0.0:1746065173.713881:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943938 is committed 00000004:00080000:0.0:1746065173.713897:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2302 committed 00000004:00080000:0.0:1746065173.713904:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2264 committed 00000004:00080000:0.0:1746065173.713908:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2263 committed 00000004:00080000:0.0:1746065173.713909:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2262 committed 00000004:00080000:0.0:1746065173.713911:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2261 committed 00000004:00080000:0.0:1746065173.713912:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2301 committed 00000004:00080000:0.0:1746065173.713913:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2260 committed 00000004:00080000:0.0:1746065173.713914:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2300 committed 00000004:00080000:0.0:1746065173.713916:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2259 committed 00000004:00080000:0.0:1746065173.713917:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2299 committed 00000004:00080000:0.0:1746065173.713919:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2298 committed 00000004:00080000:0.0:1746065173.713920:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2297 committed 00000004:00080000:0.0:1746065173.713921:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2258 committed 00000004:00080000:0.0:1746065173.713923:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2257 committed 00000004:00080000:0.0:1746065173.713925:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2296 committed 00000004:00080000:0.0:1746065173.713926:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2295 committed 00000004:00080000:0.0:1746065173.713927:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2256 committed 00000001:00080000:0.0:1746065173.713936:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943937 is committed 00000100:00100000:0.0:1746065173.714052:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065173.714063:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260214400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.714091:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065173.714111:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260214784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.714127:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065173.714139:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260215296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.714724:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065173.714744:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9880/2, rc 0, transno 17179873471 00000100:00100000:0.0:1746065173.714748:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260214400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065173.714757:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fa680/2, rc 0, transno 17179873472 00000100:00100000:0.0:1746065173.714759:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260214784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.714772:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13769 00000100:00100000:0.0:1746065173.714778:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260214656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065173.715161:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065173.715163:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.715165:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.715167:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.715168:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746065173.715192:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260214656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 415us (766us total) trans 17179873475 rc 0/0 00000100:00100000:0.0:1746065173.715197:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13769 00000004:00080000:0.0:1746065173.716078:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb10380/2, rc 0, transno 21474840729 00000100:00100000:0.0:1746065173.716083:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260216448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065173.716091:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3d180/2, rc 0, transno 17179873477 00000100:00100000:0.0:1746065173.716094:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260215296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065173.716925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.717294:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260214144:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065173.717302:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260214272:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065173.717325:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565be00/0x14b4f8542d4fa9b3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f529 expref: 9 pid: 16767 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065173.717336:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565b800/0x14b4f8542d4fa9ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f529 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.717348:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a565b800, rc 0) 00000100:00100000:0.0:1746065173.717369:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:31264:x1830881262674048:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 67394us (68080us total) trans 8589943938 rc 0/0 00000100:00100000:0.0:1746065173.717374:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9767 00000100:00100000:0.0:1746065173.730438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.730465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.730476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.730488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.730503:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.730516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.730542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.730560:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262675840 00000100:00100000:0.0:1746065173.730566:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262675840 00000100:00100000:0.0:1746065173.730597:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262676096 00000100:00100000:0.0:1746065173.730599:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262676096 00000100:00100000:0.0:1746065173.730608:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262676352 00000100:00100000:0.0:1746065173.730609:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262676352 00000100:00100000:0.0:1746065173.730616:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262675968 00000100:00100000:0.0:1746065173.730618:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262675968 00000100:00100000:0.0:1746065173.730625:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262676224 00000100:00100000:0.0:1746065173.730626:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262676224 00000100:00100000:0.0:1746065173.730633:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262676480 00000100:00100000:0.0:1746065173.730634:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262676480 00000100:00100000:0.0:1746065173.730644:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13775 00000100:00100000:0.0:1746065173.730651:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1961:x1830881262675840:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065173.730798:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065173.730801:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.730803:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065171 -> 1746065174 00002000:00010000:0.0:1746065173.730804:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.730806:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1823 -> 1823 00000100:00100000:0.0:1746065173.730862:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881262675840:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 211us (431us total) trans 21474840730 rc 0/0 00000100:00100000:0.0:1746065173.730867:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13775 00000100:00100000:0.0:1746065173.730893:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13776 00000100:00100000:0.0:1746065173.730898:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1961:x1830881262676096:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065173.730975:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065173.730977:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065174 -> 1746065174 00002000:00010000:0.0:1746065173.730979:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065173 -> 1746065174 00002000:00010000:0.0:1746065173.730980:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065173 -> 1746065174 00002000:00010000:0.0:1746065173.730982:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065173.730997:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881262676096:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 100us (531us total) trans 17179873479 rc 0/0 00000100:00100000:0.0:1746065173.731003:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13776 00000100:00100000:0.0:1746065173.731013:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13778 00000100:00100000:0.0:1746065173.731523:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1961:x1830881262675968:12345-192.168.202.46@tcp:2:lfs.0 00000100:00100000:0.0:1746065173.731571:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262676608 00000100:00100000:0.0:1746065173.731574:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262676608 00000100:00100000:0.0:1746065173.731606:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4124 00000100:00100000:0.0:1746065173.731612:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31267:x1830881262676608:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:0.0:1746065173.731677:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31267:x1830881262676608:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 65us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065173.731683:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4124 00002000:00010000:0.0:1746065173.731933:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065173.731936:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065173 -> 1746065174 00002000:00010000:0.0:1746065173.731938:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065173 -> 1746065174 00002000:00010000:0.0:1746065173.731939:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065173 -> 1746065174 00002000:00010000:0.0:1746065173.731941:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065173.731971:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881262675968:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 953us (1482us total) trans 17179873481 rc 0/0 00000100:00100000:0.0:1746065173.731977:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13778 00000100:00100000:0.0:1746065173.732226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.740466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.740987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.741071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.741700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.744702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.745907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.745932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.745952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.745978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.746744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.746786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.746865:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262678528 00000100:00100000:0.0:1746065173.746869:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262678528 00000100:00100000:0.0:1746065173.746903:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4126 00000100:00100000:0.0:1746065173.746908:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009badd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31255:x1830881262678528:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065173.747073:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009badd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31255:x1830881262678528:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 164us (286us total) trans 8589943941 rc 0/0 00000100:00100000:0.0:1746065173.747079:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4126 00000100:00100000:0.0:1746065173.749332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.750681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.751737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.754603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.758327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.764283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.766471:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262680320 00000100:00100000:0.0:1746065173.766477:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262680320 00002000:00100000:0.0:1746065173.766502:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2277376->3145727) req@ffff88009fb11f80 x1830881262680320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:89/0 lens 488/0 e 0 to 0 dl 1746065184 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065173.766510:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11f80 with x1830881262680320 ext(2277376->3145727) 00002000:00010000:0.0:1746065173.766514:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11f80 00000100:00100000:0.0:1746065173.766525:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7708 00000100:00100000:0.0:1746065173.766530:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881262680320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065173.769600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.769639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.769657:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262680832 00000100:00100000:0.0:1746065173.769663:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262680832 00000100:00100000:0.0:1746065173.769708:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4127 00000100:00100000:0.0:1746065173.769714:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:31267:x1830881262680832:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065173.769904:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31267:x1830881262680832:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 188us (263us total) trans 8589943942 rc 0/0 00000100:00100000:0.0:1746065173.769909:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4127 00000100:00100000:0.0:1746065173.769941:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.774866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.783362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.790180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.796569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.817594:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.818374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.822090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.827738:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.827954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.835207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.836870:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.843140:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.843178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.843213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.844165:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7714 00000100:00100000:0.0:1746065173.844173:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262683648:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065173.874183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.891614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.903123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.908158:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262684800 00000100:00100000:0.0:1746065173.908171:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262684800 00000100:00100000:0.0:1746065173.908219:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13789 00000100:00100000:0.0:1746065173.908227:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+28:31273:x1830881262684800:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065173.908243:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065173.908257:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003ac00/0x14b4f8542d4faa62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f592 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.908280:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fc4000/0x14b4f8542d4faa23 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f56f expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.908287:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.908289:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065173.908297:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003ac00/0x14b4f8542d4faa62 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3489792->3502079] (req 3489792->3502079) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f592 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.908321:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093fc4000/0x14b4f8542d4faa23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f56f expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065173.908331:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093fc4000/0x14b4f8542d4faa23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f56f expref: 29 pid: 21998 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746065173.908342:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260218496:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065173.908424:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065173.917711:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.922129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.924704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065173.926328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.000939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.059807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.064331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.064407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.098900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.102900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.106247:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686848 00000100:00100000:0.0:1746065174.106254:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686848 00000100:00100000:0.0:1746065174.106306:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262686976 00000100:00100000:0.0:1746065174.106308:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262686976 00000100:00100000:0.0:1746065174.106768:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13790 00000100:00100000:0.0:1746065174.106776:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881262686848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065174.106790:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.106804:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a003b000/0x14b4f8542d4faac4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f5ae expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065174.106856:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260219008:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065174.106928:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.106994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.112559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.118394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.125365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.125462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.127692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.135218:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.135262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.137560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.137576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.137589:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688640 00000100:00100000:0.0:1746065174.137594:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688640 00010000:00010000:0.0:1746065174.137614:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f363a00/0x14b4f8542d4fa8e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4b9 expref: 35 pid: 9716 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746065174.137631:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262688896 00000100:00100000:0.0:1746065174.137633:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262688896 00010000:00010000:0.0:1746065174.137640:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f362200/0x14b4f8542d4fa8be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f48f expref: 28 pid: 21235 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746065174.137653:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6959 00000100:00100000:0.0:1746065174.137658:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881262688640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065174.137665:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065174.137682:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f363a00/0x14b4f8542d4fa8e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4b9 expref: 35 pid: 9716 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746065174.137690:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f363a00/0x14b4f8542d4fa8e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4b9 expref: 35 pid: 9716 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746065174.137704:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f363a00/0x14b4f8542d4fa8e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4b9 expref: 35 pid: 9716 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746065174.137717:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065174.137737:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881262688640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065174.137743:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6959 00000100:00100000:0.0:1746065174.137763:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6960 00000100:00100000:0.0:1746065174.137768:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881262688896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065174.137774:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065174.137781:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f362200/0x14b4f8542d4fa8be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f48f expref: 28 pid: 21235 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746065174.137788:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f362200/0x14b4f8542d4fa8be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f48f expref: 28 pid: 21235 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746065174.137798:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f362200/0x14b4f8542d4fa8be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f48f expref: 28 pid: 21235 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746065174.137806:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.137807:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.137813:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093fc5200/0x14b4f8542d4faae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5ca expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.137837:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093fc5200/0x14b4f8542d4faae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5ca expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.137861:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093fc5200/0x14b4f8542d4faae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5ca expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065174.137870:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260220416:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065174.143944:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.143964:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260220416:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065174.143976:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065174.143992:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1959:x1830881262688896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6224us (6415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065174.143999:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6960 00000100:00100000:0.0:1746065174.150495:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262689792 00000100:00100000:0.0:1746065174.150500:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262689792 00010000:00010000:0.0:1746065174.150523:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf28c00/0x14b4f8542d4faad2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 606208->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5bc expref: 33 pid: 8851 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746065174.151390:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6961 00000100:00100000:0.0:1746065174.151397:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262689792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065174.151407:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065174.151422:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf28c00/0x14b4f8542d4faad2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 606208->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5bc expref: 33 pid: 8851 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746065174.151432:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf28c00/0x14b4f8542d4faad2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 606208->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5bc expref: 33 pid: 8851 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746065174.151449:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf28c00/0x14b4f8542d4faad2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 606208->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5bc expref: 33 pid: 8851 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746065174.151469:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.151471:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.151477:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fc5a00/0x14b4f8542d4faad9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5c3 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.151488:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093fc5a00/0x14b4f8542d4faad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5c3 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.151512:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093fc5a00/0x14b4f8542d4faad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5c3 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065174.151521:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260220672:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065174.151570:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.163795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.166290:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262690688 00000100:00100000:0.0:1746065174.166298:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262690688 00002000:00100000:0.0:1746065174.166324:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1314816->2097151) req@ffff88009fb12d80 x1830881262690688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:90/0 lens 488/0 e 0 to 0 dl 1746065185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.166333:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12d80 with x1830881262690688 ext(1314816->2097151) 00002000:00010000:0.0:1746065174.166338:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb12d80 00000100:00100000:0.0:1746065174.166355:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7721 00000100:00100000:0.0:1746065174.166361:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881262690688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065174.202511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.203296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.204528:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.206407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.212812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.212861:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.214758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.220579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.221842:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262692864 00000100:00100000:0.0:1746065174.221850:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262692864 00002000:00100000:0.0:1746065174.221875:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880135cde300 x1830881262692864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:90/0 lens 488/0 e 0 to 0 dl 1746065185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.221891:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde300 with x1830881262692864 ext(1048576->2097151) 00010000:00010000:0.0:1746065174.221898:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fab26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5f4 expref: 29 pid: 9716 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746065174.221908:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fab26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5f4 expref: 29 pid: 9716 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746065174.221914:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135cde300 00000100:00100000:0.0:1746065174.221926:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2357 00000100:00100000:0.0:1746065174.221931:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262692864:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065174.244802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.245859:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.256913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.266231:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.267327:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.285992:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262694528 00000100:00100000:0.0:1746065174.285996:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262694528 00000100:00100000:0.0:1746065174.286020:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9779 00000100:00100000:0.0:1746065174.286025:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31288:x1830881262694528:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065174.286040:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.286052:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a600/0x14b4f8542d4fab49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f617 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.286133:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286143:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286150:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286161:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286166:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286176:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286265:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003be00/0x14b4f8542d4fab5e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286272:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003be00/0x14b4f8542d4fab5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286278:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003be00/0x14b4f8542d4fab5e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065174.286285:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065174.286349:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286355:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286363:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286368:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a003a000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065174.286371:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286376:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286384:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065174.286386:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065174.286389:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286393:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fab50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286405:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286409:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286414:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286418:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a003b400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065174.286420:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286424:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286433:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669f00) 00010000:00010000:0.0:1746065174.286435:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065174.286437:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286441:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fab57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.286468:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a600/0x14b4f8542d4fab49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f617 expref: 257 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.286477:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003be00/0x14b4f8542d4fab5e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f617 expref: 256 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.286482:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065174.286484:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065174.286486:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003be00, rc 0) 00000100:00100000:0.0:1746065174.286584:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31288:x1830881262694528:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 485us (1275us total) trans 8589943953 rc 0/0 00000100:00100000:0.0:1746065174.286591:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9779 00000100:00100000:0.0:1746065174.289355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.297606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.297647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.299988:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7728 00000100:00100000:0.0:1746065174.299997:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1959:x1830881262695552:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065174.304497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.341343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.341388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.344680:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13805 00000100:00100000:0.0:1746065174.344696:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881262696064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065174.344711:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.344724:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f363400/0x14b4f8542d4fab73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f62c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065174.344764:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260222208:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065174.344914:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.362463:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13808 00000100:00100000:0.0:1746065174.362470:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881262696576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065174.362477:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.362485:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f363400/0x14b4f8542d4fab88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f63a expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065174.362506:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260222592:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065174.362524:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.367523:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.371874:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260222592:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065174.371911:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f363400/0x14b4f8542d4fab88 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f63a expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065174.371923:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f363400/0x14b4f8542d4fab88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f63a expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065174.371940:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f363400, rc 0) 00000100:00100000:0.0:1746065174.371975:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881262696576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9504us (10230us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065174.371982:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13808 00000100:00100000:0.0:1746065174.372916:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.376465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065174.383201:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a600/0x14b4f8542d4faba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383214:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a600/0x14b4f8542d4faba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065174.383260:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00000004:00200000:0.0:1746065174.383265:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065174.383280:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a600/0x14b4f8542d4faba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383289:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a600/0x14b4f8542d4faba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383304:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200800/0x14b4f8542d4fab96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383309:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200800/0x14b4f8542d4fab96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383314:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200800/0x14b4f8542d4fab96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383319:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f200800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065174.383322:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200800/0x14b4f8542d4fab96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383329:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200800/0x14b4f8542d4fab96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383341:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065174.383343:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065174.383346:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200800/0x14b4f8542d4fab96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383350:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200800/0x14b4f8542d4fab96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383370:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fab9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383374:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fab9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383377:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fab9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383380:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f200c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065174.383382:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fab9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383385:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fab9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383391:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fa00) 00010000:00010000:0.0:1746065174.383393:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065174.383395:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fab9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383399:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f200c00/0x14b4f8542d4fab9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065174.383437:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f201400/0x14b4f8542d4fab8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f641 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.383447:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a600/0x14b4f8542d4faba4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f641 expref: 11 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.383452:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065174.383454:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065174.383456:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9a600, rc 0) 00000100:00100000:0.0:1746065174.383500:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31290:x1830881262696704:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 15689us (15983us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065174.383507:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9780 00000100:00100000:0.0:1746065174.383558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.383660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.383677:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262697216 00000100:00100000:0.0:1746065174.383683:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262697216 00000100:00100000:0.0:1746065174.383708:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262697344 00000100:00100000:0.0:1746065174.383710:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262697344 00000100:00100000:0.0:1746065174.383723:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13809 00000100:00100000:0.0:1746065174.383728:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881262697216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065174.383740:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.383751:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f363000/0x14b4f8542d4fabab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f648 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065174.383788:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260222848:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065174.383853:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.392060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.392096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.392108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.392542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.402188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.408635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.410891:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262698880 00000100:00100000:0.0:1746065174.410897:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262698880 00000100:00100000:0.0:1746065174.410922:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9783 00000100:00100000:0.0:1746065174.410928:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31290:x1830881262698880:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065174.410939:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.410947:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fac0d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f680 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.410989:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362a00/0x14b4f8542d4fac14 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.410998:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0148c00/0x14b4f8542d4fabdc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f672 expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.411004:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362a00/0x14b4f8542d4fac14 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065174.411027:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0148c00/0x14b4f8542d4fabdc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f672 expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.411041:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0148c00/0x14b4f8542d4fabdc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f672 expref: 13 pid: 14643 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746065174.411051:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260223488:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065174.411304:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.416288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.430332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.430371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.430397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.430411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.430434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.441325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.447284:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.447554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.452548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.506431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.516450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.537807:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.544566:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.553589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.553684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.553707:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262702592 00000100:00100000:0.0:1746065174.553710:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262702592 00002000:00100000:0.0:1746065174.553723:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009ba3f480 x1830881262702592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:90/0 lens 488/0 e 0 to 0 dl 1746065185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.553729:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f480 with x1830881262702592 ext(2097152->3145727) 00002000:00010000:0.0:1746065174.553731:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3f480 00000100:00100000:0.0:1746065174.561117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.569455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.576626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.582390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.589469:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.590942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.599356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.605266:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.605288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.607640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.620416:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.630295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.642350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.655005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.655049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.655088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.667955:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262705920 00000100:00100000:0.0:1746065174.667963:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262705920 00000100:00100000:0.0:1746065174.668138:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13824 00000100:00100000:0.0:1746065174.668146:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31306:x1830881262705920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065174.668162:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.668178:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a565b000/0x14b4f8542d4facc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f6e2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.668201:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093fc4600/0x14b4f8542d4fab1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 860160->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5ed expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.668207:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065174.668209:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065174.668212:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565b000/0x14b4f8542d4facc3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f6e2 expref: 32 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.668235:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093fc4600/0x14b4f8542d4fab1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 860160->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5ed expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.668245:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093fc4600/0x14b4f8542d4fab1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 860160->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5ed expref: 22 pid: 9716 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746065174.668255:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260225536:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065174.668837:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.670671:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.678912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.686155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.691840:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262706688 00000100:00100000:0.0:1746065174.691849:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262706688 00002000:00100000:0.0:1746065174.691892:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1142783) req@ffff88009f46bb80 x1830881262706688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:90/0 lens 488/0 e 0 to 0 dl 1746065185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.691901:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46bb80 with x1830881262706688 ext(1048576->1142783) 00002000:00010000:0.0:1746065174.691907:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46bb80 00000100:00100000:0.0:1746065174.691932:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7740 00000100:00100000:0.0:1746065174.691939:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881262706688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065174.701611:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881262706688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9663us (10754us total) trans 0 rc 94208/94208 00000100:00100000:0.0:1746065174.701622:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7740 00002000:00100000:0.0:1746065174.701631:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1142783) req@ffff88009f46bb80 x1830881262706688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:90/0 lens 488/440 e 0 to 0 dl 1746065185 ref 1 fl Complete:/200/0 rc 94208/94208 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.701641:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46bb80 with x1830881262706688 ext(1048576->1142783) 00002000:00010000:0.0:1746065174.701646:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46bb80 00000100:00100000:0.0:1746065174.713511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.717021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.718839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.729288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.736238:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262707712 00000100:00100000:0.0:1746065174.736245:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262707712 00002000:00100000:0.0:1746065174.736279:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009f469180 x1830881262707712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:90/0 lens 488/0 e 0 to 0 dl 1746065185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.736288:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469180 with x1830881262707712 ext(2097152->3145727) 00002000:00010000:0.0:1746065174.736293:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f469180 00000100:00100000:0.0:1746065174.736309:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7741 00000100:00100000:0.0:1746065174.736315:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881262707712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065174.756174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.756329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.756423:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262708352 00000100:00100000:0.0:1746065174.756426:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262708352 00002000:00100000:0.0:1746065174.756450:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff880135cde680 x1830881262708352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:90/0 lens 488/0 e 0 to 0 dl 1746065185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.756459:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde680 with x1830881262708352 ext(4194304->4993023) 00002000:00010000:0.0:1746065174.756464:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cde680 00000100:00100000:0.0:1746065174.756487:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7743 00000100:00100000:0.0:1746065174.756492:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262708352:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065174.760698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.765971:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262708992 00000100:00100000:0.0:1746065174.765979:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262708992 00000100:00100000:0.0:1746065174.766469:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 721 00000100:00100000:0.0:1746065174.766478:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881262708992:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065174.766489:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065174.766508:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013551dc00/0x14b4f8542d4fad10 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f6fe expref: 25 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.767281:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065174.767285:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065174.767303:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881262708992:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 826us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065174.767309:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 721 00000100:00100000:0.0:1746065174.768236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.768259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.768268:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262709632 00000100:00100000:0.0:1746065174.768271:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262709632 00010000:00010000:0.0:1746065174.768284:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090b30400/0x14b4f8542d4fab42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f610 expref: 38 pid: 9716 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746065174.768297:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6981 00000100:00100000:0.0:1746065174.768301:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881262709632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065174.768307:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065174.768321:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090b30400/0x14b4f8542d4fab42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f610 expref: 38 pid: 9716 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065174.768329:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090b30400/0x14b4f8542d4fab42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f610 expref: 38 pid: 9716 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065174.768342:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090b30400/0x14b4f8542d4fab42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f610 expref: 38 pid: 9716 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065174.768352:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.768353:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.768357:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f11f000/0x14b4f8542d4facf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f6f7 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.768364:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f11f000/0x14b4f8542d4facf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3993599) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f6f7 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.768380:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f11f000/0x14b4f8542d4facf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3993599) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f6f7 expref: 37 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065174.768388:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260226560:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065174.768417:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065174.773456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.777718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.780554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.784698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.790125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.795412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.799602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.820309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.830418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.856046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.878260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.885211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.888907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.898900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.902487:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.903669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.903747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.914301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.914361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.914384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.914642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.914655:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262713472 00000100:00100000:0.0:1746065174.914657:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262713472 00000100:00100000:0.0:1746065174.914673:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13835 00000100:00100000:0.0:1746065174.914677:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1959:x1830881262713600:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065174.914699:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.914712:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0x14b4f8542d4fad95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f752 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.914730:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.914732:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.914739:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0x14b4f8542d4fad95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f752 expref: 16 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065174.914750:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0x14b4f8542d4fad95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f752 expref: 16 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065174.914759:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1a00, rc 0) 00000100:00100000:0.0:1746065174.915336:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1959:x1830881262713600:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 657us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065174.915347:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13835 00000100:00100000:0.0:1746065174.915385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.915415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.915428:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13837 00000100:00100000:0.0:1746065174.915433:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1959:x1830881262713728:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065174.915439:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065174.915445:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0x14b4f8542d4fadc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f759 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065174.915454:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.915456:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065174.915459:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0x14b4f8542d4fadc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f759 expref: 15 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065174.915467:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0x14b4f8542d4fadc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f759 expref: 15 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065174.915474:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1c00, rc 0) 00000100:00100000:0.0:1746065174.915486:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1959:x1830881262713728:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 54us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065174.915490:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13837 00000100:00100000:0.0:1746065174.918389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.918422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.918460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.925182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.925199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.925211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.925223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.925241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.927780:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6985 00000100:00100000:0.0:1746065174.927788:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262715136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065174.927802:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065174.927863:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a565b000/0x14b4f8542d4facc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f6e2 expref: 33 pid: 8429 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065174.927871:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a565b000/0x14b4f8542d4facc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f6e2 expref: 33 pid: 8429 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065174.927897:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a565b000/0x14b4f8542d4facc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f6e2 expref: 33 pid: 8429 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065174.927917:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065174.927951:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881262715136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 165us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065174.927956:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6985 00000100:00100000:0.0:1746065174.927969:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 6986 00000100:00100000:0.0:1746065174.927974:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881262715008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065174.927980:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065174.927988:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bddc800/0x14b4f8542d4fad8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f744 expref: 15 pid: 4545 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746065174.927995:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bddc800/0x14b4f8542d4fad8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f744 expref: 15 pid: 4545 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746065174.928009:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bddc800/0x14b4f8542d4fad8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f744 expref: 15 pid: 4545 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746065174.928017:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065174.928029:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1961:x1830881262715008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (2829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065174.928033:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 6986 00000100:00100000:0.0:1746065174.939272:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262716288 00000100:00100000:0.0:1746065174.939275:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262716288 00002000:00100000:0.0:1746065174.939295:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (352256->356351) req@ffff88009fb13b80 x1830881262716288/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:90/0 lens 488/0 e 0 to 0 dl 1746065185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.939303:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881262716288 ext(352256->356351) 00010000:00010000:0.0:1746065174.939308:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bddd000/0x14b4f8542d4fadcd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 352256->585727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f767 expref: 29 pid: 4544 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065174.939315:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bddd000/0x14b4f8542d4fadcd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 352256->585727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f767 expref: 29 pid: 4544 timeout: 874 lvb_type: 0 00002000:00010000:0.0:1746065174.939320:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb13b80 00000100:00100000:0.0:1746065174.939524:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2364 00000100:00100000:0.0:1746065174.939530:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1958:x1830881262716288:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065174.939643:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1958:x1830881262716288:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 114us (559us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065174.939648:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2364 00002000:00100000:0.0:1746065174.939653:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (352256->356351) req@ffff88009fb13b80 x1830881262716288/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746065185 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.939660:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881262716288 ext(352256->356351) 00010000:00010000:0.0:1746065174.939664:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bddd000/0x14b4f8542d4fadcd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 352256->585727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f767 expref: 29 pid: 4544 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065174.939671:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bddd000/0x14b4f8542d4fadcd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 352256->585727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f767 expref: 29 pid: 4544 timeout: 874 lvb_type: 0 00002000:00010000:0.0:1746065174.939676:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb13b80 00000100:00100000:0.0:1746065174.941281:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881262714368:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 22615us (22894us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065174.941288:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7749 00002000:00100000:0.0:1746065174.941293:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012f10d500 x1830881262714368/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:90/0 lens 488/440 e 0 to 0 dl 1746065185 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.941300:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f10d500 with x1830881262714368 ext(2097152->3145727) 00002000:00010000:0.0:1746065174.941303:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f10d500 00000100:00100000:0.0:1746065174.948538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.949232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.952079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.958586:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.958669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.958692:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262717312 00000100:00100000:0.0:1746065174.958700:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262717312 00002000:00100000:0.0:1746065174.958734:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff880095353100 x1830881262717312/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:90/0 lens 488/0 e 0 to 0 dl 1746065185 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.958747:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881262717312 ext(4194304->4993023) 00002000:00010000:0.0:1746065174.958751:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095353100 00000100:00100000:0.0:1746065174.958783:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7752 00000100:00100000:0.0:1746065174.958791:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881262717312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065174.963517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.963855:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.968869:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.970468:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+28:1958:x1830881262717312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11676us (11797us total) trans 0 rc 798720/798720 00000100:00100000:0.0:1746065174.970475:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7752 00002000:00100000:0.0:1746065174.970481:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff880095353100 x1830881262717312/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:90/0 lens 488/440 e 0 to 0 dl 1746065185 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065174.970487:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881262717312 ext(4194304->4993023) 00002000:00010000:0.0:1746065174.970491:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095353100 00000100:00100000:0.0:1746065174.977214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.978843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.990369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.990412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.990451:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065174.992809:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7754 00000100:00100000:0.0:1746065174.992827:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262718848:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065175.024451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.027897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.029751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.203635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065175.204832:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065175.231050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.236453:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262721024 00000100:00100000:0.0:1746065175.236462:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262721024 00002000:00100000:0.0:1746065175.236507:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880135cdea00 x1830881262721024/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.236516:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdea00 with x1830881262721024 ext(0->1048575) 00002000:00010000:0.0:1746065175.236520:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdea00 00000100:00100000:0.0:1746065175.236542:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7757 00000100:00100000:0.0:1746065175.236547:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881262721024:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065175.251343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.252800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.259371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.268119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.271001:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.275925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.275964:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.284425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.284553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.284580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.284624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.290129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.290716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.294942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.305045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.305081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.305113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.305159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.312145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.322141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.333664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.343625:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262725248 00000100:00100000:0.0:1746065175.343633:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262725248 00000100:00100000:0.0:1746065175.343683:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13852 00000100:00100000:0.0:1746065175.343690:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+8:31329:x1830881262725248:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:0.0:1746065175.343706:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262725504 00000100:00100000:0.0:1746065175.343709:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262725504 00002000:00100000:0.0:1746065175.343732:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009c3fad80 x1830881262725504/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.343740:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881262725504 ext(2097152->3145727) 00002000:00010000:0.0:1746065175.343743:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:0.0:1746065175.343752:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262725760 00000100:00100000:0.0:1746065175.343753:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262725760 00002000:00100000:0.0:1746065175.343761:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3624959) req@ffff88009baa1f80 x1830881262725760/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.343766:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1f80 with x1830881262725760 ext(3145728->3624959) 00002000:00010000:0.0:1746065175.343768:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1f80 00000100:00100000:0.0:1746065175.343776:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7760 00000100:00100000:0.0:1746065175.343780:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262725504:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065175.344894:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065175.344909:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4faec2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f7f3 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.344932:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bddc000/0x14b4f8542d4fad48 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f72f expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.344940:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fade2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f77c expref: 20 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065175.344946:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0x14b4f8542d4fadc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f759 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065175.344952:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065175.344953:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065175.344957:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4faec2 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->3231743] (req 3145728->3231743) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7f3 expref: 9 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.344980:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0x14b4f8542d4fadc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f759 expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065175.344990:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0x14b4f8542d4fadc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f759 expref: 8 pid: 8851 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746065175.344999:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260230528:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065175.346255:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fade2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f77c expref: 20 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065175.346266:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fade2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f77c expref: 20 pid: 4544 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746065175.346337:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260230656:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065175.346364:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bddc000/0x14b4f8542d4fad48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f72f expref: 9 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.346371:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bddc000/0x14b4f8542d4fad48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f72f expref: 9 pid: 4545 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746065175.346378:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260230784:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065175.346392:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065175.351364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.351391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.351410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.354897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.355645:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881262725760:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11800us (11960us total) trans 0 rc 479232/479232 00000100:00100000:0.0:1746065175.355652:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7761 00002000:00100000:0.0:1746065175.355659:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3624959) req@ffff88009baa1f80 x1830881262725760/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:91/0 lens 488/440 e 0 to 0 dl 1746065186 ref 1 fl Complete:/200/0 rc 479232/479232 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.355666:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1f80 with x1830881262725760 ext(3145728->3624959) 00002000:00010000:0.0:1746065175.355670:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1f80 00000100:00100000:0.0:1746065175.355684:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262726528 00000100:00100000:0.0:1746065175.355688:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262726528 00002000:00100000:0.0:1746065175.355711:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880095354a80 x1830881262726528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.355721:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354a80 with x1830881262726528 ext(2097152->3145727) 00002000:00010000:0.0:1746065175.355724:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095354a80 00000100:00100000:0.0:1746065175.355735:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7762 00000100:00100000:0.0:1746065175.355740:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881262726528:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065175.360908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.373599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.373725:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.380205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.396601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.397909:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262727936 00000100:00100000:0.0:1746065175.397913:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262727936 00000100:00100000:0.0:1746065175.397966:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13855 00000100:00100000:0.0:1746065175.397972:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+11:31332:x1830881262727936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065175.397980:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065175.397992:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4faed7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f808 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.398010:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065175.398012:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065175.398015:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4faed7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f808 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.398025:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b7c000/0x14b4f8542d4faed7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f808 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.398033:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7c000, rc 0) 00000100:00100000:0.0:1746065175.398926:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:31332:x1830881262727936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 951us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065175.398932:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13855 00000100:00100000:0.0:1746065175.414291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.421673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.421725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.422975:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7766 00000100:00100000:0.0:1746065175.422984:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262728320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065175.436361:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.441393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.441440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.453146:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.455258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.459017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.463839:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262729600 00000100:00100000:0.0:1746065175.463847:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262729600 00000100:00100000:0.0:1746065175.464759:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13858 00000100:00100000:0.0:1746065175.464770:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:31332:x1830881262729600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065175.464787:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065175.464803:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4faf01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f824 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.464848:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065175.464850:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065175.464854:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4faf01 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->4993023] (req 4194304->4993023) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f824 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.464878:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4faf01 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->4993023] (req 4194304->4993023) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f824 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.464887:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec33200, rc 0) 00000100:00100000:0.0:1746065175.464922:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:31332:x1830881262729600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 154us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065175.464927:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13858 00000100:00100000:0.0:1746065175.476968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.494586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.494622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.494660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.494696:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262729984 00000100:00100000:0.0:1746065175.494702:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262729984 00002000:00100000:0.0:1746065175.497611:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88008fd71c00 x1830881262729984/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.497620:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71c00 with x1830881262729984 ext(4194304->4993023) 00002000:00010000:0.0:1746065175.497624:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71c00 00000100:00100000:0.0:1746065175.497641:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7769 00000100:00100000:0.0:1746065175.497647:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881262729984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065175.529549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.597290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.654951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.664926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.664985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.675532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.675581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.679317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.689264:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262732160 00000100:00100000:0.0:1746065175.689271:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262732160 00000100:00100000:0.0:1746065175.689311:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13861 00000100:00100000:0.0:1746065175.689318:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+11:31350:x1830881262732160:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065175.689330:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065175.689344:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a211200/0x14b4f8542d4faf2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f840 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.689366:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a601b800/0x14b4f8542d4faf1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f832 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.689373:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065175.689374:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065175.689377:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a211200/0x14b4f8542d4faf2b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f840 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.689400:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a601b800/0x14b4f8542d4faf1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f832 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.689410:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a601b800/0x14b4f8542d4faf1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f832 expref: 17 pid: 9716 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746065175.689420:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260232704:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065175.689489:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065175.696695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.696735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.712746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.712774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.712799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.713973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.714016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.714855:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7009 00000100:00100000:0.0:1746065175.714861:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881262732800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065175.714877:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065175.719811:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880135474c00/0x14b4f8542d4faebb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7ec expref: 11 pid: 9716 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065175.719831:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135474c00/0x14b4f8542d4faebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7ec expref: 11 pid: 9716 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065175.719849:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135474c00/0x14b4f8542d4faebb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7ec expref: 11 pid: 9716 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746065175.719864:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065175.719865:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065175.719881:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a601be00/0x14b4f8542d4faf32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f847 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.719888:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a601be00/0x14b4f8542d4faf32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f847 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065175.719915:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a601be00/0x14b4f8542d4faf32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f847 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065175.719926:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260233472:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065175.719978:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065175.726230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.730120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.730569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.734853:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7774 00000100:00100000:0.0:1746065175.734865:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881262734080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065175.738220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.773227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.778438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.794699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.803117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.803704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.804044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.821478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065175.823426:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801298de000/0x14b4f8542d4faf4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f863 expref: 12 pid: 9716 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065175.823442:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260233984:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065175.823501:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065175.825231:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260233984:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065175.825252:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4faf55 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3108864->3145727] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f86a expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.825263:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b3000, rc 0) 00000100:00100000:1.0:1746065175.825284:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+12:31344:x1830881262735744:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2075us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065175.825289:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13867 00000100:00100000:0.0:1746065175.829940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.829999:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065175.830324:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262736000 00000100:00100000:1.0:1746065175.830327:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262736000 00000100:00100000:1.0:1746065175.830347:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13868 00000100:00100000:1.0:1746065175.830352:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+12:31350:x1830881262736000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065175.830362:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065175.830369:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f871 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.831347:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4faf55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f86a expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.831353:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065175.831355:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065175.831357:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f871 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.831381:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4faf55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f86a expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.831391:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4faf55 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f86a expref: 13 pid: 9716 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065175.831400:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260234112:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065175.831478:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065175.833355:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260234112:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065175.833379:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f871 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.833391:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b3800, rc 0) 00000100:00100000:1.0:1746065175.833420:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:31350:x1830881262736000:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3067us (3420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065175.833427:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13868 00000100:00100000:0.0:1746065175.833803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.835925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065175.837294:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.841786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.842987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.843689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065175.843802:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262737024 00000100:00100000:1.0:1746065175.843806:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262737024 00010000:00010000:1.0:1746065175.843836:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4faf55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f86a expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065175.843895:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7017 00000100:00100000:1.0:1746065175.843900:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881262737024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065175.843910:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065175.843922:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4faf55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f86a expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065175.843930:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4faf55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f86a expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065175.843942:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4faf55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f86a expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065175.843965:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065175.843966:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065175.843971:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f871 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.843977:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f871 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.843994:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f871 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065175.844001:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260234752:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065175.844402:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065175.849076:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260234752:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065175.849094:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065175.849126:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881262737024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5225us (5437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065175.849135:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7017 00000100:00100000:0.0:1746065175.852911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065175.855553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065175.855589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.855683:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262737664 00000100:00100000:0.0:1746065175.855688:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262737664 00002000:00100000:0.0:1746065175.855708:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009baa0700 x1830881262737664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.855715:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0700 with x1830881262737664 ext(3145728->4194303) 00002000:00010000:0.0:1746065175.855718:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa0700 00000100:00100000:0.0:1746065175.856419:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262737792 00000100:00100000:0.0:1746065175.856423:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262737792 00002000:00100000:0.0:1746065175.856439:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009baa1500 x1830881262737792/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.856446:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1500 with x1830881262737792 ext(3145728->4194303) 00002000:00010000:0.0:1746065175.856449:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa1500 00000100:00100000:0.0:1746065175.877363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.885996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.889401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.897732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.918677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.935244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.941458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.959912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065175.959974:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262739200 00000100:00100000:1.0:1746065175.959982:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262739200 00010000:00010000:1.0:1746065175.960009:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4faf63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f878 expref: 12 pid: 9716 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065175.960194:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7018 00000100:00100000:1.0:1746065175.960202:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881262739200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065175.960214:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065175.960232:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4faf63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f878 expref: 12 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065175.960240:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4faf63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f878 expref: 12 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065175.960255:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9a00/0x14b4f8542d4faf63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f878 expref: 12 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065175.960278:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065175.960279:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065175.960285:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4faf78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f88d expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.960292:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4faf78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f88d expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065175.960320:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4faf78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f88d expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065175.960331:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260235136:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065175.960440:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065175.961720:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260235136:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065175.961735:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065175.961758:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262739200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1557us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065175.961766:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7018 00000100:00100000:0.0:1746065175.968085:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.969020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.969064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065175.969252:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262739968 00000100:00100000:0.0:1746065175.969260:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262739968 00002000:00100000:0.0:1746065175.969294:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880130447800 x1830881262739968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.969305:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447800 with x1830881262739968 ext(3145728->4194303) 00002000:00010000:0.0:1746065175.969310:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130447800 00000100:00100000:0.0:1746065175.969337:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262739456 00000100:00100000:0.0:1746065175.969340:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262739456 00002000:00100000:0.0:1746065175.969351:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009f236a00 x1830881262739456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:91/0 lens 488/0 e 0 to 0 dl 1746065186 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.969358:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f236a00 with x1830881262739456 ext(2097152->3145727) 00002000:00010000:0.0:1746065175.969361:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f236a00 00000100:00100000:0.0:1746065175.969371:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7785 00000100:00100000:0.0:1746065175.969378:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262739968:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065175.972401:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7787 00000100:00100000:1.0:1746065175.972410:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262739712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065175.981411:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262739968:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12024us (12383us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065175.981421:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7785 00002000:00100000:0.0:1746065175.981431:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880130447800 x1830881262739968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:91/0 lens 488/440 e 0 to 0 dl 1746065186 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065175.981440:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447800 with x1830881262739968 ext(3145728->4194303) 00002000:00010000:0.0:1746065175.981445:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130447800 00000100:00100000:1.0:1746065175.991342:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262739712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18929us (23259us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065175.991350:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7787 00002000:00100000:1.0:1746065175.991357:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880130445180 x1830881262739712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:91/0 lens 488/440 e 0 to 0 dl 1746065186 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065175.991364:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445180 with x1830881262739712 ext(3145728->4194303) 00002000:00010000:1.0:1746065175.991368:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130445180 00000100:00100000:0.0:1746065176.002486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.002619:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262740224 00000100:00100000:1.0:1746065176.002628:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262740224 00002000:00100000:1.0:1746065176.002696:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88009f236680 x1830881262740224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.002711:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f236680 with x1830881262740224 ext(4194304->4993023) 00002000:00010000:1.0:1746065176.002716:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f236680 00000100:00100000:1.0:1746065176.002749:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7788 00000100:00100000:1.0:1746065176.002758:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881262740224:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065176.100241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065176.103202:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065176.110691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.111239:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262740480 00000100:00100000:0.0:1746065176.111244:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262740480 00010000:00010000:0.0:1746065176.111265:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4faf78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f88d expref: 22 pid: 21998 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746065176.111354:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7019 00000100:00100000:0.0:1746065176.111359:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f236d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881262740480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065176.111369:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065176.111385:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4faf78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f88d expref: 22 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.111394:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4faf78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f88d expref: 22 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.111410:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941e9400/0x14b4f8542d4faf78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f88d expref: 22 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.111426:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065176.111428:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065176.111433:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.111439:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.111460:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065176.111469:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260235392:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065176.111510:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065176.115173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.117496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.124172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.126808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.127413:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262741120 00000100:00100000:1.0:1746065176.127422:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262741120 00000100:00100000:1.0:1746065176.127589:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13876 00000100:00100000:1.0:1746065176.127596:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:31362:x1830881262741120:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065176.127609:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.127624:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f8a9 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.127646:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f546a00/0x14b4f8542d4fade9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f78a expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.127653:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f546200/0x14b4f8542d4fae1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f79f expref: 14 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.127658:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.127659:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.127663:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [983040->1048575] (req 983040->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.127685:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f546200/0x14b4f8542d4fae1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f79f expref: 14 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.127697:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f546200/0x14b4f8542d4fae1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f79f expref: 14 pid: 8429 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746065176.127707:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260235904:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065176.128706:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f546a00/0x14b4f8542d4fade9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f78a expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.128716:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f546a00/0x14b4f8542d4fade9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f78a expref: 22 pid: 8429 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065176.128725:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260236032:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065176.128745:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.131258:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260235904:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065176.131266:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260236032:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065176.131291:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [983040->1048575] (req 983040->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.131303:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b163200, rc 0) 00000100:00100000:1.0:1746065176.131628:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+14:31362:x1830881262741120:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4030us (4823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.131635:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13876 00000100:00100000:0.0:1746065176.135698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.135734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.135759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.135790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.135862:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262741504 00000100:00100000:0.0:1746065176.135880:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262741504 00010000:00010000:0.0:1746065176.135911:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f546200/0x14b4f8542d4fae1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f79f expref: 14 pid: 8429 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746065176.135933:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262741376 00000100:00100000:0.0:1746065176.135935:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262741376 00010000:00010000:0.0:1746065176.135945:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4faf6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f87f expref: 22 pid: 9716 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746065176.135955:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262741632 00000100:00100000:0.0:1746065176.135957:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262741632 00010000:00010000:0.0:1746065176.135964:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f546a00/0x14b4f8542d4fade9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f78a expref: 23 pid: 8429 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746065176.135976:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7020 00000100:00100000:0.0:1746065176.135982:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262741504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065176.135992:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065176.136010:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f546200/0x14b4f8542d4fae1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f79f expref: 14 pid: 8429 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746065176.136021:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f546200/0x14b4f8542d4fae1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f79f expref: 14 pid: 8429 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746065176.136026:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7021 00000100:00100000:1.0:1746065176.136033:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262741376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.136040:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065176.136045:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f546200/0x14b4f8542d4fae1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f79f expref: 14 pid: 8429 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.136051:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4faf6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f87f expref: 23 pid: 9716 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.136058:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4faf6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f87f expref: 23 pid: 9716 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746065176.136061:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065176.136067:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e9000/0x14b4f8542d4faf6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f87f expref: 23 pid: 9716 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.136079:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.136092:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881262741376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065176.136093:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881262741504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.136098:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7021 00000100:00100000:0.0:1746065176.137100:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7020 00000100:00100000:1.0:1746065176.137116:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7022 00000100:00100000:1.0:1746065176.137125:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262741632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.137134:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.137147:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f546a00/0x14b4f8542d4fade9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f78a expref: 21 pid: 8429 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.137156:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f546a00/0x14b4f8542d4fade9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f78a expref: 21 pid: 8429 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.137170:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f546a00/0x14b4f8542d4fade9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f78a expref: 21 pid: 8429 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746065176.137179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065176.137183:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.137185:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.137191:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.137198:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065176.137212:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262741248 00010000:00010000:1.0:1746065176.137222:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065176.137223:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262741248 00000100:00100000:1.0:1746065176.137232:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260236160:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065176.137244:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7023 00000100:00100000:0.0:1746065176.137249:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881262741760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065176.137255:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065176.137266:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f871 expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065176.137733:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeea80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065176.138575:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f871 expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.138592:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3800/0x14b4f8542d4faf5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f871 expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.138603:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065176.138605:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065176.138609:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.138621:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.138644:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065176.138652:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260236288:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065176.138703:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065176.138733:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13877 00000100:00100000:0.0:1746065176.138740:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:31366:x1830881262741248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065176.138750:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065176.138759:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f8b0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.138772:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.138778:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065176.138779:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065176.138782:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.138795:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.138808:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 20 pid: 21998 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746065176.138830:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260236416:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065176.138860:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.141675:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260236160:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.141686:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.142630:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881262741632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5506us (6868us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.142636:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7022 00000100:00100000:0.0:1746065176.143085:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260236416:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065176.143109:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.143124:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a565a600, rc 0) 00000100:00100000:0.0:1746065176.143150:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:31366:x1830881262741248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4411us (7358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065176.143155:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13877 00000100:00100000:0.0:1746065176.144418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.148764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.149998:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262742656 00000100:00100000:0.0:1746065176.150002:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262742656 00002000:00100000:0.0:1746065176.150026:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4288511) req@ffff880094a11880 x1830881262742656/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.150036:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881262742656 ext(4194304->4288511) 00010000:00010000:0.0:1746065176.150042:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 20 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.150050:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 20 pid: 21998 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746065176.150056:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a11880 00000100:00100000:0.0:1746065176.150081:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2380 00000100:00100000:0.0:1746065176.150087:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881262742656:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065176.153234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.153275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.153938:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262742784 00000100:00100000:1.0:1746065176.153945:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262742784 00010000:00010000:1.0:1746065176.153979:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bddc200/0x14b4f8542d4fad9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f74b expref: 8 pid: 4545 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746065176.154008:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7024 00000100:00100000:1.0:1746065176.154014:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262742784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.154026:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.154039:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bddc200/0x14b4f8542d4fad9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f74b expref: 8 pid: 4545 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.154047:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bddc200/0x14b4f8542d4fad9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f74b expref: 8 pid: 4545 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.154063:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bddc200/0x14b4f8542d4fad9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f74b expref: 8 pid: 4545 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.154076:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.154093:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881262742784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.154099:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7024 00000100:00080000:0.0:1746065176.154121:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065176.154148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.154180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.154209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.154231:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.154363:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262743168 00000100:00100000:1.0:1746065176.154367:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262743168 00010000:00010000:1.0:1746065176.154378:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bddce00/0x14b4f8542d4faddb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f775 expref: 21 pid: 4544 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746065176.154391:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262743424 00000100:00100000:1.0:1746065176.154394:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262743424 00010000:00010000:1.0:1746065176.154401:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1800/0x14b4f8542d4fad41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f728 expref: 12 pid: 4545 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065176.154416:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7025 00000100:00100000:1.0:1746065176.154420:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262743168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.154426:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.154434:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bddce00/0x14b4f8542d4faddb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f775 expref: 21 pid: 4544 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.154442:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bddce00/0x14b4f8542d4faddb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f775 expref: 21 pid: 4544 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.154452:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bddce00/0x14b4f8542d4faddb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f775 expref: 21 pid: 4544 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.154460:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.154475:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881262743168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.154481:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7025 00000100:00100000:1.0:1746065176.154490:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7026 00000100:00100000:1.0:1746065176.154495:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881262743424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.154501:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.154507:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1800/0x14b4f8542d4fad41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f728 expref: 12 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.154514:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1800/0x14b4f8542d4fad41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f728 expref: 12 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.154525:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1800/0x14b4f8542d4fad41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f728 expref: 12 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.154531:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.154533:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.154538:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.154544:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.154562:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 11 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.154570:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260237184:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065176.154595:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065176.155460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.156029:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262743552 00000100:00100000:1.0:1746065176.156033:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262743552 00010000:00010000:1.0:1746065176.156052:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 26 pid: 21998 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065176.156084:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7027 00000100:00100000:1.0:1746065176.156091:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881262743552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.156099:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065176.156111:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065176 -> 1746065177 00002000:00010000:1.0:1746065176.156113:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065176 -> 1746065177 00010000:00010000:1.0:1746065176.156118:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 26 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.156127:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c808800/0x14b4f8542d4faf8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4288511) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a2 expref: 26 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.156147:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.156148:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.156153:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.156160:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.156180:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.156189:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260237312:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065176.156235:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.157747:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260237184:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.157757:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.157785:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881262743424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3290us (3553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.157791:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7026 00000100:00100000:1.0:1746065176.159796:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260237312:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.159811:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.159875:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881262743552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3784us (4415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.159884:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7027 00000100:00100000:0.0:1746065176.163510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.168443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.168559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.169199:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7792 00000100:00100000:0.0:1746065176.169206:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f89c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262744192:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065176.169378:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f89c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262744192:12345-192.168.202.46@tcp:3:cat.0 Request processed in 172us (817us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065176.169384:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7792 00002000:00100000:0.0:1746065176.169389:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1425408->1429503) req@ffff88012f89c380 x1830881262744192/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.169395:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89c380 with x1830881262744192 ext(1425408->1429503) 00002000:00010000:0.0:1746065176.169397:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f89c380 00000100:00100000:0.0:1746065176.179412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.185498:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881262744320:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5880us (6087us total) trans 21474840745 rc 0/0 00000100:00100000:0.0:1746065176.185508:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2381 00002000:00100000:0.0:1746065176.185517:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (983040->1048575) req@ffff88012f89c700 x1830881262744320/t21474840745(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/448 e 0 to 0 dl 1746065187 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.185527:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89c700 with x1830881262744320 ext(983040->1048575) 00010000:00010000:0.0:1746065176.185535:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 17 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.185549:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 17 pid: 9716 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746065176.185555:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f89c700 00000100:00100000:0.0:1746065176.190582:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262744448 00000100:00100000:0.0:1746065176.190590:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262744448 00010000:00010000:0.0:1746065176.190620:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 15 pid: 9716 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746065176.190651:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7028 00000100:00100000:0.0:1746065176.190657:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881262744448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065176.190670:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065176.190763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065176.190838:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 15 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.190850:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 15 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.190881:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b163200/0x14b4f8542d4faf94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8a9 expref: 15 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.190897:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065176.190899:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065176.190905:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.190912:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.190942:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065176.190958:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f89ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260237568:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065176.191020:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.192600:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f89ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260237568:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.192616:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.193115:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262744448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2456us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.193123:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7028 00000100:00100000:0.0:1746065176.195206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.195249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.195320:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262744960 00000100:00100000:1.0:1746065176.195324:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262744960 00002000:00100000:1.0:1746065176.196590:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3584000->4194303) req@ffff88012f89d180 x1830881262744960/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.196598:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89d180 with x1830881262744960 ext(3584000->4194303) 00010000:00010000:1.0:1746065176.196604:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 20 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.196615:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 20 pid: 21998 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.196620:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f89d180 00000100:00100000:1.0:1746065176.196632:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2382 00000100:00100000:1.0:1746065176.196638:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f89d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881262744960:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065176.209632:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f89d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881262744960:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12986us (14374us total) trans 17179873490 rc 0/0 00000100:00100000:1.0:1746065176.209644:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2382 00002000:00100000:1.0:1746065176.209654:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3584000->4194303) req@ffff88012f89d180 x1830881262744960/t17179873490(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/448 e 0 to 0 dl 1746065187 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.209663:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89d180 with x1830881262744960 ext(3584000->4194303) 00010000:00010000:1.0:1746065176.209671:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 22 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.209686:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 22 pid: 21998 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.209692:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f89d180 00000100:00100000:0.0:1746065176.211425:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.212877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.213215:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262745216 00000100:00100000:1.0:1746065176.213219:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262745216 00010000:00010000:1.0:1746065176.213236:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 24 pid: 21998 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065176.213260:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7029 00000100:00100000:1.0:1746065176.213264:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f89d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881262745216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.213271:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.213287:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 24 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.213295:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 24 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.213310:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b000/0x14b4f8542d4faf7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f894 expref: 24 pid: 21998 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.213330:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.213331:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.213337:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a601ac00/0x14b4f8542d4fafc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8da expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.213348:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a601ac00/0x14b4f8542d4fafc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8da expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.213363:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a601ac00/0x14b4f8542d4fafc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8da expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.213370:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260237952:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065176.213417:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.218176:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262745344 00000100:00100000:1.0:1746065176.218182:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262745344 00002000:00100000:1.0:1746065176.218216:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1429503) req@ffff880094a11c00 x1830881262745344/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.218224:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11c00 with x1830881262745344 ext(1048576->1429503) 00010000:00010000:1.0:1746065176.218229:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 12 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.218239:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 12 pid: 9716 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.218245:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a11c00 00000100:00100000:1.0:1746065176.218270:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2383 00000100:00100000:1.0:1746065176.218277:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262745344:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065176.220722:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260237952:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.220741:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.222706:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f89d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881262745216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9432us (9832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.222717:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7029 00000100:00100000:1.0:1746065176.226835:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262745344:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8532us (9428us total) trans 17179873491 rc 0/0 00000100:00100000:1.0:1746065176.226847:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2383 00002000:00100000:1.0:1746065176.226857:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1429503) req@ffff880094a11c00 x1830881262745344/t17179873491(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/448 e 0 to 0 dl 1746065187 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.226878:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11c00 with x1830881262745344 ext(1048576->1429503) 00010000:00010000:1.0:1746065176.226887:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.226900:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 14 pid: 9716 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.226906:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a11c00 00000100:00100000:0.0:1746065176.227378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.227408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.227443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.228834:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7796 00000100:00100000:1.0:1746065176.228844:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881262745984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065176.232606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.232966:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262746240 00000100:00100000:1.0:1746065176.232974:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262746240 00010000:00010000:1.0:1746065176.233018:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 18 pid: 9716 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065176.233057:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7030 00000100:00100000:1.0:1746065176.233066:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f89e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881262746240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.233080:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065176.233099:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065175 -> 1746065177 00002000:00010000:1.0:1746065176.233102:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065175 -> 1746065177 00010000:00010000:1.0:1746065176.233108:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 18 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.233120:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 18 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.233145:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1429503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b7 expref: 18 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.233174:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.233177:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.233185:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.233193:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.233224:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.233237:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260238080:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065176.233309:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.240367:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260238080:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.240393:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.240433:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f89e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881262746240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7367us (7834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.240443:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7030 00000100:00100000:0.0:1746065176.247476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.252948:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f89e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881262745984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24100us (25498us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065176.252959:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7796 00002000:00100000:1.0:1746065176.252968:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012f89e300 x1830881262745984/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.252976:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89e300 with x1830881262745984 ext(3145728->4194303) 00002000:00010000:1.0:1746065176.252981:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f89e300 00000100:00100000:0.0:1746065176.260314:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.260974:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262746752 00000100:00100000:1.0:1746065176.260983:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262746752 00002000:00100000:1.0:1746065176.261021:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88012f89ed80 x1830881262746752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.261031:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89ed80 with x1830881262746752 ext(4194304->4993023) 00002000:00010000:1.0:1746065176.261036:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f89ed80 00000100:00100000:1.0:1746065176.261068:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7798 00000100:00100000:1.0:1746065176.261076:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881262746752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065176.270873:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881262746752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9778us (10547us total) trans 0 rc 798720/798720 00000100:00100000:1.0:1746065176.270886:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7798 00002000:00100000:1.0:1746065176.270898:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88012f89ed80 x1830881262746752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.270912:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89ed80 with x1830881262746752 ext(4194304->4993023) 00002000:00010000:1.0:1746065176.270917:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f89ed80 00000100:00100000:0.0:1746065176.271115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.271602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.295328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.295378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.310664:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.311025:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262747520 00000100:00100000:1.0:1746065176.311033:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262747520 00002000:00100000:1.0:1746065176.311071:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012f89ca80 x1830881262747520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.311080:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89ca80 with x1830881262747520 ext(2097152->3145727) 00002000:00010000:1.0:1746065176.311084:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f89ca80 00000100:00100000:1.0:1746065176.311114:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7799 00000100:00100000:1.0:1746065176.311121:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262747520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065176.314759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.324708:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262748032 00000100:00100000:0.0:1746065176.324715:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262748032 00002000:00100000:0.0:1746065176.324745:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a10000 x1830881262748032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.324754:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10000 with x1830881262748032 ext(2097152->3145727) 00002000:00010000:0.0:1746065176.324759:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10000 00000100:00100000:0.0:1746065176.324790:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262748160 00000100:00100000:0.0:1746065176.324792:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262748160 00002000:00100000:0.0:1746065176.324803:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a12680 x1830881262748160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.324809:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a12680 with x1830881262748160 ext(3145728->4194303) 00002000:00010000:0.0:1746065176.324811:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a12680 00000100:00100000:0.0:1746065176.324847:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7801 00000100:00100000:0.0:1746065176.324854:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881262748032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065176.336066:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262747520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24936us (25401us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065176.336076:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7799 00002000:00100000:1.0:1746065176.336086:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012f89ca80 x1830881262747520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.336094:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f89ca80 with x1830881262747520 ext(2097152->3145727) 00002000:00010000:1.0:1746065176.336099:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f89ca80 00000100:00100000:1.0:1746065176.345627:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262748032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20762us (21651us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065176.345640:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7801 00002000:00100000:1.0:1746065176.345654:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a10000 x1830881262748032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.345664:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10000 with x1830881262748032 ext(2097152->3145727) 00002000:00010000:1.0:1746065176.345670:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10000 00000100:00100000:0.0:1746065176.359322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.433782:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.434057:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262748672 00000100:00100000:1.0:1746065176.434066:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262748672 00000100:00100000:1.0:1746065176.436048:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13889 00000100:00100000:1.0:1746065176.436063:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31373:x1830881262748672:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065176.436079:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.436094:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f904 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.436119:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.436127:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8ef expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.436132:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.436133:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.436136:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 5/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1171456->1888255] (req 1171456->1888255) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.436162:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8ef expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.436172:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8ef expref: 13 pid: 8851 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746065176.436181:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260238208:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065176.436384:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.436392:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 24 pid: 8851 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065176.436400:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260238336:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065176.436421:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eeef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065176.438318:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.445462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.446041:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262749184 00000100:00100000:1.0:1746065176.446050:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262749184 00002000:00100000:1.0:1746065176.446088:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880099cd0e00 x1830881262749184/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.446098:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd0e00 with x1830881262749184 ext(1048576->2097151) 00010000:00010000:1.0:1746065176.446107:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafda lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8ef expref: 14 pid: 8851 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.446118:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafda lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8ef expref: 14 pid: 8851 timeout: 875 lvb_type: 1 00002000:00010000:1.0:1746065176.446124:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd0e00 00000100:00100000:1.0:1746065176.446157:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2384 00000100:00100000:1.0:1746065176.446165:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881262749184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065176.446405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.446431:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262749312 00000100:00100000:0.0:1746065176.446435:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262749312 00010000:00010000:0.0:1746065176.446453:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 25 pid: 8851 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746065176.447718:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7031 00000100:00100000:0.0:1746065176.447726:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881262749312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065176.447736:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065176.447751:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 24 pid: 8851 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.447761:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 24 pid: 8851 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.447780:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a601bc00/0x14b4f8542d4fafcc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e1 expref: 24 pid: 8851 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746065176.447800:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065176.447834:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881262749312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 109us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065176.447840:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7031 00000100:00100000:1.0:1746065176.460821:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881262749184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14639us (15350us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065176.460830:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2384 00002000:00100000:1.0:1746065176.460841:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880099cd0e00 x1830881262749184/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.460848:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd0e00 with x1830881262749184 ext(1048576->2097151) 00010000:00010000:1.0:1746065176.460856:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8ef expref: 14 pid: 8851 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.460878:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a601b800/0x14b4f8542d4fafda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8ef expref: 14 pid: 8851 timeout: 875 lvb_type: 1 00002000:00010000:1.0:1746065176.460884:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd0e00 00000100:00100000:0.0:1746065176.463937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.463983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.467261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.467458:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262749824 00000100:00100000:1.0:1746065176.467462:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262749824 00002000:00100000:1.0:1746065176.467489:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1171456->1175551) req@ffff880099cd1c00 x1830881262749824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.467496:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd1c00 with x1830881262749824 ext(1171456->1175551) 00010000:00010000:1.0:1746065176.467501:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.467510:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.467515:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd1c00 00000100:00100000:1.0:1746065176.467538:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2385 00000100:00100000:1.0:1746065176.467544:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881262749824:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065176.467794:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881262749824:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 250us (536us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065176.467802:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2385 00002000:00100000:1.0:1746065176.467806:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1171456->1175551) req@ffff880099cd1c00 x1830881262749824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746065187 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.467812:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd1c00 with x1830881262749824 ext(1171456->1175551) 00010000:00010000:1.0:1746065176.467835:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.467843:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.467848:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd1c00 00000100:00100000:0.0:1746065176.470218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.473404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.473554:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262750208 00000100:00100000:1.0:1746065176.473562:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262750208 00002000:00100000:1.0:1746065176.473598:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1884160->1888255) req@ffff880099cd2300 x1830881262750208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.473607:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd2300 with x1830881262750208 ext(1884160->1888255) 00010000:00010000:1.0:1746065176.473614:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.473626:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.473633:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd2300 00000100:00100000:1.0:1746065176.473666:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2386 00000100:00100000:1.0:1746065176.473673:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881262750208:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065176.473873:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881262750208:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 200us (475us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065176.473879:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2386 00002000:00100000:1.0:1746065176.473885:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1884160->1888255) req@ffff880099cd2300 x1830881262750208/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746065187 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.473892:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd2300 with x1830881262750208 ext(1884160->1888255) 00010000:00010000:1.0:1746065176.473897:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.473905:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.473911:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd2300 00000100:00100000:0.0:1746065176.477386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.478393:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262750464 00000100:00100000:1.0:1746065176.478402:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262750464 00002000:00100000:1.0:1746065176.478439:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1171456->1888255) req@ffff880099cd2680 x1830881262750464/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.478449:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd2680 with x1830881262750464 ext(1171456->1888255) 00010000:00010000:1.0:1746065176.478457:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.478468:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 23 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.478475:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd2680 00000100:00100000:1.0:1746065176.478504:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2387 00000100:00100000:1.0:1746065176.478511:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262750464:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065176.495476:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262750464:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 16954us (18086us total) trans 17179873492 rc 0/0 00000100:00100000:1.0:1746065176.495488:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2387 00002000:00100000:1.0:1746065176.495499:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1171456->1888255) req@ffff880099cd2680 x1830881262750464/t17179873492(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/448 e 0 to 0 dl 1746065187 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.495508:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd2680 with x1830881262750464 ext(1171456->1888255) 00010000:00010000:1.0:1746065176.495518:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 25 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.495532:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093967400/0x14b4f8542d4fafef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f904 expref: 25 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.495538:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd2680 00000100:00100000:0.0:1746065176.497642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.505225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.506659:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262750848 00000100:00100000:1.0:1746065176.506670:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262750848 00002000:00100000:1.0:1746065176.506709:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880099cd2d80 x1830881262750848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.506718:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cd2d80 with x1830881262750848 ext(1048576->2097151) 00010000:00010000:1.0:1746065176.506727:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b53ce000/0x14b4f8542d4faff6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f90b expref: 15 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.506739:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b53ce000/0x14b4f8542d4faff6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f90b expref: 15 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.506750:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cd2d80 00000100:00100000:0.0:1746065176.531437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.534845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.547516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.548158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.557998:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.559708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.560494:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262751872 00000100:00100000:1.0:1746065176.560502:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262751872 00010000:00010000:1.0:1746065176.560518:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3d8c00/0x14b4f8542d4fa8f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4c0 expref: 25 pid: 8851 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746065176.560536:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7036 00000100:00100000:1.0:1746065176.560540:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262751872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.560546:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.560554:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3d8c00/0x14b4f8542d4fa8f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4c0 expref: 25 pid: 8851 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.560561:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3d8c00/0x14b4f8542d4fa8f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4c0 expref: 25 pid: 8851 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.560573:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3d8c00/0x14b4f8542d4fa8f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f4c0 expref: 25 pid: 8851 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.561387:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.562227:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881262751872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1683us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.562233:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7036 00000100:00100000:0.0:1746065176.570401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.570452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.576339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.577509:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7806 00000100:00100000:1.0:1746065176.577519:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881262752640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065176.590422:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881262752640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12896us (14076us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065176.590432:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7806 00002000:00100000:1.0:1746065176.590442:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880129b0ca80 x1830881262752640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.590450:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ca80 with x1830881262752640 ext(1048576->2097151) 00002000:00010000:1.0:1746065176.590455:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0ca80 00000100:00100000:0.0:1746065176.596952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.602487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.605933:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262752896 00000100:00100000:1.0:1746065176.605947:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262752896 00002000:00100000:1.0:1746065176.606000:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->1478655) req@ffff880129b0d180 x1830881262752896/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.606009:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0d180 with x1830881262752896 ext(1048576->1478655) 00010000:00010000:1.0:1746065176.606017:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf000/0x14b4f8542d4fb012 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1478655) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f927 expref: 15 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.606028:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf000/0x14b4f8542d4fb012 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1478655) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f927 expref: 15 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.606034:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129b0d180 00000100:00100000:1.0:1746065176.606072:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2390 00000100:00100000:1.0:1746065176.606082:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881262752896:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065176.612967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.620744:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881262752896:12345-192.168.202.46@tcp:4:cat.0 Request processed in 14652us (18248us total) trans 17179873494 rc 0/0 00000100:00100000:1.0:1746065176.620757:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2390 00002000:00100000:1.0:1746065176.620770:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->1478655) req@ffff880129b0d180 x1830881262752896/t17179873494(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/448 e 0 to 0 dl 1746065187 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.620780:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0d180 with x1830881262752896 ext(1048576->1478655) 00010000:00010000:1.0:1746065176.620788:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf000/0x14b4f8542d4fb012 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1478655) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f927 expref: 17 pid: 4545 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.620800:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf000/0x14b4f8542d4fb012 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1478655) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f927 expref: 17 pid: 4545 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746065176.620806:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129b0d180 00000100:00100000:0.0:1746065176.622138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.623311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.624445:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.628594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.631336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.631776:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260240384:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.631792:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.631830:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881262753408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7296us (7385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.631837:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7041 00000100:00100000:0.0:1746065176.633477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.647933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.648534:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262754176 00000100:00100000:1.0:1746065176.648544:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262754176 00010000:00010000:1.0:1746065176.648578:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a601ae00/0x14b4f8542d4fafe1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8f6 expref: 24 pid: 21998 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746065176.648617:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7042 00000100:00100000:1.0:1746065176.648624:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881262754176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.648637:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.648657:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a601ae00/0x14b4f8542d4fafe1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8f6 expref: 24 pid: 21998 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.648673:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a601ae00/0x14b4f8542d4fafe1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8f6 expref: 24 pid: 21998 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.648694:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a601ae00/0x14b4f8542d4fafe1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8f6 expref: 24 pid: 21998 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746065176.649179:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.649243:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881262754176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 619us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.649250:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7042 00000100:00100000:0.0:1746065176.655776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.655854:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.656168:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262754432 00000100:00100000:1.0:1746065176.656172:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262754432 00010000:00010000:1.0:1746065176.656186:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 15 pid: 9716 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746065176.656201:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7043 00000100:00100000:1.0:1746065176.656205:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881262754432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.656211:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.656226:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 15 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.656235:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 15 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.656247:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a565a600/0x14b4f8542d4faf9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8b0 expref: 15 pid: 9716 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746065176.657014:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.657017:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.657022:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f363a00/0x14b4f8542d4fb027 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3174399) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f93c expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.657029:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f363a00/0x14b4f8542d4fb027 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3174399) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f93c expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.657053:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f363a00/0x14b4f8542d4fb027 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3174399) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f93c expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.657063:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260240768:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065176.657116:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.660551:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260240768:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.660572:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.660610:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262754432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4402us (4754us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.660619:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7043 00000100:00100000:0.0:1746065176.662327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.665498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.669319:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.687447:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262755200:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20764us (21946us total) trans 0 rc 1028096/1028096 00000100:00100000:0.0:1746065176.687459:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7810 00002000:00100000:0.0:1746065176.687471:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3125247) req@ffff880129b0f100 x1830881262755200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 1028096/1028096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.687480:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f100 with x1830881262755200 ext(2097152->3125247) 00002000:00010000:0.0:1746065176.687485:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f100 00000100:00100000:0.0:1746065176.698350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.712876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.736357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.738539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.745360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.747344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.766318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.766361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.767425:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262756608 00000100:00100000:1.0:1746065176.767430:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262756608 00010000:00010000:1.0:1746065176.767447:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f363a00/0x14b4f8542d4fb027 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3174399) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f93c expref: 28 pid: 4545 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065176.767472:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7044 00000100:00100000:1.0:1746065176.767477:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881262756608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.767485:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.767500:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f363a00/0x14b4f8542d4fb027 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3174399) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f93c expref: 28 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065176.767510:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f363a00/0x14b4f8542d4fb027 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3174399) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f93c expref: 28 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065176.768091:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.768093:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.768101:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f363000/0x14b4f8542d4fb03c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3657728->18446744073709551615] (req 3657728->3981311) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f951 expref: 14 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.768109:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f363000/0x14b4f8542d4fb03c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3657728->18446744073709551615] (req 3657728->3981311) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f951 expref: 14 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.768130:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f363000/0x14b4f8542d4fb03c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3657728->18446744073709551615] (req 3657728->3981311) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f951 expref: 14 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.768138:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260241280:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065176.768773:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.774784:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260241280:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.774804:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.774884:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881262756608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7406us (8521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.774893:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7044 00000100:00100000:0.0:1746065176.776110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.777061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.786519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.792231:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.792276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.796680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.796704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.796717:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262757760 00000100:00100000:1.0:1746065176.796723:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262757760 00000100:00100000:1.0:1746065176.796742:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262757888 00000100:00100000:1.0:1746065176.796743:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262757888 00000100:00100000:1.0:1746065176.796752:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13905 00000100:00100000:1.0:1746065176.796756:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881262757760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065176.796762:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.796770:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800911e0c00/0x14b4f8542d4fb05f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f974 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.796800:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260241536:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065176.796854:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.796878:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13906 00000100:00100000:1.0:1746065176.796882:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881262757888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065176.796887:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.796903:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3e2000/0x14b4f8542d4fb066 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f97b expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.796923:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881260241664:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065176.796939:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065176.800366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065176.800585:0:21235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065176 -> 1746065177 00000100:00100000:1.0:1746065176.800604:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881260241664:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065176.800629:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f3e2000/0x14b4f8542d4fb066 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f97b expref: 18 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.800644:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f3e2000/0x14b4f8542d4fb066 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f97b expref: 18 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.800671:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3e2000, rc 0) 00000100:00100000:1.0:1746065176.800707:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881262757888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3823us (4000us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065176.800713:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13906 00000100:00100000:1.0:1746065176.800758:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260241536:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065176.800774:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800911e0c00/0x14b4f8542d4fb05f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f974 expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.800781:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800911e0c00/0x14b4f8542d4fb05f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f974 expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.801298:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e0c00, rc 0) 00000100:00100000:1.0:1746065176.801315:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881262757760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4558us (4636us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065176.801320:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13905 00000100:00100000:0.0:1746065176.810578:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.811333:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262758144 00000100:00100000:1.0:1746065176.811340:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262758144 00010000:00010000:1.0:1746065176.811366:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f363000/0x14b4f8542d4fb03c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3657728->18446744073709551615] (req 3657728->3981311) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f951 expref: 17 pid: 4545 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065176.811400:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7045 00000100:00100000:1.0:1746065176.811406:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881262758144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065176.811416:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065176.811431:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f363000/0x14b4f8542d4fb03c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3657728->18446744073709551615] (req 3657728->3981311) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f951 expref: 17 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065176.811441:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f363000/0x14b4f8542d4fb03c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3657728->18446744073709551615] (req 3657728->3981311) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f951 expref: 17 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065176.811784:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f363000/0x14b4f8542d4fb03c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3657728->18446744073709551615] (req 3657728->3981311) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f951 expref: 17 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065176.811797:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.811799:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.811806:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5049e00/0x14b4f8542d4fb04a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4988928->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f95f expref: 25 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.811978:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5049e00/0x14b4f8542d4fb04a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4988928->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f95f expref: 25 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.812008:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5049e00/0x14b4f8542d4fb04a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4988928->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f95f expref: 25 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.812018:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260241792:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065176.813166:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.820141:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830881260242176:0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820188:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065176.820191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.820211:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830881260242688:0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820226:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065176.820243:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065176.820247:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1830881260242304:0@lo:400:kworker.0 00000100:00100000:0.0:1746065176.820256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.820260:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065176.820290:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260242176 00000100:00100000:1.0:1746065176.820298:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260242176 00000100:00100000:1.0:1746065176.820331:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260242688 00000100:00100000:1.0:1746065176.820333:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260242688 00000100:00100000:1.0:1746065176.820344:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260242304 00000100:00100000:1.0:1746065176.820345:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260242304 00000100:00100000:1.0:1746065176.820359:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1746065176.820364:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830881260242176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820396:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830881260242176:12345-0@lo:400:kworker.0 Request processed in 32us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.820401:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1746065176.820413:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1746065176.820417:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830881260242688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820435:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830881260242688:12345-0@lo:400:kworker.0 Request processed in 18us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.820439:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1746065176.820772:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1746065176.820777:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830881260242304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820798:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830881260242304:12345-0@lo:400:kworker.0 Request processed in 21us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.820801:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1746065176.820832:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065176.820852:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1830881260242304:0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820869:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830881260242176:0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820875:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830881260242688:0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820892:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260242432 00000100:00100000:1.0:1746065176.820894:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260242432 00000100:00100000:1.0:1746065176.820912:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1746065176.820915:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1830881260242432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.820939:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1830881260242432:12345-0@lo:400:kworker.0 Request processed in 22us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.820943:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00080000:1.0:1746065176.820953:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065176.822797:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260242560 00000100:00100000:1.0:1746065176.822801:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260242560 00000100:00100000:1.0:1746065176.822842:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1746065176.822847:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3295:x1830881260242560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065176.822886:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3295:x1830881260242560:12345-0@lo:400:kworker.0 Request processed in 39us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.822891:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:1.0:1746065176.822904:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065176.823073:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262758528 00000100:00100000:0.0:1746065176.823077:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262758528 00002000:00100000:0.0:1746065176.823098:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009dc9d880 x1830881262758528/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.823107:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc9d880 with x1830881262758528 ext(1048576->2097151) 00002000:00010000:0.0:1746065176.823111:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc9d880 00000100:00100000:0.0:1746065176.823119:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262758656 00000100:00100000:0.0:1746065176.823121:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262758656 00002000:00100000:0.0:1746065176.823128:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009dc9dc00 x1830881262758656/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.823134:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc9dc00 with x1830881262758656 ext(1048576->2097151) 00002000:00010000:0.0:1746065176.823136:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc9dc00 00000100:00100000:0.0:1746065176.823143:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7815 00000100:00100000:0.0:1746065176.823147:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881262758528:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065176.829293:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260241792:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065176.829316:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065176.829369:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881262758144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 17962us (18795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.829378:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7045 00000100:00100000:0.0:1746065176.836773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.838210:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262759040 00000100:00100000:1.0:1746065176.838220:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262759040 00002000:00100000:1.0:1746065176.838256:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4988928->4993023) req@ffff88009dc9df80 x1830881262759040/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.838266:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc9df80 with x1830881262759040 ext(4988928->4993023) 00002000:00010000:1.0:1746065176.838271:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009dc9df80 00000100:00100000:0.0:1746065176.841759:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881262758528:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18608us (21565us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065176.841767:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7815 00002000:00100000:0.0:1746065176.841773:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009dc9d880 x1830881262758528/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.841780:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc9d880 with x1830881262758528 ext(1048576->2097151) 00002000:00010000:0.0:1746065176.841784:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009dc9d880 00000100:00100000:1.0:1746065176.868043:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065176.868061:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260242816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065176.868116:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065176.869591:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260242816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065176.871227:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262759168 00000100:00100000:1.0:1746065176.871233:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262759168 00000100:00100000:1.0:1746065176.871274:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262759296 00000100:00100000:1.0:1746065176.871277:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262759296 00000100:00100000:1.0:1746065176.871293:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13907 00000100:00100000:1.0:1746065176.871299:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881262759168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065176.871312:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.871326:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb06d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f982 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.871343:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.871345:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.871353:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb06d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f982 expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.871366:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb06d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f982 expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.871376:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3e2c00, rc 0) 00000100:00100000:1.0:1746065176.871410:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262759168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 111us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.871417:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13907 00000100:00100000:1.0:1746065176.871430:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13908 00000100:00100000:1.0:1746065176.871435:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881262759296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065176.871442:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.871450:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3e2400/0x14b4f8542d4fb074 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f989 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065176.871478:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260242944:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065176.871524:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.876512:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260242944:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065176.876544:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f3e2400/0x14b4f8542d4fb074 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f989 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.876557:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f3e2400/0x14b4f8542d4fb074 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f989 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.876982:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3e2400, rc 0) 00000100:00100000:1.0:1746065176.877034:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881262759296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5597us (6559us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065176.877042:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13908 00000100:00100000:0.0:1746065176.888216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.904434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.904805:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262759680 00000100:00100000:1.0:1746065176.904865:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262759680 00000100:00100000:1.0:1746065176.904914:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13909 00000100:00100000:1.0:1746065176.904921:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:31394:x1830881262759680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065176.904941:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.904956:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927dac00/0x14b4f8542d4fb07b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f990 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.904988:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1c00/0x14b4f8542d4fb020 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f935 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.904995:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065176.904997:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065176.905000:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927dac00/0x14b4f8542d4fb07b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f990 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.905026:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1c00/0x14b4f8542d4fb020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f935 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.905037:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1c00/0x14b4f8542d4fb020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f935 expref: 24 pid: 4545 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065176.905049:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260243072:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065176.905142:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065176.910989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.911316:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260243072:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065176.911341:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927dac00/0x14b4f8542d4fb07b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f990 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.911354:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927dac00, rc 0) 00000100:00100000:1.0:1746065176.911661:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:31394:x1830881262759680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6738us (7232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.911668:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13909 00000100:00100000:1.0:1746065176.938622:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262759936 00000100:00100000:1.0:1746065176.938630:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262759936 00000100:00100000:1.0:1746065176.938665:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13910 00000100:00100000:1.0:1746065176.938672:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:31401:x1830881262759936:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065176.938685:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.938700:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd57e00/0x14b4f8542d4fb082 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f997 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.938732:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a211200/0x14b4f8542d4faf2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f840 expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.938740:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f14f000/0x14b4f8542d4faf47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f85c expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.938744:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.938746:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.938749:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd57e00/0x14b4f8542d4fb082 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1654784->1712127] (req 1654784->1712127) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f997 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.938775:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f14f000/0x14b4f8542d4faf47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f85c expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.938783:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f14f000/0x14b4f8542d4faf47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f85c expref: 25 pid: 21998 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065176.938793:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260243200:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065176.939178:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a211200/0x14b4f8542d4faf2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f840 expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.939185:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a211200/0x14b4f8542d4faf2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f840 expref: 18 pid: 9716 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065176.939193:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260243328:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065176.939212:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065176.939543:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262760064 00000100:00100000:0.0:1746065176.939547:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262760064 00010000:00010000:0.0:1746065176.939565:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1c00/0x14b4f8542d4fb020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f935 expref: 27 pid: 4545 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065176.939592:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7046 00000100:00100000:0.0:1746065176.939597:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881262760064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065176.939607:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065176.939623:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1c00/0x14b4f8542d4fb020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f935 expref: 27 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065176.939631:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1c00/0x14b4f8542d4fb020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f935 expref: 27 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065176.939646:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1c00/0x14b4f8542d4fb020 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f935 expref: 27 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065176.939665:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065176.939666:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065176.939671:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927dac00/0x14b4f8542d4fb07b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f990 expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.939678:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927dac00/0x14b4f8542d4fb07b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f990 expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065176.939694:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800927dac00/0x14b4f8542d4fb07b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f990 expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065176.939702:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009dc9f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260243456:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065176.939725:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.943241:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260243200:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065176.943253:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260243328:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065176.943282:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd57e00/0x14b4f8542d4fb082 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1654784->1712127] (req 1654784->1712127) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f997 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065176.943282:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009dc9f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260243456:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065176.943293:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065176.943295:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd57e00, rc 0) 00000100:00100000:0.0:1746065176.943340:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262760064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3741us (4794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065176.943349:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7046 00000100:00100000:1.0:1746065176.943719:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:31401:x1830881262759936:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5046us (5275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.943725:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13910 00000100:00100000:0.0:1746065176.954030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.954075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.956913:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262760704 00000100:00100000:1.0:1746065176.956920:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262760704 00002000:00100000:1.0:1746065176.956952:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094ff4e00 x1830881262760704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.956962:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4e00 with x1830881262760704 ext(3145728->4194303) 00002000:00010000:1.0:1746065176.956966:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff4e00 00000100:00100000:1.0:1746065176.956979:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262760960 00000100:00100000:1.0:1746065176.956980:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262760960 00002000:00100000:1.0:1746065176.956990:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094ff5f80 x1830881262760960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.956996:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff5f80 with x1830881262760960 ext(3145728->4194303) 00002000:00010000:1.0:1746065176.956999:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff5f80 00000100:00100000:1.0:1746065176.957005:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262760832 00000100:00100000:1.0:1746065176.957006:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262760832 00002000:00100000:1.0:1746065176.957012:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009c3f9880 x1830881262760832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.957018:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830881262760832 ext(2097152->3145727) 00002000:00010000:1.0:1746065176.957020:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00000100:00100000:1.0:1746065176.957028:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262761344 00000100:00100000:1.0:1746065176.957029:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262761344 00002000:00100000:1.0:1746065176.957035:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1654784->1658879) req@ffff88009c3fa680 x1830881262761344/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.957041:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881262761344 ext(1654784->1658879) 00002000:00010000:1.0:1746065176.957043:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:1.0:1746065176.957051:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7820 00000100:00100000:1.0:1746065176.957055:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881262760960:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065176.957210:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7821 00000100:00100000:1.0:1746065176.957214:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881262760832:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065176.968125:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262761600 00000100:00100000:0.0:1746065176.968133:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262761600 00002000:00100000:0.0:1746065176.968169:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1708032->1712127) req@ffff88009fb10380 x1830881262761600/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/0 e 0 to 0 dl 1746065187 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.968178:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881262761600 ext(1708032->1712127) 00002000:00010000:0.0:1746065176.968182:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10380 00000100:00100000:0.0:1746065176.968213:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7823 00000100:00100000:0.0:1746065176.968220:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881262761600:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065176.968368:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881262761600:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 148us (1262us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065176.968374:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7823 00002000:00100000:0.0:1746065176.968380:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1708032->1712127) req@ffff88009fb10380 x1830881262761600/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.968386:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881262761600 ext(1708032->1712127) 00002000:00010000:0.0:1746065176.968389:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10380 00000100:00100000:0.0:1746065176.969365:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881262760704:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12315us (12551us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065176.969371:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7819 00002000:00100000:0.0:1746065176.969377:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094ff4e00 x1830881262760704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065176.969388:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4e00 with x1830881262760704 ext(3145728->4194303) 00002000:00010000:0.0:1746065176.969391:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff4e00 00000100:00100000:1.0:1746065176.976694:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262760832:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 19472us (19798us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065176.976702:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7821 00002000:00100000:1.0:1746065176.976710:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009c3f9880 x1830881262760832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:92/0 lens 488/440 e 0 to 0 dl 1746065187 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065176.976717:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830881262760832 ext(2097152->3145727) 00002000:00010000:1.0:1746065176.976721:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00010000:00010000:0.0:1746065176.977544:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065176.986622:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.988090:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262761728 00000100:00100000:1.0:1746065176.988102:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262761728 00000100:00100000:1.0:1746065176.988155:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13911 00000100:00100000:1.0:1746065176.988163:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31403:x1830881262761728:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065176.988180:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.988196:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f99e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.988224:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fb019 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f92e expref: 27 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.988232:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0200/0x14b4f8542d4fb058 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f96d expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.988238:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.988240:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.988243:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.988272:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0200/0x14b4f8542d4fb058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f96d expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.988282:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b0200/0x14b4f8542d4fb058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f96d expref: 17 pid: 21998 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065176.988299:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260243712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065176.988400:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fb019 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f92e expref: 27 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.988407:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fb019 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f92e expref: 27 pid: 4545 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065176.988416:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260243840:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065176.988438:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065176.990964:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260243712:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065176.990973:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260243840:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065176.990999:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.991013:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b418fe00, rc 0) 00000100:00100000:1.0:1746065176.991054:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31403:x1830881262761728:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2891us (4435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065176.991060:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13911 00000100:00100000:0.0:1746065176.996906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065176.996945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.996953:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262762112 00000100:00100000:1.0:1746065176.996962:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262762112 00000100:00100000:0.0:1746065176.996983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065176.997000:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13912 00000100:00100000:1.0:1746065176.997007:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881262762112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065176.997023:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065176.997039:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f14f000/0x14b4f8542d4fb090 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f9a5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065176.997059:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065176.997069:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f14f000/0x14b4f8542d4fb090 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9a5 expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.997080:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f14f000/0x14b4f8542d4fb090 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9a5 expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065176.997095:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14f000, rc 0) 00000100:00100000:1.0:1746065176.997752:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881262762112:12345-192.168.202.46@tcp:101:cat.0 Request processed in 743us (850us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065176.997759:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13912 00000100:00100000:0.0:1746065176.999609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.001767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.003179:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262762624 00000100:00100000:1.0:1746065177.003187:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262762624 00002000:00100000:1.0:1746065177.003225:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88009dc9d180 x1830881262762624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.003234:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc9d180 with x1830881262762624 ext(4194304->4993023) 00002000:00010000:1.0:1746065177.003238:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009dc9d180 00000100:00100000:1.0:1746065177.003263:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7825 00000100:00100000:1.0:1746065177.003271:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262762624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065177.005127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.005173:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262762752 00000100:00100000:1.0:1746065177.005179:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262762752 00000100:00100000:1.0:1746065177.005267:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13913 00000100:00100000:1.0:1746065177.005275:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31403:x1830881262762752:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065177.005290:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.005304:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f9ac expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.005328:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd57e00/0x14b4f8542d4fb082 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1712127) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f997 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.005335:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065177.005336:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065177.005340:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.005367:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd57e00/0x14b4f8542d4fb082 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1712127) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f997 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.005378:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd57e00/0x14b4f8542d4fb082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1712127) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f997 expref: 18 pid: 8429 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.005389:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260244096:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.005924:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065177.011594:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262762624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8313us (9817us total) trans 0 rc 798720/798720 00000100:00100000:1.0:1746065177.011606:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7825 00002000:00100000:1.0:1746065177.011616:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88009dc9d180 x1830881262762624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.011624:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009dc9d180 with x1830881262762624 ext(4194304->4993023) 00002000:00010000:1.0:1746065177.011631:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009dc9d180 00000100:00100000:0.0:1746065177.012030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.012775:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260244096:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065177.012797:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.012808:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b418ee00, rc 0) 00000100:00100000:1.0:1746065177.012869:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31403:x1830881262762752:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7595us (7746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.012875:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13913 00000100:00100000:0.0:1746065177.016651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.016795:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262763008 00000100:00100000:1.0:1746065177.016802:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262763008 00000100:00100000:1.0:1746065177.017095:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13914 00000100:00100000:1.0:1746065177.017103:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262763008:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065177.017116:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.017128:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b418e000/0x14b4f8542d4fb09e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f9b3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.017256:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260244224:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065177.017303:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00002000:00010000:1.0:1746065177.019477:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime: 1746065174 -> 1746065177 00000100:00100000:1.0:1746065177.019500:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260244224:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065177.019524:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b418e000/0x14b4f8542d4fb09e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9b3 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.019535:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b418e000/0x14b4f8542d4fb09e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9b3 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.019552:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b418e000, rc 0) 00000100:00100000:1.0:1746065177.019776:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262763008:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2673us (3127us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065177.019783:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13914 00000100:00100000:0.0:1746065177.020492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.047983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065177.051152:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065177.055524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.055562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065177.057433:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065177.059261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.061374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.065114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.065147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.065172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.065185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065177.066060:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065177.066083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.068562:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262764928 00000100:00100000:1.0:1746065177.068573:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262764928 00000100:00100000:1.0:1746065177.068613:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262765056 00000100:00100000:1.0:1746065177.068616:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262765056 00000100:00100000:1.0:1746065177.068628:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262765184 00000100:00100000:1.0:1746065177.068630:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262765184 00000100:00100000:1.0:1746065177.068638:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262765312 00000100:00100000:1.0:1746065177.068640:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262765312 00000100:00100000:1.0:1746065177.068653:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13918 00000100:00100000:1.0:1746065177.068660:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262764800:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065177.068675:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.068690:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f9d6 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.068710:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.068712:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.068719:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.068734:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.068744:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3d9200, rc 0) 00000100:00100000:1.0:1746065177.068788:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262764800:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 129us (3682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.068793:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13918 00000100:00100000:1.0:1746065177.068807:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13920 00000100:00100000:1.0:1746065177.068812:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262765056:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065177.068831:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.068837:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fb0e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5f9e4 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.068886:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260245120:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065177.068925:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9085240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.069889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.074183:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260245120:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065177.074202:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fb0e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9e4 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.074210:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fb0e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9e4 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.074226:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3d9c00, rc 0) 00000100:00100000:1.0:1746065177.074245:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262765056:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5433us (9071us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065177.074249:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13920 00000100:00100000:0.0:1746065177.078219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.085211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.089406:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.092078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.101489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.101539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.101627:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262766208 00000100:00100000:1.0:1746065177.101635:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262766208 00000100:00100000:0.0:1746065177.109752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.116221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.116250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.116261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.116273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.116292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.116310:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262766720 00000100:00100000:0.0:1746065177.116317:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262766720 00000100:00100000:0.0:1746065177.116345:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262766848 00000100:00100000:0.0:1746065177.116346:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262766848 00000100:00100000:0.0:1746065177.116354:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262766976 00000100:00100000:0.0:1746065177.116355:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262766976 00000100:00100000:0.0:1746065177.116361:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262767104 00000100:00100000:0.0:1746065177.116362:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262767104 00000100:00100000:0.0:1746065177.116369:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262767232 00000100:00100000:0.0:1746065177.116370:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262767232 00000100:00100000:0.0:1746065177.116380:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13926 00000100:00100000:0.0:1746065177.116386:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262766720:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065177.116423:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fb146 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.116440:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.116452:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.116459:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009534e000/0x14b4f8542d4fafd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e8 expref: 17 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.116464:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.116465:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.116468:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fb146 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.116494:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009534e000/0x14b4f8542d4fafd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e8 expref: 17 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.116504:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009534e000/0x14b4f8542d4fafd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e8 expref: 17 pid: 9716 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746065177.116515:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260245888:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065177.116584:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.116591:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 10 pid: 4544 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746065177.116598:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260246016:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065177.116620:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.116626:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 25 pid: 8851 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.116632:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260246144:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065177.116641:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.116657:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13927 00000100:00100000:0.0:1746065177.116662:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262766848:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065177.116683:0:2462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.116692:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf400/0x14b4f8542d4fb00b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f920 expref: 25 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.116698:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a601be00/0x14b4f8542d4fb0dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9dd expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.116704:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4fb051 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f966 expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.116708:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.116709:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.116711:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.116727:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4fb051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f966 expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.116734:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4fb051 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f966 expref: 16 pid: 21998 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746065177.116742:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260246272:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065177.116761:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a601be00/0x14b4f8542d4fb0dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9dd expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.116768:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a601be00/0x14b4f8542d4fb0dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9dd expref: 9 pid: 8851 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746065177.116775:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260246400:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065177.116791:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf400/0x14b4f8542d4fb00b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f920 expref: 25 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.116797:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf400/0x14b4f8542d4fb00b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f920 expref: 25 pid: 4545 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.116804:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260246528:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065177.116845:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.116886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.127397:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260246272:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065177.127401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.127406:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260246400:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.127411:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260246528:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065177.127417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065177.127434:0:2462:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065177.127437:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262767872 00000100:00100000:0.0:1746065177.127442:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262767872 00010000:00010000:0.0:1746065177.127467:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4fb051 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f966 expref: 17 pid: 21998 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746065177.127487:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262767616 00000100:00100000:0.0:1746065177.127489:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262767616 00010000:00010000:0.0:1746065177.127496:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a601be00/0x14b4f8542d4fb0dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9dd expref: 11 pid: 8851 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746065177.127509:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7055 00000100:00100000:0.0:1746065177.127514:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881262767872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065177.127523:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065177.127541:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4fb051 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f966 expref: 17 pid: 21998 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746065177.127549:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4fb051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f966 expref: 17 pid: 21998 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746065177.127565:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1800/0x14b4f8542d4fb051 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f966 expref: 17 pid: 21998 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746065177.128386:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065177.128432:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881262767872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 917us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.128439:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7055 00000100:00100000:1.0:1746065177.129241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.129252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.129835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.130673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.130946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.130960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.130972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.130986:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262767744 00000100:00100000:1.0:1746065177.130989:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262767744 00002000:00100000:1.0:1746065177.131016:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (2031616->2097151) req@ffff88009baa2d80 x1830881262767744/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.131024:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2d80 with x1830881262767744 ext(2031616->2097151) 00010000:00010000:1.0:1746065177.131030:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 26 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.131039:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 26 pid: 8429 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746065177.131045:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009baa2d80 00000100:00100000:1.0:1746065177.131057:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262768512 00000100:00100000:1.0:1746065177.131059:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262768512 00002000:00100000:1.0:1746065177.131069:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1265663) req@ffff88009baa2300 x1830881262768512/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.131080:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2300 with x1830881262768512 ext(1048576->1265663) 00010000:00010000:1.0:1746065177.131085:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 26 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.131091:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 26 pid: 8429 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746065177.131096:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa2300 00000100:00100000:1.0:1746065177.131105:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2397 00000100:00100000:1.0:1746065177.131110:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262767744:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065177.131238:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2398 00000100:00100000:1.0:1746065177.131244:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881262768512:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065177.131440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.131454:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262768128 00000100:00100000:1.0:1746065177.131457:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262768128 00010000:00010000:1.0:1746065177.131468:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf400/0x14b4f8542d4fb00b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f920 expref: 28 pid: 4545 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.131479:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262767488 00000100:00100000:1.0:1746065177.131480:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262767488 00010000:00010000:1.0:1746065177.131488:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 11 pid: 4544 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.131495:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262768256 00000100:00100000:1.0:1746065177.131496:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262768256 00010000:00010000:1.0:1746065177.131504:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009534e000/0x14b4f8542d4fafd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e8 expref: 18 pid: 9716 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.131511:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262768384 00000100:00100000:1.0:1746065177.131512:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262768384 00010000:00010000:1.0:1746065177.131518:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 28 pid: 8851 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.131525:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262768640 00000100:00100000:1.0:1746065177.131526:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262768640 00010000:00010000:1.0:1746065177.131532:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb06d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f982 expref: 19 pid: 8429 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.131540:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7057 00000100:00100000:1.0:1746065177.131544:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881262768128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.131551:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.131564:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf400/0x14b4f8542d4fb00b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f920 expref: 28 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.131572:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf400/0x14b4f8542d4fb00b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f920 expref: 28 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.131589:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53cf400/0x14b4f8542d4fb00b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f920 expref: 28 pid: 4545 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.131607:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.131609:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.131612:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.131620:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.131636:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.131651:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881262768128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.131657:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7057 00000100:00100000:1.0:1746065177.131670:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7058 00000100:00100000:1.0:1746065177.131674:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262767488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.131680:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.131689:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 11 pid: 4544 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131696:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 11 pid: 4544 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131707:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb0d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9d6 expref: 11 pid: 4544 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131715:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.131726:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262767488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.131731:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7058 00000100:00100000:1.0:1746065177.131739:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7059 00000100:00100000:1.0:1746065177.131743:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262768256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.131748:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.131753:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009534e000/0x14b4f8542d4fafd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e8 expref: 19 pid: 9716 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131760:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009534e000/0x14b4f8542d4fafd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e8 expref: 19 pid: 9716 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131769:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009534e000/0x14b4f8542d4fafd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8e8 expref: 19 pid: 9716 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131775:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.131786:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881262768256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 43us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.131790:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7059 00000100:00100000:1.0:1746065177.131798:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7060 00000100:00100000:1.0:1746065177.131802:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881262768384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.131808:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.131833:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 28 pid: 8851 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.131841:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 28 pid: 8851 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.131851:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a601a000/0x14b4f8542d4fafbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f8d3 expref: 28 pid: 8851 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.131873:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.131875:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.131877:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fb146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.131882:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fb146 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.131894:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.131908:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881262768384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 105us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.131913:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7060 00000100:00100000:1.0:1746065177.131922:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7061 00000100:00100000:1.0:1746065177.131926:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881262768640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.131931:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.131939:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb06d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f982 expref: 17 pid: 8429 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131946:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb06d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f982 expref: 17 pid: 8429 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131955:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb06d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f982 expref: 17 pid: 8429 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.131963:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.131974:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881262768640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 48us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.131978:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7061 00010000:00010000:1.0:1746065177.131993:0:2462:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.132000:0:2462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.132014:0:2462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.132020:0:2462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.132026:0:2462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.132031:0:2462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5048000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065177.132034:0:2462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.132041:0:2462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.132049:0:2462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.132058:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5048000/0x14b4f8542d4fb14d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.132088:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262766848:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 15426us (15838us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.132093:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13927 00000100:00100000:1.0:1746065177.137254:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881262767744:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 6142us (6306us total) trans 17179873496 rc 0/0 00000100:00100000:1.0:1746065177.137261:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2397 00002000:00100000:1.0:1746065177.137270:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (2031616->2097151) req@ffff88009baa2d80 x1830881262767744/t17179873496(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/448 e 0 to 0 dl 1746065188 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.137278:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2d80 with x1830881262767744 ext(2031616->2097151) 00010000:00010000:1.0:1746065177.137284:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 27 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.137292:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 27 pid: 8429 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746065177.137299:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009baa2d80 00000100:00100000:0.0:1746065177.138436:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881262768512:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 7189us (7459us total) trans 21474840749 rc 0/0 00000100:00100000:0.0:1746065177.138444:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2398 00002000:00100000:0.0:1746065177.138450:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1265663) req@ffff88009baa2300 x1830881262768512/t21474840749(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/448 e 0 to 0 dl 1746065188 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.138458:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2300 with x1830881262768512 ext(1048576->1265663) 00010000:00010000:0.0:1746065177.138464:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 25 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.138473:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 25 pid: 8429 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746065177.138479:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa2300 00000100:00100000:1.0:1746065177.141099:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262769280 00000100:00100000:1.0:1746065177.141107:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262769280 00010000:00010000:1.0:1746065177.141137:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 27 pid: 8429 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.141436:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7067 00000100:00100000:1.0:1746065177.141445:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881262769280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.141457:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.141476:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 27 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.141487:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 27 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.141508:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b418fe00/0x14b4f8542d4fb089 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f99e expref: 27 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.141535:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.141536:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.141541:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be8a600/0x14b4f8542d4fb154 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.141548:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be8a600/0x14b4f8542d4fb154 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.141661:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.141950:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881262769280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 506us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.141956:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7067 00000100:00100000:0.0:1746065177.144363:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.144944:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262769408 00000100:00100000:1.0:1746065177.144952:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262769408 00010000:00010000:1.0:1746065177.144978:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 25 pid: 8429 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.145005:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7068 00000100:00100000:1.0:1746065177.145012:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881262769408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.145023:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.145040:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 25 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.145049:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 25 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.145067:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b418ee00/0x14b4f8542d4fb097 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f9ac expref: 25 pid: 8429 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.145079:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.145081:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.145085:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f362400/0x14b4f8542d4fb15b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.145092:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f362400/0x14b4f8542d4fb15b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.145110:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.145142:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881262769408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 129us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.147367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.147467:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7068 00000100:00100000:1.0:1746065177.154050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.154104:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262770176 00000100:00100000:0.0:1746065177.154109:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262770176 00000100:00100000:0.0:1746065177.154152:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4151 00000100:00100000:0.0:1746065177.154157:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:27246:x1830881262770176:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065177.154895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.154914:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262770304 00000100:00100000:1.0:1746065177.154917:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262770304 00010000:00010000:1.0:1746065177.154936:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918000/0x14b4f8542d4fa9eb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f53e expref: 270 pid: 20754 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.154955:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7069 00000100:00100000:1.0:1746065177.154961:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:1961:x1830881262770304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.154969:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.154974:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918000/0x14b4f8542d4fa9eb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f53e expref: 270 pid: 20754 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.154983:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918000/0x14b4f8542d4fa9eb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f53e expref: 270 pid: 20754 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.154999:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:1.0:1746065177.155003:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065177.155011:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.155177:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:1961:x1830881262770304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 216us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.155183:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7069 00000100:00100000:1.0:1746065177.155238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.155270:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:27246:x1830881262770176:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 1113us (1222us total) trans 8589943990 rc 0/0 00000100:00100000:0.0:1746065177.155276:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4151 00000100:00100000:0.0:1746065177.155297:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262770048 00000100:00100000:0.0:1746065177.155302:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262770048 00010000:00010000:0.0:1746065177.155311:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4000/0x14b4f8542d4faafc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5d1 expref: 33 pid: 16767 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.155323:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7070 00000100:00100000:0.0:1746065177.155328:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1961:x1830881262770048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065177.155333:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065177.155337:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4000/0x14b4f8542d4faafc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5d1 expref: 33 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155344:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4000/0x14b4f8542d4faafc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5d1 expref: 33 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155353:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093fc4000/0x14b4f8542d4faafc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5d1 expref: 33 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155360:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065177.155363:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065177.155367:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065177.155377:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881262770048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.155381:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7070 00000100:00100000:1.0:1746065177.155453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.155479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.155487:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262769792 00000100:00100000:1.0:1746065177.155490:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262769792 00010000:00010000:1.0:1746065177.155500:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59800/0x14b4f8542d4faab6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5a7 expref: 269 pid: 16767 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.155630:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262770432 00000100:00100000:1.0:1746065177.155633:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262770432 00010000:00010000:1.0:1746065177.155642:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fa9e4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f537 expref: 32 pid: 20754 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.155687:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262770560 00000100:00100000:0.0:1746065177.155690:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262770560 00010000:00010000:0.0:1746065177.155699:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565b800/0x14b4f8542d4fa9ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f529 expref: 33 pid: 16767 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.155721:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7071 00000100:00100000:0.0:1746065177.155725:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:1959:x1830881262769792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065177.155731:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065177.155735:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59800/0x14b4f8542d4faab6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5a7 expref: 269 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155742:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59800/0x14b4f8542d4faab6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5a7 expref: 269 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155750:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db59800/0x14b4f8542d4faab6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f5a7 expref: 269 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155758:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065177.155761:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065177.155765:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065177.155777:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:1959:x1830881262769792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.155781:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7071 00000100:00100000:0.0:1746065177.155789:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7072 00000100:00100000:0.0:1746065177.155792:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881262770432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065177.155798:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065177.155800:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fa9e4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f537 expref: 33 pid: 20754 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155807:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fa9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f537 expref: 33 pid: 20754 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155828:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fa9e4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f537 expref: 33 pid: 20754 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155835:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065177.155837:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065177.155842:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065177.155851:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881262770432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.155865:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7072 00000100:00100000:0.0:1746065177.155874:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7073 00000100:00100000:0.0:1746065177.155877:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881262770560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065177.155882:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065177.155885:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565b800/0x14b4f8542d4fa9ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f529 expref: 31 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155891:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565b800/0x14b4f8542d4fa9ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f529 expref: 31 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155899:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565b800/0x14b4f8542d4fa9ba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f529 expref: 31 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.155904:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065177.155907:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065177.155911:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065177.155919:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881262770560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.155923:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7073 00000100:00100000:0.0:1746065177.155933:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262770816 00000100:00100000:0.0:1746065177.155935:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262770816 00000100:00100000:0.0:1746065177.155945:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4152 00000100:00100000:0.0:1746065177.155948:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+30:27031:x1830881262770816:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065177.156014:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+31:27031:x1830881262770816:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 65us (561us total) trans 8589943991 rc 0/0 00000100:00100000:0.0:1746065177.156019:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4152 00000100:00100000:0.0:1746065177.157737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.157885:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.157901:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262771072 00000100:00100000:1.0:1746065177.157908:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262771072 00010000:00010000:1.0:1746065177.157927:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565be00/0x14b4f8542d4fae9f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7d7 expref: 268 pid: 16767 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.157991:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7074 00000100:00100000:1.0:1746065177.157998:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:1960:x1830881262771072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.158008:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.158012:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565be00/0x14b4f8542d4fae9f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7d7 expref: 268 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.158021:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565be00/0x14b4f8542d4fae9f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7d7 expref: 268 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.158037:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565be00/0x14b4f8542d4fae9f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7d7 expref: 268 pid: 16767 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.158048:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:1.0:1746065177.158052:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065177.158058:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.158222:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1960:x1830881262771072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 223us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.158228:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7074 00000100:00100000:1.0:1746065177.158241:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7075 00000100:00100000:1.0:1746065177.158245:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881262770944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.158252:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.158256:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fae6e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7b4 expref: 31 pid: 14643 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.158264:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fae6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7b4 expref: 31 pid: 14643 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.158275:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fae6e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5f7b4 expref: 31 pid: 14643 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.158282:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:1.0:1746065177.158284:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065177.158290:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065177.158296:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f362000/0x14b4f8542d4fb170 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065177.158311:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.158574:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881262770944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 327us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.158580:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7075 00000001:00080000:1.0:1746065177.180065:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943991 is committed 00000001:00080000:1.0:1746065177.180078:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943990 is committed 00000001:00080000:1.0:1746065177.180086:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943941 is committed 00000001:00080000:1.0:1746065177.180098:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943975 is committed 00000001:00080000:1.0:1746065177.180120:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943989 is committed 00000001:00080000:1.0:1746065177.180158:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943992 is committed 00000004:00080000:1.0:1746065177.180161:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2310 committed 00000004:00080000:1.0:1746065177.180167:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2273 committed 00000004:00080000:1.0:1746065177.180173:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2272 committed 00000004:00080000:1.0:1746065177.180174:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2271 committed 00000004:00080000:1.0:1746065177.180176:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2270 committed 00000004:00080000:1.0:1746065177.180177:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2309 committed 00000004:00080000:1.0:1746065177.180179:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2269 committed 00000004:00080000:1.0:1746065177.180180:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2308 committed 00000004:00080000:1.0:1746065177.180181:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2268 committed 00000004:00080000:1.0:1746065177.180182:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2307 committed 00000004:00080000:1.0:1746065177.180184:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2306 committed 00000004:00080000:1.0:1746065177.180185:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2305 committed 00000004:00080000:1.0:1746065177.180186:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2267 committed 00000004:00080000:1.0:1746065177.180188:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2266 committed 00000004:00080000:1.0:1746065177.180194:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2304 committed 00000004:00080000:1.0:1746065177.180195:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2303 committed 00000004:00080000:1.0:1746065177.180196:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2265 committed 00000100:00100000:0.0:1746065177.181307:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260249344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.181332:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182040:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260248576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.182059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182077:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260249088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.182091:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182105:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260249600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.182117:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182126:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260250112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.182130:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260250368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.182136:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182145:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260250624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.182152:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182160:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260248704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.182169:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746065177.182172:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065177.182174:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260250496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.182179:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260249216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.182189:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182195:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260249856 00000100:00100000:1.0:1746065177.182197:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260249856 00000100:00100000:0.0:1746065177.182208:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260248576 00000100:00100000:1.0:1746065177.182210:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260249088 00000100:00100000:1.0:1746065177.182211:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260249088 00000100:00100000:0.0:1746065177.182211:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260248576 00000100:00100000:1.0:1746065177.182217:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260249600 00000100:00100000:1.0:1746065177.182218:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260249600 00000100:00100000:1.0:1746065177.182224:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260250368 00000100:00100000:0.0:1746065177.182224:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260250112 00000100:00100000:0.0:1746065177.182225:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260250112 00000100:00100000:1.0:1746065177.182226:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260250368 00000100:00100000:1.0:1746065177.182233:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260250496 00000100:00100000:0.0:1746065177.182233:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260248704 00000100:00100000:0.0:1746065177.182234:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260248704 00000100:00100000:1.0:1746065177.182235:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260250496 00000100:00100000:1.0:1746065177.182243:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13936 00000100:00100000:1.0:1746065177.182247:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3298:x1830881260249856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.182253:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13937 00000100:00100000:0.0:1746065177.182258:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881260249088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065177.182326:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065177.182329:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.182330:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.182332:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.182334:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1746065177.182340:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065177.182343:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065177.182344:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065177.182346:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065177.182348:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065177.182352:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3298:x1830881260249856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (647us total) trans 17179873499 rc 0/0 00000100:00100000:1.0:1746065177.182357:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13936 00000100:00100000:1.0:1746065177.182368:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13938 00000100:00100000:0.0:1746065177.182369:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260249088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (276us total) trans 21474840751 rc 0/0 00000100:00100000:1.0:1746065177.182372:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260248576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.182375:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13937 00000100:00100000:0.0:1746065177.182385:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13939 00000100:00100000:0.0:1746065177.182390:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3295:x1830881260249600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.182449:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260248576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (388us total) trans 21474840752 rc 0/0 00000100:00100000:1.0:1746065177.182453:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13938 00000100:00100000:1.0:1746065177.182465:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13940 00000100:00100000:0.0:1746065177.182467:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881260249600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (348us total) trans 17179873500 rc 0/0 00000100:00100000:1.0:1746065177.182469:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881260250112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.182472:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13939 00000100:00100000:0.0:1746065177.182482:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13941 00000100:00100000:0.0:1746065177.182486:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3297:x1830881260250368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.182536:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881260250112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (398us total) trans 17179873501 rc 0/0 00000100:00100000:1.0:1746065177.182541:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13940 00000100:00100000:1.0:1746065177.182549:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13942 00002000:00010000:0.0:1746065177.182551:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1746065177.182553:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260248704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065177.182553:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065177.182555:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065177.182556:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065177.182557:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065177.182578:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881260250368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (425us total) trans 21474840753 rc 0/0 00000100:00100000:0.0:1746065177.182583:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13941 00000100:00100000:0.0:1746065177.182592:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13943 00000100:00100000:0.0:1746065177.182596:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3297:x1830881260250496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.182611:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182627:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260248704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (454us total) trans 21474840754 rc 0/0 00000100:00100000:1.0:1746065177.182632:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13942 00000004:00080000:0.0:1746065177.182632:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009baa1880/2, rc 0, transno 21474840752 00000100:00100000:0.0:1746065177.182635:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260248576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.182639:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260250624 00000004:00080000:0.0:1746065177.182641:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90adc00/2, rc 0, transno 21474840751 00000100:00100000:1.0:1746065177.182642:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260250624 00000100:00100000:0.0:1746065177.182643:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260249088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.182650:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13944 00000004:00080000:0.0:1746065177.182650:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4ea680/2, rc 0, transno 17179873500 00000100:00100000:0.0:1746065177.182653:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260249600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.182654:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260250624:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065177.182660:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba2a00/2, rc 0, transno 17179873501 00000100:00100000:0.0:1746065177.182662:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260250112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.182717:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182730:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260249728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.182744:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.182754:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260250240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.182754:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881260250496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (564us total) trans 21474840756 rc 0/0 00000100:00100000:0.0:1746065177.182760:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13943 00000100:00100000:1.0:1746065177.182764:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065177.182768:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260249216 00000100:00100000:0.0:1746065177.182770:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260249216 00000004:00080000:1.0:1746065177.182778:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cc380/2, rc 0, transno 21474840754 00000100:00100000:1.0:1746065177.182781:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260248704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.182781:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260249728 00000100:00100000:0.0:1746065177.182782:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260249728 00000100:00100000:0.0:1746065177.182789:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260250240 00000100:00100000:0.0:1746065177.182790:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260250240 00000100:00100000:1.0:1746065177.182795:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13945 00000100:00100000:1.0:1746065177.182800:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260249216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.182800:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13946 00000100:00100000:0.0:1746065177.182804:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260249728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065177.182898:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065177.182900:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065177.182902:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065177.182903:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065177.182905:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065177.182908:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3296:x1830881260249216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (190us total) trans 21474840757 rc 0/0 00000100:00100000:1.0:1746065177.182913:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13945 00000100:00100000:1.0:1746065177.182922:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13947 00000100:00100000:0.0:1746065177.182925:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260249728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (179us total) trans 17179873502 rc 0/0 00000100:00100000:1.0:1746065177.182926:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260250240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.182930:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13946 00000100:00100000:0.0:1746065177.182969:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881260250624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (357us total) trans 21474840755 rc 0/0 00000100:00100000:0.0:1746065177.182974:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13944 00000100:00100000:1.0:1746065177.182992:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260250240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (226us total) trans 17179873503 rc 0/0 00000004:00080000:0.0:1746065177.182992:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fdf80/2, rc 0, transno 21474840755 00000100:00100000:0.0:1746065177.182995:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260250624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.182996:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13947 00000004:00080000:0.0:1746065177.183007:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fe300/2, rc 0, transno 21474840756 00000100:00100000:0.0:1746065177.183009:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260250496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065177.183015:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fe680/2, rc 0, transno 21474840753 00000100:00100000:0.0:1746065177.183017:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260250368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065177.183028:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fea00/2, rc 0, transno 21474840757 00000100:00100000:1.0:1746065177.183031:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260249216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065177.183037:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e8000/2, rc 0, transno 17179873502 00000100:00100000:1.0:1746065177.183040:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260249728:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065177.183045:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1180/2, rc 0, transno 17179873503 00000100:00100000:0.0:1746065177.184366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.185633:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260250240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.191057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.195536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.195575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.195590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.195604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.195615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.195693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.196439:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13952 00000100:00100000:0.0:1746065177.196445:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262771840:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065177.196451:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065177.196456:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13953 00010000:00010000:0.0:1746065177.196459:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b418e800/0x14b4f8542d4fb1a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fa46 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.196463:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262772096:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065177.196470:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746065177.196471:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d719, atime: 0x6812d718, ctime: 0x6812d719, blocks: 0x81d 00010000:00010000:1.0:1746065177.196479:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f11fe00/0x14b4f8542d4fb1a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fa54 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.196479:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.196480:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.196484:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b418e800/0x14b4f8542d4fb1a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa46 expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746065177.196491:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d719, atime: 0x6812d719, ctime: 0x6812d719, blocks: 0x1029 00010000:00010000:0.0:1746065177.196497:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b418e800/0x14b4f8542d4fb1a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa46 expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.196499:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.196501:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.196505:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f11fe00/0x14b4f8542d4fb1a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa54 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.196512:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b418e800, rc 0) 00010000:00010000:1.0:1746065177.196514:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f11fe00/0x14b4f8542d4fb1a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa54 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.196520:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f11fe00, rc 0) 00000100:00100000:1.0:1746065177.197004:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262772096:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 540us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.197010:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13953 00000100:00100000:0.0:1746065177.197120:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262771840:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 675us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.197125:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13952 00000100:00100000:0.0:1746065177.214645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.215952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.216514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.218445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.218474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.218492:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262772608 00000100:00100000:0.0:1746065177.218497:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262772608 00000100:00100000:0.0:1746065177.218528:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262773248 00000100:00100000:0.0:1746065177.218531:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262773248 00000100:00100000:1.0:1746065177.221732:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262773120 00000100:00100000:1.0:1746065177.221742:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262773120 00000100:00100000:1.0:1746065177.221789:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7829 00000100:00100000:1.0:1746065177.221797:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262772608:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065177.221849:0:8434:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.221870:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.221871:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.221875:0:8434:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.221887:0:8434:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.222877:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7831 00000100:00100000:1.0:1746065177.222885:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b62ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881262773120:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065177.222909:0:21485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.222916:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.222917:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.222921:0:21485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.222932:0:21485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065177.227196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.227225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.227245:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.227258:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262774016 00000100:00100000:0.0:1746065177.227265:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262774016 00000100:00100000:0.0:1746065177.227429:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7832 00000100:00100000:0.0:1746065177.227437:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b62f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1960:x1830881262773632:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065177.227467:0:21487:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.227489:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.227492:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.227496:0:21487:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.227506:0:21487:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.249224:0:8434:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.249239:0:8434:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.249246:0:8434:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.249253:0:8434:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f11f400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065177.249256:0:8434:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.249262:0:8434:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.249278:0:8434:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.249287:0:8434:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.249371:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881262772608:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 27571us (32853us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065177.249380:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7829 00010000:00010000:1.0:1746065177.261320:0:21485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.261336:0:21485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.261343:0:21485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.261349:0:21485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f200400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065177.261353:0:21485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.261360:0:21485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.261376:0:21485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.261382:0:21485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f200400/0x14b4f8542d4fb1d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.261468:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b62ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262773120:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 38580us (42989us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065177.261477:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7831 00010000:00010000:0.0:1746065177.268705:0:21487:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.268720:0:21487:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.268728:0:21487:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.268733:0:21487:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bd56a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065177.268737:0:21487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.268744:0:21487:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.268759:0:21487:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.268764:0:21487:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd56a00/0x14b4f8542d4fb1d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065177.268871:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b62f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262773632:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 41431us (41680us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065177.268881:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7832 00000100:00100000:0.0:1746065177.283984:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.288376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.288933:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262774528 00000100:00100000:1.0:1746065177.288941:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262774528 00000100:00100000:1.0:1746065177.288981:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13955 00000100:00100000:1.0:1746065177.288988:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b62e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31407:x1830881262774528:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065177.289002:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.289016:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fa5b expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.289038:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133003a00/0x14b4f8542d4fb18c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa31 expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.289045:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.289047:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.289050:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.289074:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133003a00/0x14b4f8542d4fb18c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa31 expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.289083:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133003a00/0x14b4f8542d4fb18c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa31 expref: 10 pid: 25185 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.289093:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260250752:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.289167:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.291504:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260250752:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065177.291529:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.291541:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f11f400, rc 0) 00000100:00100000:0.0:1746065177.291579:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b62e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31407:x1830881262774528:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2592us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.291587:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13955 00000100:00100000:0.0:1746065177.292022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.292464:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262774656 00000100:00100000:1.0:1746065177.292470:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262774656 00010000:00010000:1.0:1746065177.292490:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133003a00/0x14b4f8542d4fb18c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa31 expref: 10 pid: 25185 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.292888:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7076 00000100:00100000:1.0:1746065177.292895:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262774656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.292907:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.292926:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133003a00/0x14b4f8542d4fb18c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa31 expref: 10 pid: 25185 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.292936:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133003a00/0x14b4f8542d4fb18c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa31 expref: 10 pid: 25185 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.292954:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133003a00/0x14b4f8542d4fb18c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa31 expref: 10 pid: 25185 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.292976:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.292978:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.292984:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.292992:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.293017:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.293027:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260250880:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.293078:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.295125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.295628:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260250880:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.295645:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.295676:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262774656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2781us (3654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.295684:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7076 00000100:00100000:0.0:1746065177.298984:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.299297:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262774912 00000100:00100000:1.0:1746065177.299303:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262774912 00010000:00010000:1.0:1746065177.299324:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29e000/0x14b4f8542d4fb193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa38 expref: 10 pid: 8428 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.299354:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7077 00000100:00100000:1.0:1746065177.299361:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262774912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.299372:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.299391:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c29e000/0x14b4f8542d4fb193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa38 expref: 10 pid: 8428 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.299401:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c29e000/0x14b4f8542d4fb193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa38 expref: 10 pid: 8428 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.299419:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c29e000/0x14b4f8542d4fb193 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa38 expref: 10 pid: 8428 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.299444:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.299446:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.299452:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f222600/0x14b4f8542d4fb1fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa62 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.299459:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f222600/0x14b4f8542d4fb1fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa62 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.299484:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f222600/0x14b4f8542d4fb1fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa62 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.299494:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260251136:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.299548:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.301409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.302094:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260251136:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.302108:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.302577:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262774912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3215us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.302584:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7077 00000100:00100000:0.0:1746065177.304046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.304371:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262775168 00000100:00100000:1.0:1746065177.304376:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262775168 00010000:00010000:1.0:1746065177.304395:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb19a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa3f expref: 10 pid: 8428 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.304722:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7078 00000100:00100000:1.0:1746065177.304729:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262775168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.304740:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.304758:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb19a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa3f expref: 10 pid: 8428 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.304768:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb19a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa3f expref: 10 pid: 8428 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.304784:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9200/0x14b4f8542d4fb19a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa3f expref: 10 pid: 8428 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.304794:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.304796:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.304801:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.304807:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.305243:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.305254:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260251392:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.305305:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065177.307444:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260251392:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.307461:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.307501:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262775168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2771us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.307510:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7078 00000100:00100000:0.0:1746065177.307687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.311528:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.311799:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262775424 00000100:00100000:1.0:1746065177.311805:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262775424 00010000:00010000:1.0:1746065177.311850:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b418e800/0x14b4f8542d4fb1a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa46 expref: 10 pid: 21998 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.311890:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7079 00000100:00100000:1.0:1746065177.311897:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262775424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.311908:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.311926:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b418e800/0x14b4f8542d4fb1a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa46 expref: 10 pid: 21998 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.311936:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b418e800/0x14b4f8542d4fb1a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa46 expref: 10 pid: 21998 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.311955:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b418e800/0x14b4f8542d4fb1a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa46 expref: 10 pid: 21998 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.311980:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.311981:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.311987:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fb20a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa70 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.311994:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fb20a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa70 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.312019:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fb20a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa70 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.312030:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260251648:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.312083:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.313966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.314117:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260251648:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.314132:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.314163:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262775424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2266us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.314170:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7079 00000100:00100000:0.0:1746065177.317510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.317605:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262775680 00000100:00100000:1.0:1746065177.317612:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262775680 00010000:00010000:1.0:1746065177.317638:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb1af lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa4d expref: 11 pid: 25185 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.318079:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7080 00000100:00100000:1.0:1746065177.318087:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262775680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.318096:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.318112:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb1af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa4d expref: 10 pid: 25185 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.318122:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb1af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa4d expref: 10 pid: 25185 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.318139:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb1af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa4d expref: 10 pid: 25185 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.318155:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.318156:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.318162:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8000/0x14b4f8542d4fb211 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa77 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.318169:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8000/0x14b4f8542d4fb211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa77 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.318190:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8000/0x14b4f8542d4fb211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa77 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.318199:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260251904:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.318239:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.320142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.320225:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260251904:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.320241:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.320276:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262775680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2190us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.320285:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7080 00000100:00100000:0.0:1746065177.323663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.324255:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262775936 00000100:00100000:1.0:1746065177.324261:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262775936 00010000:00010000:1.0:1746065177.324283:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f11fe00/0x14b4f8542d4fb1a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa54 expref: 10 pid: 4545 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746065177.324302:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7081 00000100:00100000:1.0:1746065177.324308:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262775936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.324320:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.324336:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f11fe00/0x14b4f8542d4fb1a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa54 expref: 10 pid: 4545 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.324346:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f11fe00/0x14b4f8542d4fb1a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa54 expref: 10 pid: 4545 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.324364:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f11fe00/0x14b4f8542d4fb1a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa54 expref: 10 pid: 4545 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746065177.324374:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.324375:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.324381:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8600/0x14b4f8542d4fb218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa7e expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.324388:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8600/0x14b4f8542d4fb218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa7e expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.324410:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8600/0x14b4f8542d4fb218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa7e expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.324420:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260252160:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.324465:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.326572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.326595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.326609:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262776192 00000100:00100000:0.0:1746065177.326614:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262776192 00000100:00100000:0.0:1746065177.326632:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262776448 00000100:00100000:0.0:1746065177.326633:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262776448 00000100:00100000:0.0:1746065177.326654:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13961 00000100:00100000:0.0:1746065177.326660:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262776192:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065177.326802:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065177.326805:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.326807:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065175 -> 1746065177 00002000:00010000:0.0:1746065177.326809:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065177 -> 1746065178 00002000:00010000:0.0:1746065177.326811:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065177.326874:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262776192:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 213us (305us total) trans 17179873505 rc 0/0 00000100:00100000:0.0:1746065177.326879:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13961 00000100:00100000:0.0:1746065177.326895:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13962 00000100:00100000:0.0:1746065177.326900:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262776448:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065177.326979:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065177.326982:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.326984:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065176 -> 1746065177 00002000:00010000:0.0:1746065177.326985:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065177 -> 1746065178 00002000:00010000:0.0:1746065177.326987:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065177.327002:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262776448:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 102us (406us total) trans 21474840759 rc 0/0 00000100:00100000:0.0:1746065177.327007:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13962 00000100:00100000:0.0:1746065177.327033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.327045:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262776704 00000100:00100000:0.0:1746065177.327047:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262776704 00000100:00100000:0.0:1746065177.327059:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13963 00000100:00100000:0.0:1746065177.327063:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262776704:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065177.327120:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065177.327122:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.327124:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.327126:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065177 -> 1746065178 00002000:00010000:0.0:1746065177.327127:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746065177.327142:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262776704:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 79us (108us total) trans 17179873506 rc 0/0 00000100:00100000:0.0:1746065177.327147:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13963 00000100:00100000:0.0:1746065177.327183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.327192:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262776064 00000100:00100000:0.0:1746065177.327194:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262776064 00000100:00100000:0.0:1746065177.327205:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13964 00000100:00100000:0.0:1746065177.327209:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262776064:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065177.327269:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065177.327271:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.327272:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065175 -> 1746065177 00002000:00010000:0.0:1746065177.327274:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065177 -> 1746065178 00002000:00010000:0.0:1746065177.327275:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1821 -> 1821 00000100:00100000:0.0:1746065177.327290:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262776064:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 80us (106us total) trans 21474840760 rc 0/0 00000100:00100000:0.0:1746065177.327294:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13964 00000100:00100000:0.0:1746065177.327327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.327336:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262776320 00000100:00100000:0.0:1746065177.327339:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262776320 00000100:00100000:0.0:1746065177.327350:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13965 00000100:00100000:0.0:1746065177.327354:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262776320:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065177.327410:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065177.327412:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.327414:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065174 -> 1746065177 00002000:00010000:0.0:1746065177.327415:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065177 -> 1746065178 00002000:00010000:0.0:1746065177.327417:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065177.327432:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1960:x1830881262776320:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 78us (105us total) trans 17179873507 rc 0/0 00000100:00100000:0.0:1746065177.327436:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13965 00000100:00100000:0.0:1746065177.327481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.327492:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262776576 00000100:00100000:0.0:1746065177.327494:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262776576 00000100:00100000:0.0:1746065177.327507:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 13966 00000100:00100000:0.0:1746065177.327511:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262776576:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:0.0:1746065177.327567:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 4989376 -> 4989376 00002000:00010000:0.0:1746065177.327569:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.327570:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.327572:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065177 -> 1746065178 00002000:00010000:0.0:1746065177.327574:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5729 -> 5729 00000100:00100000:0.0:1746065177.327588:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262776576:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 76us (106us total) trans 21474840761 rc 0/0 00000100:00100000:0.0:1746065177.327592:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 13966 00000100:00100000:1.0:1746065177.327964:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260252160:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.327978:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.327995:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262775936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3688us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.328002:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7081 00000100:00100000:1.0:1746065177.330259:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262776960 00000100:00100000:1.0:1746065177.330266:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262776960 00000100:00100000:1.0:1746065177.330297:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4153 00000100:00100000:1.0:1746065177.330303:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31407:x1830881262776960:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:1.0:1746065177.330347:0:14646:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x30c:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009be8ba00/0x14b4f8542d4fb138 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa1c expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.330383:0:14646:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14646 initiator: MDT0 00010000:00010000:1.0:1746065177.330394:0:14646:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fb177 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa23 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.330400:0:14646:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14646 initiator: MDT0 00010000:00010000:1.0:1746065177.330424:0:14646:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fb177 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa23 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.330433:0:14646:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fb177 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa23 expref: 9 pid: 24350 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.330445:0:14646:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14646:1830881260252288:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.331760:0:14646:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065177.333867:0:14646:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14646:1830881260252288:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065177.333888:0:14646:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14646 initiator: MDT0 00000100:00100000:0.0:1746065177.334369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.334692:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262777088 00000100:00100000:1.0:1746065177.334697:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262777088 00010000:00010000:1.0:1746065177.334725:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fb177 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa23 expref: 10 pid: 24350 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.334758:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7082 00000100:00100000:1.0:1746065177.334765:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262777088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.334775:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.334780:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fb177 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa23 expref: 10 pid: 24350 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.334788:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fb177 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa23 expref: 10 pid: 24350 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.334805:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fb177 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa23 expref: 10 pid: 24350 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.334841:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:1.0:1746065177.334845:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14646 initiator: MDT0 00010000:00010000:1.0:1746065177.334860:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14646 initiator: MDT0 00010000:00010000:1.0:1746065177.334866:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14646 initiator: MDT0 00010000:00010000:1.0:1746065177.335312:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065177.335387:0:14646:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14646 initiator: MDT0 00010000:00010000:0.0:1746065177.335394:0:14646:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14646 initiator: MDT0 00000040:00080000:0.0:1746065177.335922:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2992, 88 off252712 00000004:00080000:0.0:1746065177.335929:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627112903ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.335974:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3029, 88 off256152 00000004:00080000:0.0:1746065177.335977:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776627161799ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.336000:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3030, 88 off256240 00000004:00080000:0.0:1746065177.336003:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776627188078ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.336010:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2993, 88 off252800 00000004:00080000:0.0:1746065177.336013:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627197893ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.336019:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2994, 88 off252888 00000004:00080000:0.0:1746065177.336021:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627205687ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.336027:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3031, 88 off256328 00000004:00080000:0.0:1746065177.336029:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776627214147ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.336035:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3032, 88 off256416 00000004:00080000:0.0:1746065177.336037:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776627222192ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.336043:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3033, 88 off256504 00000004:00080000:0.0:1746065177.336045:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776627230005ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.336052:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2995, 88 off252976 00000004:00080000:0.0:1746065177.336054:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627238475ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.336060:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3034, 88 off256592 00000004:00080000:0.0:1746065177.336062:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776627247114ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.336068:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2996, 88 off253064 00000004:00080000:0.0:1746065177.336070:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627255117ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.336076:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3035, 88 off256680 00000004:00080000:0.0:1746065177.336079:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776627263322ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.336084:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2997, 88 off253152 00000004:00080000:0.0:1746065177.336086:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627270863ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.336091:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2998, 88 off253240 00000004:00080000:0.0:1746065177.336093:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627277825ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.336098:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2999, 88 off253328 00000004:00080000:0.0:1746065177.336100:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627284985ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.336105:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3000, 88 off253416 00000004:00080000:0.0:1746065177.336108:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776627292473ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.336113:0:14646:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3036, 88 off256768 00000004:00080000:0.0:1746065177.336115:0:14646:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776627299408ns, next at 737095943431ns, rc = 0 00000100:00100000:1.0:1746065177.336229:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262777088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1463us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.336238:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7082 00000001:00080000:1.0:1746065177.365108:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943994 is committed 00000004:00080000:1.0:1746065177.365115:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2318 committed 00000004:00080000:1.0:1746065177.365142:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2282 committed 00000004:00080000:1.0:1746065177.365147:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2281 committed 00000004:00080000:1.0:1746065177.365148:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2280 committed 00000004:00080000:1.0:1746065177.365150:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2279 committed 00000004:00080000:1.0:1746065177.365151:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2317 committed 00000004:00080000:1.0:1746065177.365152:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2278 committed 00000004:00080000:1.0:1746065177.365154:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2316 committed 00000004:00080000:1.0:1746065177.365155:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2277 committed 00000004:00080000:1.0:1746065177.365156:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2315 committed 00000004:00080000:1.0:1746065177.365158:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2314 committed 00000004:00080000:1.0:1746065177.365159:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2313 committed 00000004:00080000:1.0:1746065177.365160:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2276 committed 00000004:00080000:1.0:1746065177.365162:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2275 committed 00000004:00080000:1.0:1746065177.365163:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2312 committed 00000004:00080000:1.0:1746065177.365165:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2311 committed 00000004:00080000:1.0:1746065177.365166:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2274 committed 00000100:00100000:0.0:1746065177.365249:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065177.365264:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260252416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.365312:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1746065177.365362:0:14646:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fb12680 reply state ffff880135ba2400 transno 8589943994 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a565a600/0x14b4f8542d4fb21f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14646 initiator: MDT0 00000100:00100000:0.0:1746065177.365371:0:14646:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065177.365378:0:14646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880090d6f000) 00010000:00010000:0.0:1746065177.365381:0:14646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065177.365387:0:14646:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be8ba00/0x14b4f8542d4fb138 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa1c expref: 7 pid: 14645 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746065177.365458:0:14646:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065177.365798:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260252928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.365833:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.365847:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260253440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.365872:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.365888:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065177.365892:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260252800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.365905:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.365918:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260253312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.365938:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260252416 00000100:00100000:1.0:1746065177.365942:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260252416 00000100:00100000:1.0:1746065177.365966:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260252928 00000100:00100000:1.0:1746065177.365967:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260252928 00000100:00100000:1.0:1746065177.365976:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260253440 00000100:00100000:1.0:1746065177.365977:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260253440 00000100:00100000:0.0:1746065177.366028:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31407:x1830881262776960:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 35724us (36054us total) trans 8589943994 rc 0/0 00000100:00100000:0.0:1746065177.366036:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4153 00000100:00100000:1.0:1746065177.366182:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260252800 00000100:00100000:1.0:1746065177.366185:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260252800 00000100:00100000:1.0:1746065177.366199:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260252544 00000100:00100000:1.0:1746065177.366201:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260252544 00000100:00100000:1.0:1746065177.366211:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260253056 00000100:00100000:1.0:1746065177.366212:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260253056 00000100:00100000:1.0:1746065177.366218:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260252672 00000100:00100000:1.0:1746065177.366219:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260252672 00000100:00100000:1.0:1746065177.366225:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260253184 00000100:00100000:1.0:1746065177.366227:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260253184 00000100:00100000:1.0:1746065177.366232:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260253568 00000100:00100000:1.0:1746065177.366233:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260253568 00000100:00100000:1.0:1746065177.366239:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260254080 00000100:00100000:1.0:1746065177.366240:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260254080 00000100:00100000:1.0:1746065177.366247:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13967 00000100:00100000:1.0:1746065177.366252:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881260252416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.366319:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13970 00000100:00100000:1.0:1746065177.366323:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260252800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065177.366394:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 4989376 -> 4989376 00002000:00010000:1.0:1746065177.366396:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:1.0:1746065177.366398:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065177 -> 1746065177 00002000:00010000:1.0:1746065177.366400:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065178 -> 1746065178 00002000:00010000:1.0:1746065177.366401:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5729 -> 5729 00000100:00100000:1.0:1746065177.366416:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260252800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (511us total) trans 21474840763 rc 0/0 00000100:00100000:1.0:1746065177.366421:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13970 00000100:00100000:1.0:1746065177.366428:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13972 00000100:00100000:1.0:1746065177.366432:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881260253056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.366493:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260253056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (538us total) trans 21474840764 rc 0/0 00000100:00100000:1.0:1746065177.366498:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13972 00000100:00100000:1.0:1746065177.366507:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13973 00000100:00100000:1.0:1746065177.366511:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3297:x1830881260252672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065177.366586:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065177.366588:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:1.0:1746065177.366590:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065177 -> 1746065177 00002000:00010000:1.0:1746065177.366592:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065178 -> 1746065178 00002000:00010000:1.0:1746065177.366594:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065177.366607:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3297:x1830881260252672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (624us total) trans 17179873508 rc 0/0 00000100:00100000:1.0:1746065177.366612:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13973 00000100:00100000:1.0:1746065177.366620:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13976 00000100:00100000:1.0:1746065177.366624:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3297:x1830881260254080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.366683:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260254080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (449us total) trans 17179873510 rc 0/0 00000100:00100000:1.0:1746065177.366687:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13976 00000100:00100000:1.0:1746065177.366706:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065177.366730:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd83480/2, rc 0, transno 21474840762 00000100:00100000:1.0:1746065177.366737:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260253440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.366746:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260253952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.366761:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065177.366774:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd82a00/2, rc 0, transno 21474840763 00000100:00100000:1.0:1746065177.366777:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260252800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065177.366782:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd80e00/2, rc 0, transno 21474840767 00000100:00100000:1.0:1746065177.366785:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260252928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.366789:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065177.366793:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260253824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.366805:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.366829:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260254336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.366844:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.366875:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260254336 00000100:00100000:1.0:1746065177.366877:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260254336 00000100:00100000:1.0:1746065177.366887:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13978 00000100:00100000:1.0:1746065177.366891:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881260253952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065177.366948:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065177.366951:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.366952:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.366954:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.366956:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065177.366971:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881260253952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (209us total) trans 17179873511 rc 0/0 00000100:00100000:1.0:1746065177.366976:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13978 00000100:00100000:1.0:1746065177.366983:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13980 00000100:00100000:1.0:1746065177.366987:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881260254336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.367047:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881260254336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (202us total) trans 17179873513 rc 0/0 00000100:00100000:1.0:1746065177.367051:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13980 00000004:00080000:1.0:1746065177.367065:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb11c00/2, rc 0, transno 17179873512 00000100:00100000:1.0:1746065177.367068:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260253824:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065177.367073:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d86a00/2, rc 0, transno 17179873513 00000100:00100000:1.0:1746065177.367076:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260254336:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065177.367081:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb10700/2, rc 0, transno 17179873511 00000100:00100000:1.0:1746065177.367083:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260253952:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065177.367088:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd81500/2, rc 0, transno 21474840768 00000100:00100000:1.0:1746065177.367090:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260253312:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065177.367141:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065177.367144:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:1.0:1746065177.367145:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065177 -> 1746065177 00002000:00010000:1.0:1746065177.367147:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065178 -> 1746065178 00002000:00010000:1.0:1746065177.367148:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1821 -> 1821 00000100:00100000:1.0:1746065177.367162:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3295:x1830881260252416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 911us (1851us total) trans 21474840769 rc 0/0 00000100:00100000:1.0:1746065177.367166:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13967 00000100:00100000:1.0:1746065177.367192:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260254464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.367204:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.367216:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260254464 00000100:00100000:1.0:1746065177.367218:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260254464 00000100:00100000:1.0:1746065177.367227:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13981 00000100:00100000:1.0:1746065177.367230:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881260254464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.367302:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260254464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (97us total) trans 21474840770 rc 0/0 00000100:00100000:1.0:1746065177.367307:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13981 00000004:00080000:1.0:1746065177.367323:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4eb800/2, rc 0, transno 21474840770 00000100:00100000:1.0:1746065177.367326:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260254464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065177.367438:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd83100/2, rc 0, transno 21474840769 00000100:00100000:0.0:1746065177.367442:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260252416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065177.370045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.373465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.395420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.402106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.403057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.405392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.408372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.409968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.415267:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262778880 00000100:00100000:1.0:1746065177.415272:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262778880 00010000:00010000:1.0:1746065177.415294:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 12 pid: 2462 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.415311:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7083 00000100:00100000:1.0:1746065177.415315:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262778880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.415325:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.415341:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 12 pid: 2462 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.415349:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 12 pid: 2462 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.415365:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f11f400/0x14b4f8542d4fb1f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa5b expref: 12 pid: 2462 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.415375:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.415376:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.415382:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f223a00/0x14b4f8542d4fb288 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faa1 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.415393:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f223a00/0x14b4f8542d4fb288 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faa1 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.415400:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.415401:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.415404:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fb28f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faa8 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.415410:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fb28f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faa8 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.415434:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fb28f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faa8 expref: 24 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.415444:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260254976:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.415503:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f223a00/0x14b4f8542d4fb288 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faa1 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.415510:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260255104:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.415527:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.416638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.416957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.417037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.418611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.418677:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260254976:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.418685:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260255104:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.418701:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.418730:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262778880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3414us (3882us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.418738:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7083 00000100:00100000:0.0:1746065177.420136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.422456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065177.422878:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f223000/0x14b4f8542d4fb2ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065177.422885:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f223000/0x14b4f8542d4fb2ab lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14645 initiator: MDT0 00000040:00080000:0.0:1746065177.424034:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3001, 88 off253504 00000004:00080000:0.0:1746065177.424039:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776715223691ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425205:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3037, 88 off256856 00000004:00080000:0.0:1746065177.425211:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776716395472ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.425234:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3038, 88 off256944 00000004:00080000:0.0:1746065177.425238:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776716422601ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.425247:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3002, 88 off253592 00000004:00080000:0.0:1746065177.425250:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776716434431ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425255:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3003, 88 off253680 00000004:00080000:0.0:1746065177.425259:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776716443272ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425265:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3039, 88 off257032 00000004:00080000:0.0:1746065177.425267:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776716451949ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.425274:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3040, 88 off257120 00000004:00080000:0.0:1746065177.425276:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776716460519ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.425281:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3041, 88 off257208 00000004:00080000:0.0:1746065177.425284:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776716468355ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.425290:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3004, 88 off253768 00000004:00080000:0.0:1746065177.425292:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776716476984ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425298:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3042, 88 off257296 00000004:00080000:0.0:1746065177.425300:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776716484852ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.425306:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3005, 88 off253856 00000004:00080000:0.0:1746065177.425308:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776716492599ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425314:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3043, 88 off257384 00000004:00080000:0.0:1746065177.425316:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776716500541ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065177.425352:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3007, 88 off254040 00000004:00080000:0.0:1746065177.425355:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776716540084ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425363:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3008, 88 off254128 00000004:00080000:0.0:1746065177.425366:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776716551099ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425373:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3009, 88 off254216 00000004:00080000:0.0:1746065177.425375:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776716559529ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425380:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3010, 88 off254304 00000004:00080000:0.0:1746065177.425383:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776716567346ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065177.425389:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3044, 88 off257472 00000004:00080000:0.0:1746065177.425391:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776716575949ns, next at 737095943431ns, rc = 0 00000001:00080000:1.0:1746065177.468442:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944000 is committed 00000004:00080000:1.0:1746065177.468450:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2326 committed 00000004:00080000:1.0:1746065177.468455:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2291 committed 00000004:00080000:1.0:1746065177.468460:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2290 committed 00000004:00080000:1.0:1746065177.468461:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2289 committed 00000004:00080000:1.0:1746065177.468463:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2288 committed 00000004:00080000:1.0:1746065177.468464:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2325 committed 00000004:00080000:1.0:1746065177.468466:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2287 committed 00000004:00080000:1.0:1746065177.468467:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2324 committed 00000004:00080000:1.0:1746065177.468468:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2286 committed 00000004:00080000:1.0:1746065177.468470:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2323 committed 00000004:00080000:1.0:1746065177.468471:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2322 committed 00000004:00080000:1.0:1746065177.468472:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2321 committed 00000004:00080000:1.0:1746065177.468474:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2285 committed 00000004:00080000:1.0:1746065177.468475:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2284 committed 00000004:00080000:1.0:1746065177.468477:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2320 committed 00000004:00080000:1.0:1746065177.468478:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2319 committed 00000004:00080000:1.0:1746065177.468479:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2283 committed 00000001:00080000:1.0:1746065177.468486:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943997 is committed 00000001:00080000:1.0:1746065177.468490:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943995 is committed 00000001:00080000:1.0:1746065177.468493:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943999 is committed 00000100:00100000:1.0:1746065177.468608:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260255744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.468652:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.468679:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260256256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.468689:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.468701:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065177.468705:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260255616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.468715:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.468723:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260256128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.468732:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065177.468748:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260255744 00000100:00100000:1.0:1746065177.468753:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260255744 00000100:00100000:1.0:1746065177.468775:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260256256 00000100:00100000:1.0:1746065177.468776:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260256256 00000100:00100000:1.0:1746065177.468783:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260255616 00000100:00100000:1.0:1746065177.468784:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260255616 00000100:00100000:1.0:1746065177.468803:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260256128 00000100:00100000:1.0:1746065177.468805:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260256128 00000100:00100000:1.0:1746065177.468832:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13986 00000100:00100000:1.0:1746065177.468837:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3296:x1830881260255744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065177.468972:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065177.468975:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.468977:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.468978:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.468980:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065177.469002:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260255744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (350us total) trans 21474840771 rc 0/0 00000100:00100000:1.0:1746065177.469008:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13986 00000100:00100000:1.0:1746065177.469020:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13987 00000100:00100000:1.0:1746065177.469024:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3296:x1830881260256256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065177.469081:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260256256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (391us total) trans 21474840772 rc 0/0 00000100:00100000:1.0:1746065177.469085:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13987 00000100:00100000:1.0:1746065177.469093:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13988 00000100:00100000:1.0:1746065177.469098:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3296:x1830881260255616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065177.469152:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 4989376 -> 4989376 00002000:00010000:1.0:1746065177.469154:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:1.0:1746065177.469156:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065177 -> 1746065177 00002000:00010000:1.0:1746065177.469158:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065178 -> 1746065178 00002000:00010000:1.0:1746065177.469159:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5729 -> 5729 00000100:00100000:1.0:1746065177.469172:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260255616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (456us total) trans 21474840773 rc 0/0 00000100:00100000:1.0:1746065177.469176:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13988 00000100:00100000:1.0:1746065177.469183:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13989 00000100:00100000:1.0:1746065177.469186:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3296:x1830881260256128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065177.469235:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065177.469237:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.469239:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.469241:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065177.469242:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065177.469255:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260256128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (521us total) trans 21474840774 rc 0/0 00000100:00100000:1.0:1746065177.469259:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13989 00000004:00080000:1.0:1746065177.469292:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49e680/2, rc 0, transno 21474840773 00000100:00100000:1.0:1746065177.469297:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260255616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065177.469303:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49d500/2, rc 0, transno 21474840774 00000100:00100000:1.0:1746065177.469305:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260256128:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065177.469310:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49f100/2, rc 0, transno 21474840771 00000100:00100000:1.0:1746065177.469312:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260255744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065177.469317:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f49d180/2, rc 0, transno 21474840772 00000100:00100000:1.0:1746065177.469320:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260256256:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746065177.469371:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f223000/0x14b4f8542d4fb2ab lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fab6 expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.469381:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065177.469383:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065177.469387:0:14645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f11ea00/0x14b4f8542d4fb2b9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fabd expref: 248 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.469395:0:14645:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f11ea00/0x14b4f8542d4fb2b9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fabd expref: 248 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.469401:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f11ea00/0x14b4f8542d4fb2b9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fabd expref: 248 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.469408:0:14645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb2c0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fac4 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.469413:0:14645:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb2c0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fac4 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.469418:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fac4 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.469432:0:14645:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fac4 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.469440:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260256512:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.469485:0:14645:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f11ea00/0x14b4f8542d4fb2b9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fabd expref: 248 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.469491:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260256640:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.469503:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.471258:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260256896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.471284:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065177.471313:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260257408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.471327:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065177.471339:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065177.471343:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260257024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.471355:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065177.471365:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260257536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.471376:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065177.471393:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260256896 00000100:00100000:0.0:1746065177.471396:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260256896 00000100:00100000:0.0:1746065177.471412:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260257408 00000100:00100000:0.0:1746065177.471414:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260257408 00000100:00100000:0.0:1746065177.471422:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260257024 00000100:00100000:0.0:1746065177.471424:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260257024 00000100:00100000:0.0:1746065177.471430:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260257536 00000100:00100000:0.0:1746065177.471432:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260257536 00000100:00100000:0.0:1746065177.471440:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13999 00000100:00100000:0.0:1746065177.471444:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260256896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065177.471521:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065177.471524:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.471526:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.471528:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065178 -> 1746065178 00002000:00010000:0.0:1746065177.471529:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746065177.471550:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881260256896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (265us total) trans 17179873520 rc 0/0 00000100:00100000:0.0:1746065177.471555:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13999 00000100:00100000:0.0:1746065177.471570:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14000 00000100:00100000:0.0:1746065177.471575:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260257408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.471645:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881260257408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (316us total) trans 17179873521 rc 0/0 00000100:00100000:0.0:1746065177.471650:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14000 00000100:00100000:0.0:1746065177.471660:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14001 00000100:00100000:0.0:1746065177.471664:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260257024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065177.471724:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065177.471726:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.471728:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065177 -> 1746065177 00002000:00010000:0.0:1746065177.471729:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065178 -> 1746065178 00002000:00010000:0.0:1746065177.471731:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746065177.471747:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881260257024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (391us total) trans 17179873522 rc 0/0 00000100:00100000:0.0:1746065177.471752:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14001 00000100:00100000:0.0:1746065177.471761:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14002 00000100:00100000:0.0:1746065177.471765:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260257536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065177.471864:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881260257536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (485us total) trans 17179873523 rc 0/0 00000100:00100000:0.0:1746065177.471868:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14002 00000004:00080000:0.0:1746065177.471889:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d84a80/2, rc 0, transno 17179873522 00000100:00100000:0.0:1746065177.471893:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260257024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065177.471899:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d86680/2, rc 0, transno 17179873523 00000100:00100000:0.0:1746065177.471901:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260257536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065177.471906:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d87100/2, rc 0, transno 17179873520 00000100:00100000:0.0:1746065177.471908:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260256896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065177.471913:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d84000/2, rc 0, transno 17179873521 00000100:00100000:0.0:1746065177.471915:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260257408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065177.472871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.472900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.474668:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260256512:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065177.474676:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260256640:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065177.474705:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f223e00/0x14b4f8542d4fb2a4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fab6 expref: 9 pid: 14645 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065177.474723:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f223000/0x14b4f8542d4fb2ab lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fab6 expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.474739:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f223000, rc 0) 00000100:00100000:0.0:1746065177.474755:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:31414:x1830881262779392:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 56714us (57719us total) trans 8589944000 rc 0/0 00000100:00100000:0.0:1746065177.474761:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9814 00000100:00100000:0.0:1746065177.478256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.479212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.485118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.485180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.491102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.499277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.507322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.523909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.523947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.523967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.524034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.524074:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262781440 00000100:00100000:0.0:1746065177.524082:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262781440 00000100:00100000:0.0:1746065177.524118:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262781568 00000100:00100000:0.0:1746065177.524120:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262781568 00000100:00100000:0.0:1746065177.524132:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262781696 00000100:00100000:0.0:1746065177.524133:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262781696 00000100:00100000:0.0:1746065177.524144:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14005 00000100:00100000:0.0:1746065177.524151:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31420:x1830881262781440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.524169:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.524184:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fad9 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524210:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f222600/0x14b4f8542d4fb1fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa62 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524216:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065177.524218:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065177.524221:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad9 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524248:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f222600/0x14b4f8542d4fb1fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa62 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524259:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f222600/0x14b4f8542d4fb1fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa62 expref: 11 pid: 2462 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.524271:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260258304:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065177.524340:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.524358:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14006 00000100:00100000:0.0:1746065177.524364:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:31419:x1830881262781568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.524370:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.524376:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fae0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524386:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065177.524389:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524396:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524411:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f362a00, rc 0) 00000100:00100000:0.0:1746065177.524431:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+16:31419:x1830881262781568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 67us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.524436:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14006 00000100:00100000:0.0:1746065177.524452:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14007 00000100:00100000:0.0:1746065177.524457:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31416:x1830881262781696:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065177.524462:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.524469:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f362800/0x14b4f8542d4fb2e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fae7 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524480:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8600/0x14b4f8542d4fb218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa7e expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524485:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065177.524486:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065177.524488:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f362800/0x14b4f8542d4fb2e3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae7 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524501:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8600/0x14b4f8542d4fb218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa7e expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.524507:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8600/0x14b4f8542d4fb218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa7e expref: 11 pid: 2462 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.524514:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260258432:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065177.524533:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.524629:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262781952 00000100:00100000:0.0:1746065177.524632:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262781952 00002000:00100000:0.0:1746065177.524654:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2101247) req@ffff88008fd06680 x1830881262781952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.524662:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06680 with x1830881262781952 ext(2097152->2101247) 00002000:00010000:0.0:1746065177.524666:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd06680 00000100:00100000:0.0:1746065177.524679:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7838 00000100:00100000:0.0:1746065177.524684:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1958:x1830881262781952:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065177.524794:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1958:x1830881262781952:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 109us (759us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065177.524799:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7838 00002000:00100000:0.0:1746065177.524804:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2101247) req@ffff88008fd06680 x1830881262781952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.524811:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06680 with x1830881262781952 ext(2097152->2101247) 00002000:00010000:0.0:1746065177.524841:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd06680 00000100:00100000:0.0:1746065177.529593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.529624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.529651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.529674:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262782464 00000100:00100000:0.0:1746065177.529680:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262782464 00000100:00100000:0.0:1746065177.529714:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4157 00000100:00100000:0.0:1746065177.529720:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:31414:x1830881262782464:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065177.529948:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:31414:x1830881262782464:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 228us (295us total) trans 8589944001 rc 0/0 00000100:00100000:0.0:1746065177.529954:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4157 00000100:00100000:0.0:1746065177.529975:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7090 00000100:00100000:0.0:1746065177.529980:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1960:x1830881262782208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065177.529985:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065177.529995:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f222600/0x14b4f8542d4fb1fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa62 expref: 13 pid: 2462 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.530004:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f222600/0x14b4f8542d4fb1fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa62 expref: 13 pid: 2462 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746065177.530013:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.530014:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.530017:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad9 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.530023:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad9 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.530195:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8600/0x14b4f8542d4fb218 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa7e expref: 12 pid: 2462 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.530214:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260258432:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065177.530227:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f362800/0x14b4f8542d4fb2e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae7 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.530235:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f362800, rc 0) 00000100:00100000:1.0:1746065177.530254:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:31416:x1830881262781696:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5796us (6285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.530265:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14007 00010000:00010000:0.0:1746065177.530803:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.530805:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.530810:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 15 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.530906:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 15 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.531024:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 15 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065177.531033:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260258688:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065177.531136:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad9 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065177.531144:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260258816:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065177.531160:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.538443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.538469:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262782720 00000100:00100000:0.0:1746065177.538476:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262782720 00002000:00100000:0.0:1746065177.538510:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2744320->2748415) req@ffff88009f46aa00 x1830881262782720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.538519:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46aa00 with x1830881262782720 ext(2744320->2748415) 00002000:00010000:0.0:1746065177.538522:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46aa00 00000100:00100000:0.0:1746065177.538539:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7839 00000100:00100000:0.0:1746065177.538546:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881262782720:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065177.538678:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260258688:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.538692:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260258816:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.538702:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.538738:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262782208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8756us (9112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.538744:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7090 00000100:00100000:0.0:1746065177.541217:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881262782720:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 2664us (2775us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065177.541226:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7839 00002000:00100000:0.0:1746065177.541234:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2744320->2748415) req@ffff88009f46aa00 x1830881262782720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.541241:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46aa00 with x1830881262782720 ext(2744320->2748415) 00002000:00010000:0.0:1746065177.541246:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46aa00 00000100:00100000:1.0:1746065177.541359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.541418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.541432:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262782976 00000100:00100000:1.0:1746065177.541437:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262782976 00002000:00100000:1.0:1746065177.541459:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008fc59c00 x1830881262782976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.541466:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59c00 with x1830881262782976 ext(1048576->2097151) 00002000:00010000:1.0:1746065177.541469:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc59c00 00000100:00100000:1.0:1746065177.541478:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262783232 00000100:00100000:1.0:1746065177.541479:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262783232 00002000:00100000:1.0:1746065177.541486:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008fc58a80 x1830881262783232/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.541492:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58a80 with x1830881262783232 ext(1048576->2097151) 00002000:00010000:1.0:1746065177.541494:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc58a80 00000100:00100000:1.0:1746065177.541502:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7840 00000100:00100000:1.0:1746065177.541507:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881262782976:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065177.545589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.565465:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262783488 00000100:00100000:1.0:1746065177.565471:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262783488 00002000:00100000:1.0:1746065177.565499:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2101247) req@ffff880135cdc380 x1830881262783488/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 4584/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.565507:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc380 with x1830881262783488 ext(2097152->2101247) 00010000:00010000:1.0:1746065177.565513:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8e00/0x14b4f8542d4fb2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad2 expref: 19 pid: 21998 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.565524:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8e00/0x14b4f8542d4fb2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad2 expref: 19 pid: 21998 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746065177.565535:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cdc380 00000100:00100000:1.0:1746065177.565548:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2399 00000100:00100000:1.0:1746065177.565554:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262783488:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065177.567273:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262783488:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 1718us (2625us total) trans 21474840780 rc 0/0 00000100:00100000:1.0:1746065177.567279:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2399 00002000:00100000:1.0:1746065177.567284:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2101247) req@ffff880135cdc380 x1830881262783488/t21474840780(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 4584/448 e 0 to 0 dl 1746065188 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.567290:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc380 with x1830881262783488 ext(2097152->2101247) 00010000:00010000:1.0:1746065177.567296:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8e00/0x14b4f8542d4fb2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad2 expref: 21 pid: 21998 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.567307:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8e00/0x14b4f8542d4fb2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad2 expref: 21 pid: 21998 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746065177.567312:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cdc380 00000100:00100000:0.0:1746065177.579482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.579687:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262783616 00000100:00100000:1.0:1746065177.579695:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262783616 00010000:00010000:1.0:1746065177.580061:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8e00/0x14b4f8542d4fb2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad2 expref: 21 pid: 21998 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.580176:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7091 00000100:00100000:1.0:1746065177.580185:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262783616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.580199:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065177.580213:0:8444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065177 -> 1746065178 00010000:00010000:1.0:1746065177.580219:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8e00/0x14b4f8542d4fb2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad2 expref: 21 pid: 21998 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.580229:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8e00/0x14b4f8542d4fb2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad2 expref: 21 pid: 21998 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.580274:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d8e00/0x14b4f8542d4fb2ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2101247) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad2 expref: 21 pid: 21998 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.580296:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.580298:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.580304:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb2ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faee expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.580312:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb2ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faee expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.580336:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb2ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faee expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.580346:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260259072:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.580403:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.582658:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262783744 00000100:00100000:0.0:1746065177.582666:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262783744 00000100:00100000:0.0:1746065177.582724:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14009 00000100:00100000:0.0:1746065177.582731:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31420:x1830881262783744:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.582745:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.582759:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5036600/0x14b4f8542d4fb2f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5faf5 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.582778:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.582785:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065177.582786:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065177.582790:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5036600/0x14b4f8542d4fb2f1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faf5 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.582859:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.582870:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 9 pid: 2462 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.582880:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260259200:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065177.582943:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065177.584590:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260259072:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.584611:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.585594:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262783616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5408us (6118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.585604:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7091 00000100:00100000:0.0:1746065177.587676:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.588620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.588859:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262784000 00000100:00100000:1.0:1746065177.588863:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262784000 00010000:00010000:1.0:1746065177.588880:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 10 pid: 2462 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746065177.588906:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7092 00000100:00100000:1.0:1746065177.588911:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262784000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.588918:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.588934:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 10 pid: 2462 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.588943:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 10 pid: 2462 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.588958:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f222800/0x14b4f8542d4fb203 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fa69 expref: 10 pid: 2462 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.588971:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.588972:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.588977:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5036600/0x14b4f8542d4fb2f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faf5 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.588984:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5036600/0x14b4f8542d4fb2f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faf5 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.588995:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.588997:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.588999:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4fb2f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fafc expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.589005:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4fb2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fafc expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.589024:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4fb2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fafc expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.589034:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260259328:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.589085:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5036600/0x14b4f8542d4fb2f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faf5 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.589092:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260259456:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.589108:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.589381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.593645:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260259328:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.593657:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260259456:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.593677:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.593712:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262784000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4800us (5091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.593722:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7092 00000100:00100000:0.0:1746065177.596304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.596411:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262784512 00000100:00100000:1.0:1746065177.596419:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262784512 00002000:00100000:1.0:1746065177.596451:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8800a0084000 x1830881262784512/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.596460:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084000 with x1830881262784512 ext(1048576->2097151) 00002000:00010000:1.0:1746065177.596465:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084000 00000100:00100000:1.0:1746065177.596531:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7843 00000100:00100000:1.0:1746065177.596537:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262784512:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065177.605527:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7845 00000100:00100000:1.0:1746065177.605540:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881262785024:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065177.618082:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881262784512:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 21537us (21776us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065177.618092:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7843 00002000:00100000:1.0:1746065177.618102:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8800a0084000 x1830881262784512/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.618109:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084000 with x1830881262784512 ext(1048576->2097151) 00002000:00010000:1.0:1746065177.618114:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084000 00000100:00100000:1.0:1746065177.631014:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881262785024:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 25467us (26509us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065177.631025:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7845 00000100:00100000:0.0:1746065177.631403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.631467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.631496:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262785152 00000100:00100000:0.0:1746065177.631502:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262785152 00000100:00100000:0.0:1746065177.631529:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262785280 00000100:00100000:0.0:1746065177.631531:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262785280 00000100:00100000:0.0:1746065177.631551:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14011 00000100:00100000:0.0:1746065177.631557:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1958:x1830881262785152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.631571:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.631586:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6eb1a00/0x14b4f8542d4fb2ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb03 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065177.631629:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260259584:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065177.631692:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.631742:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14012 00000100:00100000:0.0:1746065177.631748:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881262785280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.631755:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.631763:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6eb0800/0x14b4f8542d4fb306 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb0a expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065177.631785:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260259712:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065177.631808:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c840 going to sleep for 11 seconds 00002000:00100000:1.0:1746065177.633448:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009f2c4700 x1830881262785024/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.633458:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4700 with x1830881262785024 ext(1048576->2097151) 00002000:00010000:1.0:1746065177.633475:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c4700 00002000:00010000:1.0:1746065177.634669:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime: 1746065177 -> 1746065178 00002000:00010000:1.0:1746065177.634672:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065177 -> 1746065178 00000100:00100000:1.0:1746065177.634683:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260259712:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065177.634698:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6eb0800/0x14b4f8542d4fb306 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb0a expref: 18 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.634707:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6eb0800/0x14b4f8542d4fb306 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb0a expref: 18 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.634718:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6eb0800, rc 0) 00000100:00100000:1.0:1746065177.634736:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881262785280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2989us (3269us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065177.634741:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14012 00000100:00100000:0.0:1746065177.636508:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.636594:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262785408 00000100:00100000:1.0:1746065177.636600:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262785408 00000100:00100000:0.0:1746065177.637673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.640265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.641725:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262785664 00000100:00100000:1.0:1746065177.641731:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262785664 00002000:00100000:1.0:1746065177.641763:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3485695) req@ffff8800a0086300 x1830881262785664/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.641771:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086300 with x1830881262785664 ext(3145728->3485695) 00010000:00010000:1.0:1746065177.641777:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb2ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faee expref: 28 pid: 8428 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746065177.641785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065177.641786:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb2ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faee expref: 28 pid: 8428 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746065177.641792:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0086300 00000100:00100000:1.0:1746065177.641937:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2400 00000100:00100000:1.0:1746065177.641944:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881262785664:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065177.656363:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262785664:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 14419us (16099us total) trans 21474840781 rc 0/0 00000100:00100000:1.0:1746065177.656369:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2400 00002000:00100000:1.0:1746065177.656374:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3485695) req@ffff8800a0086300 x1830881262785664/t21474840781(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/448 e 0 to 0 dl 1746065188 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.656380:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086300 with x1830881262785664 ext(3145728->3485695) 00010000:00010000:1.0:1746065177.656386:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb2ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faee expref: 29 pid: 8428 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746065177.656394:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb2ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faee expref: 29 pid: 8428 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746065177.656399:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0086300 00000100:00100000:0.0:1746065177.659678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.661428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.667374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.671171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.671637:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262786560 00000100:00100000:1.0:1746065177.671645:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262786560 00002000:00100000:1.0:1746065177.671685:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800900c0380 x1830881262786560/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.671693:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0380 with x1830881262786560 ext(1048576->2097151) 00002000:00010000:1.0:1746065177.672344:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c0380 00000100:00100000:1.0:1746065177.672393:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7846 00000100:00100000:1.0:1746065177.672403:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881262786560:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065177.676526:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.689713:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881262786560:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 17305us (18543us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065177.689723:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7846 00002000:00100000:1.0:1746065177.689733:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800900c0380 x1830881262786560/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.689741:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0380 with x1830881262786560 ext(1048576->2097151) 00002000:00010000:1.0:1746065177.689746:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c0380 00000100:00100000:0.0:1746065177.696740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.697126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.701913:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.703999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.704071:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262787456 00000100:00100000:1.0:1746065177.704077:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262787456 00002000:00100000:1.0:1746065177.704102:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff8800900c1f80 x1830881262787456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.704110:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1f80 with x1830881262787456 ext(2097152->3145727) 00002000:00010000:1.0:1746065177.704114:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c1f80 00000100:00100000:1.0:1746065177.704141:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7848 00000100:00100000:1.0:1746065177.704147:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881262787456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065177.710696:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262787712 00000100:00100000:0.0:1746065177.710703:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262787712 00000100:00100000:0.0:1746065177.710745:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9818 00000100:00100000:0.0:1746065177.710751:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31426:x1830881262787712:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065177.710766:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.710779:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb0400/0x14b4f8542d4fb34c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb34 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.710912:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.710926:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.710939:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.710952:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.710958:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.710963:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711070:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135496200/0x14b4f8542d4fb361 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711080:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135496200/0x14b4f8542d4fb361 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711086:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135496200/0x14b4f8542d4fb361 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065177.711096:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065177.711167:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711178:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711184:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711189:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6eb1c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065177.711192:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711198:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711208:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065177.711211:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065177.711215:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711220:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1c00/0x14b4f8542d4fb353 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711251:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711257:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711261:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711265:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6eb1e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065177.711268:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711275:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711282:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f500) 00010000:00010000:0.0:1746065177.711284:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065177.711286:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711290:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb1e00/0x14b4f8542d4fb35a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065177.711331:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6eb0400/0x14b4f8542d4fb34c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb34 expref: 252 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.711343:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135496200/0x14b4f8542d4fb361 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb34 expref: 251 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.711349:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065177.711350:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065177.711353:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135496200, rc 0) 00000100:00100000:0.0:1746065177.711382:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31426:x1830881262787712:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 629us (715us total) trans 8589944003 rc 0/0 00000100:00100000:0.0:1746065177.711388:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9818 00000100:00100000:1.0:1746065177.717252:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881262787456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13096us (13248us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065177.717262:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7848 00002000:00100000:1.0:1746065177.717271:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff8800900c1f80 x1830881262787456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.717279:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1f80 with x1830881262787456 ext(2097152->3145727) 00002000:00010000:1.0:1746065177.717284:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c1f80 00000100:00100000:0.0:1746065177.718189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.718226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.722550:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262788224 00000100:00100000:0.0:1746065177.722555:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262788224 00000100:00100000:0.0:1746065177.722592:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262788352 00000100:00100000:0.0:1746065177.722594:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262788352 00000100:00100000:1.0:1746065177.722624:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14017 00000100:00100000:1.0:1746065177.722632:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:31426:x1830881262788224:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065177.722648:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.722662:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eeb2e00/0x14b4f8542d4fb36f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb3b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.722690:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133002200/0x14b4f8542d4fb314 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb18 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.722696:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.722698:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.722701:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eeb2e00/0x14b4f8542d4fb36f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1085440->1105919] (req 1085440->1105919) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb3b expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.722722:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133002200/0x14b4f8542d4fb314 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb18 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.722732:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133002200/0x14b4f8542d4fb314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb18 expref: 30 pid: 25185 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065177.722741:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260260608:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.722788:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.722937:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14018 00000100:00100000:0.0:1746065177.722943:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31420:x1830881262788352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.722949:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.722957:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb42 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.722967:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.722968:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.722974:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.722984:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.722991:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135496a00, rc 0) 00000100:00100000:0.0:1746065177.723009:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31420:x1830881262788352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 68us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.723014:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14018 00000100:00100000:1.0:1746065177.725218:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260260608:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065177.725236:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eeb2e00/0x14b4f8542d4fb36f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1085440->1105919] (req 1085440->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb3b expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.725246:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eeb2e00, rc 0) 00000100:00100000:1.0:1746065177.725283:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31426:x1830881262788224:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2651us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.725289:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14017 00000100:00100000:0.0:1746065177.728227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.728260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.728284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.728323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.728829:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7850 00000100:00100000:1.0:1746065177.728836:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262788992:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065177.729840:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7851 00000100:00100000:1.0:1746065177.729859:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881262789248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065177.733917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.733950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.733971:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262789504 00000100:00100000:0.0:1746065177.733979:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262789504 00002000:00100000:0.0:1746065177.734020:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012b45f100 x1830881262789504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.734038:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f100 with x1830881262789504 ext(2097152->3145727) 00002000:00010000:0.0:1746065177.734045:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45f100 00000100:00100000:0.0:1746065177.734069:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262789760 00000100:00100000:0.0:1746065177.734071:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262789760 00002000:00100000:0.0:1746065177.734084:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45ea00 x1830881262789760/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.734093:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881262789760 ext(3145728->4194303) 00002000:00010000:0.0:1746065177.734096:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:0.0:1746065177.734112:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7852 00000100:00100000:0.0:1746065177.734122:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881262789504:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065177.735150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.738187:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262790272 00000100:00100000:0.0:1746065177.738194:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262790272 00002000:00100000:0.0:1746065177.738223:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1101824->1105919) req@ffff88009bee3800 x1830881262790272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.738232:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3800 with x1830881262790272 ext(1101824->1105919) 00002000:00010000:0.0:1746065177.738236:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee3800 00000100:00100000:0.0:1746065177.738250:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7855 00000100:00100000:0.0:1746065177.738256:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881262790272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065177.738352:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881262790272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 95us (429us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065177.738357:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7855 00002000:00100000:0.0:1746065177.738362:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1101824->1105919) req@ffff88009bee3800 x1830881262790272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.738368:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3800 with x1830881262790272 ext(1101824->1105919) 00002000:00010000:0.0:1746065177.738371:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee3800 00000100:00100000:1.0:1746065177.742337:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262788992:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13491us (14041us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065177.742349:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7850 00002000:00100000:1.0:1746065177.742363:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45e300 x1830881262788992/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.742373:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e300 with x1830881262788992 ext(3145728->4194303) 00002000:00010000:1.0:1746065177.742378:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45e300 00000100:00100000:0.0:1746065177.745325:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881262789248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15470us (16993us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065177.745337:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7851 00002000:00100000:0.0:1746065177.745347:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012b45d880 x1830881262789248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.745355:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881262789248 ext(3145728->4194303) 00002000:00010000:0.0:1746065177.745359:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45d880 00000100:00100000:0.0:1746065177.752913:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.753512:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262790400 00000100:00100000:1.0:1746065177.753520:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262790400 00000100:00100000:1.0:1746065177.754070:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14019 00000100:00100000:1.0:1746065177.754078:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:31424:x1830881262790400:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065177.754094:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.754109:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3200/0x14b4f8542d4fb37d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb49 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.754136:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133002400/0x14b4f8542d4fb30d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb11 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.754143:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb33e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb26 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.754150:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.754151:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.754154:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3200/0x14b4f8542d4fb37d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb49 expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.754178:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb33e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb26 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.754189:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb33e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb26 expref: 30 pid: 25185 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065177.754199:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260260864:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065177.755470:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133002400/0x14b4f8542d4fb30d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb11 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.755480:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133002400/0x14b4f8542d4fb30d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb11 expref: 23 pid: 21998 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065177.755489:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260260992:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.755521:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065177.757002:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262789504:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 22879us (23091us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065177.757010:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7852 00002000:00100000:1.0:1746065177.757019:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012b45f100 x1830881262789504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.757033:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f100 with x1830881262789504 ext(2097152->3145727) 00002000:00010000:1.0:1746065177.757037:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45f100 00000100:00100000:0.0:1746065177.764417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.771682:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260260864:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.771692:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260260992:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065177.771714:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3200/0x14b4f8542d4fb37d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb49 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.771728:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eeb3200, rc 0) 00000100:00100000:1.0:1746065177.771768:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:31424:x1830881262790400:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 17691us (18862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.771774:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14019 00000100:00100000:0.0:1746065177.773181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.775621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.775684:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.780063:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262791040 00000100:00100000:0.0:1746065177.780070:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262791040 00010000:00010000:0.0:1746065177.780140:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb33e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb26 expref: 30 pid: 25185 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746065177.780171:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7098 00000100:00100000:0.0:1746065177.780177:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262791040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065177.780188:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065177.780207:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb33e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb26 expref: 30 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065177.780221:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb33e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb26 expref: 30 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065177.780240:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133003400/0x14b4f8542d4fb33e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb26 expref: 30 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065177.780267:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.780268:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.780274:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3200/0x14b4f8542d4fb37d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb49 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.780281:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3200/0x14b4f8542d4fb37d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb49 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.780307:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3200/0x14b4f8542d4fb37d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb49 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.780317:0:15963:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3200/0x14b4f8542d4fb37d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb49 expref: 22 pid: 8428 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746065177.780326:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260261376:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065177.780392:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.787285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.787519:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260261376:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.787538:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.787984:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262791040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7805us (8275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.788176:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7098 00000100:00100000:0.0:1746065177.788300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.788364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.788394:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262791424 00000100:00100000:1.0:1746065177.788397:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262791424 00000100:00100000:1.0:1746065177.788604:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14023 00000100:00100000:1.0:1746065177.788611:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+18:31424:x1830881262791424:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065177.788622:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.788635:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3600/0x14b4f8542d4fb399 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb65 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.788886:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133003c00/0x14b4f8542d4fb345 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb2d expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.789347:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.789353:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.789355:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.789358:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3600/0x14b4f8542d4fb399 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->3334143] (req 3145728->3334143) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb65 expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.789381:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.789390:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 30 pid: 25185 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065177.789400:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260261504:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065177.789883:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133003c00/0x14b4f8542d4fb345 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb2d expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.789891:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133003c00/0x14b4f8542d4fb345 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb2d expref: 19 pid: 25185 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065177.789899:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260261632:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.789919:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065177.792777:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260261504:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.794807:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260261632:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065177.794871:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3600/0x14b4f8542d4fb399 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->3334143] (req 3145728->3334143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb65 expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.794888:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eeb3600, rc 0) 00000100:00100000:1.0:1746065177.794934:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:31424:x1830881262791424:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6323us (6633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.794941:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14023 00000100:00100000:0.0:1746065177.795870:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.795985:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262791808 00000100:00100000:1.0:1746065177.795991:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262791808 00010000:00010000:1.0:1746065177.796018:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 31 pid: 25185 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065177.796041:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7099 00000100:00100000:1.0:1746065177.796094:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262791808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.796106:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.796126:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 31 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065177.796135:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 31 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065177.796154:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135496a00/0x14b4f8542d4fb376 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb42 expref: 31 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065177.796168:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.796191:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262791808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 144us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.796196:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7099 00000100:00100000:0.0:1746065177.800071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.801554:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262791936 00000100:00100000:1.0:1746065177.801564:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262791936 00010000:00010000:1.0:1746065177.801598:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133003c00/0x14b4f8542d4fb345 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb2d expref: 19 pid: 25185 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065177.801644:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7100 00000100:00100000:1.0:1746065177.801651:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881262791936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065177.801664:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065177.801683:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133003c00/0x14b4f8542d4fb345 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb2d expref: 19 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065177.801693:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133003c00/0x14b4f8542d4fb345 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb2d expref: 19 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065177.801711:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133003c00/0x14b4f8542d4fb345 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb2d expref: 19 pid: 25185 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065177.801742:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.801744:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065177.801750:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3600/0x14b4f8542d4fb399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb65 expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.801761:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3600/0x14b4f8542d4fb399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb65 expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.801788:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3600/0x14b4f8542d4fb399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb65 expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065177.801798:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260261760:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065177.801909:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.802364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.802409:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262792064 00000100:00100000:1.0:1746065177.802413:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262792064 00000100:00100000:0.0:1746065177.802418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.802429:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.802671:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262792320 00000100:00100000:1.0:1746065177.802674:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262792320 00000100:00100000:0.0:1746065177.803173:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14026 00000100:00100000:0.0:1746065177.803180:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881262792192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.803187:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.803194:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135496e00/0x14b4f8542d4fb3ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb73 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.803203:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.803204:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.803208:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135496e00/0x14b4f8542d4fb3ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb73 expref: 28 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.803219:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135496e00/0x14b4f8542d4fb3ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb73 expref: 28 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.803227:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135496e00, rc 0) 00000100:00100000:0.0:1746065177.803245:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881262792192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 67us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.803250:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14026 00000100:00100000:1.0:1746065177.806220:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260261760:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065177.806236:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065177.806278:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262791936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4626us (6209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065177.806287:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7100 00000100:00100000:0.0:1746065177.808618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.808689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.809567:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7857 00000100:00100000:1.0:1746065177.809577:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7858 00000100:00100000:1.0:1746065177.809587:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262792960:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065177.810629:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881262792704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065177.814048:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881262792704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 4458us (5420us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065177.814058:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7857 00002000:00100000:1.0:1746065177.814068:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3330048->3334143) req@ffff88009c7ac380 x1830881262792704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.814078:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac380 with x1830881262792704 ext(3330048->3334143) 00002000:00010000:1.0:1746065177.814083:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac380 00000100:00100000:0.0:1746065177.815915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.818169:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262792960:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8586us (9478us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065177.818181:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7858 00002000:00100000:0.0:1746065177.818188:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009c7aed80 x1830881262792960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:93/0 lens 488/440 e 0 to 0 dl 1746065188 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065177.818196:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aed80 with x1830881262792960 ext(3145728->4194303) 00002000:00010000:0.0:1746065177.818199:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7aed80 00000100:00100000:1.0:1746065177.818408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.819039:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262793344 00000100:00100000:0.0:1746065177.819045:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262793344 00000100:00100000:0.0:1746065177.819532:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4159 00000100:00100000:0.0:1746065177.819540:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:31424:x1830881262793344:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065177.819801:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:31424:x1830881262793344:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 261us (1392us total) trans 8589944005 rc 0/0 00000100:00100000:0.0:1746065177.819808:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4159 00000100:00100000:0.0:1746065177.827492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.829498:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.829568:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262793728 00000100:00100000:1.0:1746065177.829572:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262793728 00000100:00100000:1.0:1746065177.829602:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4160 00000100:00100000:1.0:1746065177.829608:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:31419:x1830881262793728:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065177.829747:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:31419:x1830881262793728:12345-192.168.202.46@tcp:35:cat.0 Request processed in 139us (249us total) trans 8589944006 rc 0/0 00000100:00100000:1.0:1746065177.829753:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4160 00000100:00100000:0.0:1746065177.832779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.832935:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262793856 00000100:00100000:1.0:1746065177.832941:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262793856 00002000:00100000:1.0:1746065177.832977:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3334143) req@ffff880094d95c00 x1830881262793856/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:93/0 lens 488/0 e 0 to 0 dl 1746065188 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065177.832985:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95c00 with x1830881262793856 ext(3145728->3334143) 00010000:00010000:1.0:1746065177.832991:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3600/0x14b4f8542d4fb399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb65 expref: 18 pid: 8428 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065177.833001:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3600/0x14b4f8542d4fb399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb65 expref: 18 pid: 8428 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746065177.833006:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d95c00 00000100:00100000:1.0:1746065177.833021:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2404 00000100:00100000:1.0:1746065177.833027:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881262793856:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065177.841933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.849293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.873950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.893911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.979140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.979476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.980006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065177.980705:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262795264 00000100:00100000:0.0:1746065177.980708:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262795264 00000100:00100000:0.0:1746065177.980723:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262795392 00000100:00100000:0.0:1746065177.980725:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262795392 00000100:00100000:0.0:1746065177.980735:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14029 00000100:00100000:0.0:1746065177.980738:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881262795264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.980748:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.980757:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135496400/0x14b4f8542d4fb3e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb96 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065177.980793:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260262656:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065177.980867:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065177.980882:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14030 00000100:00100000:0.0:1746065177.980886:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881262795392:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065177.980892:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065177.980899:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fb9d expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065177.980908:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.980909:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065177.980916:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb9d expref: 20 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.980926:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb9d expref: 20 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065177.980933:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135497e00, rc 0) 00000100:00100000:0.0:1746065177.980949:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262795392:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065177.980953:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14030 00000100:00100000:1.0:1746065177.986694:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260262656:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065177.986723:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135496400/0x14b4f8542d4fb3e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb96 expref: 26 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.986735:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135496400/0x14b4f8542d4fb3e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb96 expref: 26 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065177.986750:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135496400, rc 0) 00000100:00100000:1.0:1746065177.986796:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881262795264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6056us (7319us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065177.986803:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14029 00000100:00100000:0.0:1746065177.996988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065177.997069:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262795520 00000100:00100000:1.0:1746065177.997078:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262795520 00000100:00100000:1.0:1746065177.997122:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14031 00000100:00100000:1.0:1746065177.997130:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+25:31433:x1830881262795520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065177.997145:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065177.997159:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3c00/0x14b4f8542d4fb3f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fba4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.997183:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eeb2e00/0x14b4f8542d4fb36f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb3b expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.997190:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065177.997191:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065177.997195:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3c00/0x14b4f8542d4fb3f4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fba4 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.997224:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eeb2e00/0x14b4f8542d4fb36f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1105919) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb3b expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065177.997235:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eeb2e00/0x14b4f8542d4fb36f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1105919) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb3b expref: 28 pid: 8428 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065177.997246:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260262784:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065177.997309:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.014025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.015205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065178.015557:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065178.020071:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260262784:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.020096:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3c00/0x14b4f8542d4fb3f4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fba4 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.020110:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eeb3c00, rc 0) 00000100:00100000:1.0:1746065178.021560:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+26:31433:x1830881262795520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 24425us (24573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.021569:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14031 00000100:00100000:0.0:1746065178.026585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.031411:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262796160 00000100:00100000:0.0:1746065178.031422:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262796160 00000100:00100000:0.0:1746065178.031464:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4162 00000100:00100000:0.0:1746065178.031471:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:31435:x1830881262796160:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065178.031651:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31435:x1830881262796160:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 180us (5073us total) trans 8589944010 rc 0/0 00000100:00100000:0.0:1746065178.031657:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4162 00000100:00100000:0.0:1746065178.031742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.031776:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262796288 00000100:00100000:0.0:1746065178.031778:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262796288 00000100:00100000:0.0:1746065178.031797:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 725 00000100:00100000:0.0:1746065178.031801:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1960:x1830881262796288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065178.031809:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065178.031842:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f8e400/0x14b4f8542d4fb410 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbab expref: 256 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.031867:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065178.031870:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065178.031885:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1960:x1830881262796288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 83us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.031890:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 725 00000100:00100000:0.0:1746065178.036334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.044940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.045103:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262796544 00000100:00100000:1.0:1746065178.045111:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262796544 00000100:00100000:1.0:1746065178.045162:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14032 00000100:00100000:1.0:1746065178.045169:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31435:x1830881262796544:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065178.045184:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.045198:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3e00/0x14b4f8542d4fb41e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fbb2 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.045228:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f8f400/0x14b4f8542d4fb3bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb88 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.045236:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb9d expref: 19 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.045241:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.045243:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.045246:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3e00/0x14b4f8542d4fb41e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3555328->3727359] (req 3555328->3727359) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbb2 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.045269:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb9d expref: 19 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.045279:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb9d expref: 19 pid: 4544 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746065178.045289:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263040:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.045349:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f8f400/0x14b4f8542d4fb3bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb88 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.045357:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f8f400/0x14b4f8542d4fb3bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb88 expref: 32 pid: 2462 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.045364:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263168:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.045377:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59180 going to sleep for 11 seconds 00000100:00080000:0.0:1746065178.047106:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065178.047783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.050179:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263040:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.050212:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263168:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.050238:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3e00/0x14b4f8542d4fb41e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3555328->3727359] (req 3555328->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbb2 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.050253:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eeb3e00, rc 0) 00000100:00100000:1.0:1746065178.050402:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31435:x1830881262796544:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5231us (5468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.050489:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14032 00000100:00100000:0.0:1746065178.054536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.057147:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262797184 00000100:00100000:1.0:1746065178.057159:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262797184 00000100:00100000:1.0:1746065178.057199:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9821 00000100:00100000:1.0:1746065178.057206:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:31437:x1830881262797184:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065178.057224:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.057239:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3800/0x14b4f8542d4fb425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fbb9 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.057327:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057339:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057348:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057359:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057364:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057369:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057456:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3a00/0x14b4f8542d4fb43a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057464:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3a00/0x14b4f8542d4fb43a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057470:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3a00/0x14b4f8542d4fb43a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065178.057477:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:1.0:1746065178.057555:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057560:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057565:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057570:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eeb3000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065178.057573:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057578:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057586:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065178.057589:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065178.057593:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057597:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3000/0x14b4f8542d4fb42c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057619:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057623:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057627:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057630:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eeb3400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065178.057632:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057635:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057640:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18600) 00010000:00010000:1.0:1746065178.057642:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065178.057644:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057647:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3400/0x14b4f8542d4fb433 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.057675:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3800/0x14b4f8542d4fb425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbb9 expref: 17 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.057688:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eeb3a00/0x14b4f8542d4fb43a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbb9 expref: 16 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.057693:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065178.057695:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065178.057696:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eeb3a00, rc 0) 00000100:00100000:1.0:1746065178.057733:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:31437:x1830881262797184:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 528us (3063us total) trans 8589944011 rc 0/0 00000100:00100000:1.0:1746065178.057738:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9821 00000100:00100000:0.0:1746065178.057970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.058760:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262797312 00000100:00100000:1.0:1746065178.058766:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262797312 00010000:00010000:1.0:1746065178.058782:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f8f400/0x14b4f8542d4fb3bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb88 expref: 32 pid: 2462 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.058805:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7104 00000100:00100000:1.0:1746065178.058812:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262796928:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.058835:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065178.058838:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7105 00000100:00100000:0.0:1746065178.058843:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881262797312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.058862:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb9d expref: 20 pid: 4544 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.058871:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb9d expref: 20 pid: 4544 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.058884:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135497e00/0x14b4f8542d4fb3ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb9d expref: 20 pid: 4544 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.058898:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.058919:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262796928:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (4392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.058923:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7104 00000100:00100000:1.0:1746065178.065361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.073009:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.073060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.089164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.089301:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262798080 00000100:00100000:1.0:1746065178.089309:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262798080 00000100:00100000:1.0:1746065178.089352:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14033 00000100:00100000:1.0:1746065178.089359:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+19:31437:x1830881262798080:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065178.089372:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.089386:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2000/0x14b4f8542d4fb448 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fbc0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.089409:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5036600/0x14b4f8542d4fb2f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faf5 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.089416:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4fb2f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fafc expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.089420:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.089422:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.089425:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2000/0x14b4f8542d4fb448 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1671168->2076671] (req 1671168->2076671) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc0 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.089451:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4fb2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fafc expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.089465:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133003a00/0x14b4f8542d4fb2f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fafc expref: 20 pid: 8428 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.089475:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263424:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.089556:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5036600/0x14b4f8542d4fb2f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faf5 expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.089564:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5036600/0x14b4f8542d4fb2f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5faf5 expref: 30 pid: 8428 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.089571:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263552:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.089589:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.091385:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263424:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.091396:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263552:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.091422:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2000/0x14b4f8542d4fb448 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1671168->2076671] (req 1671168->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc0 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.091435:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eeb2000, rc 0) 00000100:00100000:1.0:1746065178.091476:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:31437:x1830881262798080:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2116us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.091483:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14033 00000100:00100000:0.0:1746065178.098135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.098166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.098214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.098469:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262798464 00000100:00100000:1.0:1746065178.098473:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262798464 00000100:00100000:1.0:1746065178.098494:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14034 00000100:00100000:1.0:1746065178.098499:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+21:31433:x1830881262798464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065178.098511:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.098523:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2400/0x14b4f8542d4fb44f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fbc7 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.098544:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3e00/0x14b4f8542d4fb41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3555328->3727359) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbb2 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.098549:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065178.098551:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065178.098554:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2400/0x14b4f8542d4fb44f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc7 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.098577:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3e00/0x14b4f8542d4fb41e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3555328->3727359) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbb2 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.098586:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eeb3e00/0x14b4f8542d4fb41e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3555328->3727359) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbb2 expref: 31 pid: 21998 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.098597:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263680:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.098651:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.105510:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260263680:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.105543:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2400/0x14b4f8542d4fb44f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc7 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.105559:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eeb2400, rc 0) 00000100:00100000:1.0:1746065178.105613:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:31433:x1830881262798464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7112us (7485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.105620:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14034 00000100:00100000:0.0:1746065178.106503:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.115249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.124996:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262799104 00000100:00100000:0.0:1746065178.125004:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262799104 00002000:00100000:0.0:1746065178.125035:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (2072576->2076671) req@ffff88009bee1c00 x1830881262799104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.125044:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1c00 with x1830881262799104 ext(2072576->2076671) 00002000:00010000:0.0:1746065178.125049:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee1c00 00000100:00100000:0.0:1746065178.125076:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7865 00000100:00100000:0.0:1746065178.125082:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262799104:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065178.125202:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262799104:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 119us (266us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065178.125208:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7865 00002000:00100000:0.0:1746065178.125213:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (2072576->2076671) req@ffff88009bee1c00 x1830881262799104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.125220:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1c00 with x1830881262799104 ext(2072576->2076671) 00002000:00010000:0.0:1746065178.125222:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee1c00 00000100:00100000:0.0:1746065178.128279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.134378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.134407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.134434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.134457:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262800000 00000100:00100000:0.0:1746065178.134462:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262800000 00002000:00100000:0.0:1746065178.134490:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880129b0df80 x1830881262800000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.134499:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0df80 with x1830881262800000 ext(2097152->3145727) 00002000:00010000:0.0:1746065178.134503:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0df80 00000100:00100000:0.0:1746065178.134514:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262800512 00000100:00100000:0.0:1746065178.134516:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262800512 00000100:00100000:0.0:1746065178.134747:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7867 00000100:00100000:0.0:1746065178.134753:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262800256:12345-192.168.202.46@tcp:3:multiop.0 00002000:00100000:0.0:1746065178.135737:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880129b0ce00 x1830881262800512/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.135744:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ce00 with x1830881262800512 ext(3145728->4194303) 00002000:00010000:0.0:1746065178.135747:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0ce00 00000100:00100000:0.0:1746065178.135769:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7868 00000100:00100000:0.0:1746065178.135774:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881262800512:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065178.140084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.140166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.140186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.140203:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262800640 00000100:00100000:0.0:1746065178.140208:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262800640 00000100:00100000:0.0:1746065178.140234:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262800768 00000100:00100000:0.0:1746065178.140236:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262800768 00000100:00100000:0.0:1746065178.140243:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262800896 00000100:00100000:0.0:1746065178.140244:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262800896 00000100:00100000:0.0:1746065178.140254:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14035 00000100:00100000:0.0:1746065178.140260:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881262800640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065178.140275:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.140289:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135497400/0x14b4f8542d4fb479 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fbd5 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065178.140326:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260264064:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065178.140374:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.140389:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14036 00000100:00100000:0.0:1746065178.140393:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881262800768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065178.140398:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.140406:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135497800/0x14b4f8542d4fb480 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fbdc expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.140416:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.140417:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.140423:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135497800/0x14b4f8542d4fb480 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbdc expref: 31 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.140435:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135497800/0x14b4f8542d4fb480 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbdc expref: 31 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.140444:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135497800, rc 0) 00000100:00100000:0.0:1746065178.140462:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262800768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.140467:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14036 00000100:00100000:0.0:1746065178.140483:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14037 00000100:00100000:0.0:1746065178.140488:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262800896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065178.140493:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.140498:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135497c00/0x14b4f8542d4fb487 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fbe3 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.140506:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.140507:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.140510:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135497c00/0x14b4f8542d4fb487 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbe3 expref: 34 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.140518:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135497c00/0x14b4f8542d4fb487 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbe3 expref: 34 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.140524:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135497c00, rc 0) 00000100:00100000:0.0:1746065178.140536:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881262800896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 49us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.140541:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14037 00000100:00100000:0.0:1746065178.140582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.157876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.160984:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262800256:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 26230us (26574us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065178.160992:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7867 00002000:00100000:1.0:1746065178.161000:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012dc4b450 x1830881262800256/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/440 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.161009:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc4b450 with x1830881262800256 ext(3145728->4194303) 00002000:00010000:1.0:1746065178.161012:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc4b450 00000100:00100000:1.0:1746065178.172342:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.172403:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262801280 00000100:00100000:0.0:1746065178.172410:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262801280 00002000:00100000:0.0:1746065178.172438:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1671168->2076671) req@ffff88008fc59180 x1830881262801280/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.172448:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59180 with x1830881262801280 ext(1671168->2076671) 00010000:00010000:0.0:1746065178.172454:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2000/0x14b4f8542d4fb448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc0 expref: 20 pid: 21998 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.172465:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2000/0x14b4f8542d4fb448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc0 expref: 20 pid: 21998 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746065178.172471:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc59180 00000100:00100000:0.0:1746065178.172486:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2407 00000100:00100000:0.0:1746065178.172492:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881262801280:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065178.182386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.186012:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881262801280:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 13513us (13664us total) trans 17179873527 rc 0/0 00000100:00100000:1.0:1746065178.186021:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2407 00002000:00100000:1.0:1746065178.186031:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1671168->2076671) req@ffff88008fc59180 x1830881262801280/t17179873527(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/448 e 0 to 0 dl 1746065189 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.186039:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59180 with x1830881262801280 ext(1671168->2076671) 00010000:00010000:1.0:1746065178.186046:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2000/0x14b4f8542d4fb448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc0 expref: 23 pid: 21998 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.186060:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2000/0x14b4f8542d4fb448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc0 expref: 23 pid: 21998 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746065178.186065:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc59180 00000100:00100000:0.0:1746065178.192041:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.196567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.197140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.200312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.200585:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262802176 00000100:00100000:1.0:1746065178.200591:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262802176 00002000:00100000:1.0:1746065178.200625:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009b9fca80 x1830881262802176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.200633:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fca80 with x1830881262802176 ext(1048576->2097151) 00002000:00010000:1.0:1746065178.200637:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fca80 00000100:00100000:1.0:1746065178.200664:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7869 00000100:00100000:1.0:1746065178.200671:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262802176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065178.201276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.207685:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262802560 00000100:00100000:1.0:1746065178.207693:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262802560 00000100:00100000:1.0:1746065178.207742:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4164 00000100:00100000:1.0:1746065178.207749:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:7711:x1830881262802560:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065178.211730:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:7711:x1830881262802560:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 3972us (4644us total) trans 8589944014 rc 0/0 00000100:00100000:1.0:1746065178.211741:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4164 00000100:00100000:1.0:1746065178.219250:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262802816 00000100:00100000:1.0:1746065178.219257:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262802816 00000100:00100000:1.0:1746065178.219306:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4165 00000100:00100000:1.0:1746065178.219313:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:31433:x1830881262802816:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065178.219486:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:31433:x1830881262802816:12345-192.168.202.46@tcp:35:cat.0 Request processed in 172us (597us total) trans 8589944015 rc 0/0 00000100:00100000:1.0:1746065178.219493:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4165 00000100:00100000:0.0:1746065178.219808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.220921:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262802176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20250us (20609us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065178.220927:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7869 00002000:00100000:1.0:1746065178.220932:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009b9fca80 x1830881262802176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/440 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.220939:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fca80 with x1830881262802176 ext(1048576->2097151) 00002000:00010000:1.0:1746065178.220942:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fca80 00000100:00100000:0.0:1746065178.233921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.233960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.233983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.234009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.234022:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262803328 00000100:00100000:0.0:1746065178.234026:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262803328 00000100:00100000:0.0:1746065178.234049:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262803200 00000100:00100000:0.0:1746065178.234051:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262803200 00000100:00100000:0.0:1746065178.234063:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14043 00000100:00100000:0.0:1746065178.234067:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262803328:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065178.234074:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.234082:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092716200/0x14b4f8542d4fb4c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fc14 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.234099:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.234100:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.234106:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092716200/0x14b4f8542d4fb4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc14 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.234118:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092716200/0x14b4f8542d4fb4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc14 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.234126:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092716200, rc 0) 00000100:00100000:0.0:1746065178.234158:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262803328:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 90us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.234163:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14043 00000100:00100000:0.0:1746065178.234179:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14044 00000100:00100000:0.0:1746065178.234184:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262803200:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065178.234189:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.234194:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092717000/0x14b4f8542d4fb4cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fc0d expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.234202:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.234203:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.234206:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092717000/0x14b4f8542d4fb4cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc0d expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.234213:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092717000/0x14b4f8542d4fb4cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc0d expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.234219:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092717000, rc 0) 00000100:00100000:0.0:1746065178.234231:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262803200:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 47us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.234235:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14044 00000100:00080000:0.0:1746065178.234247:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065178.234266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.234304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.234313:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262803712 00000100:00100000:0.0:1746065178.234315:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262803712 00000100:00100000:0.0:1746065178.234327:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14046 00000100:00100000:0.0:1746065178.234330:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262803712:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065178.234335:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.234341:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092717400/0x14b4f8542d4fb4e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fc29 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.234349:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.234350:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.234354:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092717400/0x14b4f8542d4fb4e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc29 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.234361:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092717400/0x14b4f8542d4fb4e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc29 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.234371:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092717400, rc 0) 00000100:00100000:0.0:1746065178.234383:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881262803712:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 52us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.234387:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14046 00000100:00100000:0.0:1746065178.247253:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.247351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.248835:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262803968 00000100:00100000:1.0:1746065178.248841:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262803968 00000100:00100000:1.0:1746065178.248888:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9825 00000100:00100000:1.0:1746065178.248894:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31445:x1830881262803968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065178.248905:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.248913:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0x14b4f8542d4fb4f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fc30 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.248993:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249001:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249009:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249018:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249023:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249026:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249096:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2e00/0x14b4f8542d4fb50c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249106:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2e00/0x14b4f8542d4fb50c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249116:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2e00/0x14b4f8542d4fb50c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065178.249124:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:1.0:1746065178.249201:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249207:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249212:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249216:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e3f2a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065178.249219:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249223:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249232:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065178.249234:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065178.249237:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249241:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0x14b4f8542d4fb4fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249259:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249267:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249271:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249274:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e3f2c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065178.249276:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249280:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249285:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18e00) 00010000:00010000:1.0:1746065178.249287:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065178.249289:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249292:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2c00/0x14b4f8542d4fb505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.249320:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0x14b4f8542d4fb4f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc30 expref: 259 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.249328:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2e00/0x14b4f8542d4fb50c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc30 expref: 258 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.249334:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065178.249336:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065178.249338:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f2e00, rc 0) 00000100:00100000:1.0:1746065178.249460:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31445:x1830881262803968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 564us (2106us total) trans 8589944016 rc 0/0 00000100:00100000:1.0:1746065178.249467:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9825 00000100:00100000:0.0:1746065178.250141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.250246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.250260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.250791:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262804736 00000100:00100000:1.0:1746065178.250796:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262804736 00002000:00100000:1.0:1746065178.250836:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094ff5f80 x1830881262804736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.250855:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff5f80 with x1830881262804736 ext(3145728->4194303) 00002000:00010000:1.0:1746065178.250859:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff5f80 00000100:00100000:1.0:1746065178.251003:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7871 00000100:00100000:1.0:1746065178.251009:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881262804608:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065178.251619:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7873 00000100:00100000:0.0:1746065178.251625:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262804992:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065178.253633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.253908:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262805120 00000100:00100000:1.0:1746065178.253915:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262805120 00010000:00010000:1.0:1746065178.253941:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f8f800/0x14b4f8542d4fb4b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbff expref: 9 pid: 14645 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746065178.264502:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.276044:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262804608:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25027us (25789us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065178.276055:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7871 00002000:00100000:1.0:1746065178.276065:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094ff5880 x1830881262804608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/440 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.276074:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff5880 with x1830881262804608 ext(2097152->3145727) 00002000:00010000:1.0:1746065178.276078:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff5880 00000100:00100000:0.0:1746065178.278967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.282089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.282179:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262805504 00000100:00100000:1.0:1746065178.282184:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262805504 00010000:00010000:1.0:1746065178.282210:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0x14b4f8542d4fb4f7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc37 expref: 10 pid: 14645 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.282234:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7112 00000100:00100000:1.0:1746065178.282240:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881262805504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.282249:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.282253:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0x14b4f8542d4fb4f7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc37 expref: 10 pid: 14645 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.282262:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0x14b4f8542d4fb4f7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc37 expref: 10 pid: 14645 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.282278:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0x14b4f8542d4fb4f7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc37 expref: 10 pid: 14645 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.282303:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065178.282306:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f8e400/0x14b4f8542d4fb528 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065178.282314:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f8e400/0x14b4f8542d4fb528 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065178.282319:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f8e400/0x14b4f8542d4fb528 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065178.282342:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.282382:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262805504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 142us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.282388:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7112 00000100:00100000:0.0:1746065178.289377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.292048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.292485:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262806016 00000100:00100000:1.0:1746065178.292492:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262806016 00000100:00100000:1.0:1746065178.292539:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4166 00000100:00100000:1.0:1746065178.292546:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31441:x1830881262806016:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065178.292727:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31441:x1830881262806016:12345-192.168.202.46@tcp:35:cat.0 Request processed in 181us (685us total) trans 8589944018 rc 0/0 00000100:00100000:1.0:1746065178.292733:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4166 00000100:00100000:0.0:1746065178.293657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.294134:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4167 00000100:00100000:1.0:1746065178.294147:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31443:x1830881262806272:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:1.0:1746065178.294265:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31443:x1830881262806272:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 123us (609us total) trans 8589944019 rc 0/0 00000100:00100000:1.0:1746065178.294270:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4167 00000100:00100000:0.0:1746065178.338238:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.341869:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.342120:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262806528 00000100:00100000:1.0:1746065178.342129:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262806528 00010000:00010000:1.0:1746065178.342152:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f8fe00/0x14b4f8542d4fb4bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc22 expref: 12 pid: 25185 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746065178.342183:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7113 00000100:00100000:1.0:1746065178.342189:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1958:x1830881262806528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.342199:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.342217:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f8fe00/0x14b4f8542d4fb4bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc22 expref: 12 pid: 25185 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.342226:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f8fe00/0x14b4f8542d4fb4bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc22 expref: 12 pid: 25185 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.342244:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f8fe00/0x14b4f8542d4fb4bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc22 expref: 12 pid: 25185 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.342258:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.342277:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881262806528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 89us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.342282:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7113 00000100:00100000:0.0:1746065178.346169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.349479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.353734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.371661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.382630:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.383408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.384133:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.388975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.389007:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262807808 00000100:00100000:0.0:1746065178.389014:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262807808 00000100:00100000:0.0:1746065178.389056:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9828 00000100:00100000:0.0:1746065178.389062:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:31450:x1830881262807808:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065178.389079:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.389092:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e200/0x14b4f8542d4fb54b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fc5a expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.389177:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389188:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389197:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389208:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389213:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389218:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389306:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389314:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389320:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065178.389328:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065178.389393:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389399:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389404:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389409:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c9e000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065178.389412:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389417:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389426:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065178.389429:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065178.389432:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389437:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389449:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389454:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389462:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389466:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c9ec00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065178.389467:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389471:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389476:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fe00) 00010000:00010000:0.0:1746065178.389478:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065178.389480:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389483:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb559 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.389514:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e200/0x14b4f8542d4fb54b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc5a expref: 20 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.389523:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc5a expref: 19 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.389529:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065178.389530:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065178.389533:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c9ee00, rc 0) 00000100:00100000:0.0:1746065178.389573:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:31450:x1830881262807808:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 510us (603us total) trans 8589944020 rc 0/0 00000100:00100000:0.0:1746065178.389578:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9828 00000100:00100000:1.0:1746065178.389850:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262807552 00000100:00100000:1.0:1746065178.389856:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262807552 00010000:00010000:1.0:1746065178.389876:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2400/0x14b4f8542d4fb44f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc7 expref: 22 pid: 21998 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.389901:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262807424 00000100:00100000:1.0:1746065178.389904:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262807424 00010000:00010000:1.0:1746065178.389914:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092717400/0x14b4f8542d4fb4e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc29 expref: 12 pid: 2463 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746065178.389926:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7117 00000100:00100000:1.0:1746065178.389931:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881262807552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.389939:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.389953:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2400/0x14b4f8542d4fb44f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc7 expref: 22 pid: 21998 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.389960:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2400/0x14b4f8542d4fb44f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc7 expref: 22 pid: 21998 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.389972:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eeb2400/0x14b4f8542d4fb44f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbc7 expref: 22 pid: 21998 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.389988:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.390004:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262807552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (6597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.390008:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7117 00000100:00100000:1.0:1746065178.390018:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7118 00000100:00100000:1.0:1746065178.390021:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262807424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.390027:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.390033:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092717400/0x14b4f8542d4fb4e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc29 expref: 12 pid: 2463 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.390041:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092717400/0x14b4f8542d4fb4e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc29 expref: 12 pid: 2463 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.390051:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092717400/0x14b4f8542d4fb4e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc29 expref: 12 pid: 2463 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.390058:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.390060:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.390065:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.390072:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.390096:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065178.390107:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260265856:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065178.390152:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.394166:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260265856:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065178.394186:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.394238:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262807424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4213us (10103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.394248:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7118 00000100:00100000:1.0:1746065178.395280:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262808064 00000100:00100000:1.0:1746065178.395286:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262808064 00002000:00100000:1.0:1746065178.395318:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3280896->3284991) req@ffff88009bee3b80 x1830881262808064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.395326:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3b80 with x1830881262808064 ext(3280896->3284991) 00002000:00010000:1.0:1746065178.395330:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee3b80 00000100:00100000:1.0:1746065178.395344:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7875 00000100:00100000:1.0:1746065178.395350:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262808064:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065178.395477:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262808064:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 126us (260us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065178.395483:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7875 00002000:00100000:1.0:1746065178.395488:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3280896->3284991) req@ffff88009bee3b80 x1830881262808064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.395495:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3b80 with x1830881262808064 ext(3280896->3284991) 00002000:00010000:1.0:1746065178.395497:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee3b80 00000100:00100000:0.0:1746065178.398309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.457967:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.463798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.465293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.465345:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262808832 00000100:00100000:0.0:1746065178.465350:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262808832 00000100:00100000:0.0:1746065178.465384:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14050 00000100:00100000:0.0:1746065178.465391:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262808832:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065178.465400:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.465410:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c9f000/0x14b4f8542d4fb58a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fc6f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065178.465448:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260265984:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065178.465521:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.491111:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.505397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.507158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.513028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.515214:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262809472 00000100:00100000:1.0:1746065178.515220:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262809472 00010000:00010000:1.0:1746065178.515245:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092716200/0x14b4f8542d4fb4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc14 expref: 11 pid: 2463 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746065178.515271:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7119 00000100:00100000:1.0:1746065178.515277:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881262809472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.515287:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.515303:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092716200/0x14b4f8542d4fb4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc14 expref: 11 pid: 2463 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.515312:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092716200/0x14b4f8542d4fb4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc14 expref: 11 pid: 2463 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.515330:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092716200/0x14b4f8542d4fb4c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc14 expref: 11 pid: 2463 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.515343:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.515368:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881262809472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.515373:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7119 00000100:00100000:0.0:1746065178.517221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.517653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.518122:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7120 00000100:00100000:1.0:1746065178.518130:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881262809600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.518140:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.518157:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcadc00/0x14b4f8542d4fb4b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbf8 expref: 22 pid: 2462 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.518167:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcadc00/0x14b4f8542d4fb4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbf8 expref: 22 pid: 2462 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.518184:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcadc00/0x14b4f8542d4fb4b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbf8 expref: 22 pid: 2462 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.518197:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.518238:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262809600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 109us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.518243:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7120 00000100:00100000:1.0:1746065178.518285:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7121 00000100:00100000:1.0:1746065178.518290:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262809728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.518295:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.518301:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcad200/0x14b4f8542d4fb48e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbea expref: 33 pid: 8428 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.518310:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcad200/0x14b4f8542d4fb48e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbea expref: 33 pid: 8428 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.518319:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcad200/0x14b4f8542d4fb48e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fbea expref: 33 pid: 8428 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.518326:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.518328:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.518334:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcaca00/0x14b4f8542d4fb591 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc76 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.518341:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcaca00/0x14b4f8542d4fb591 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc76 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.518366:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcaca00/0x14b4f8542d4fb591 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc76 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065178.518376:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260266496:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065178.518417:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.519870:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.522771:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260266496:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065178.522793:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.522865:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881262809728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4573us (5210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.522874:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7121 00000100:00100000:0.0:1746065178.523892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.528988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.529004:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262810368 00000100:00100000:0.0:1746065178.529010:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262810368 00000100:00100000:0.0:1746065178.529043:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9830 00000100:00100000:0.0:1746065178.529048:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:31457:x1830881262810368:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065178.529064:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.529077:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e600/0x14b4f8542d4fb5a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fc8b expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.529157:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529169:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529177:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529186:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529190:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529194:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529277:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb5bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529285:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb5bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529291:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb5bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:0.0:1746065178.529297:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065178.529513:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529520:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529524:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529529:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c9ea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065178.529536:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529541:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529551:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065178.529554:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065178.529557:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529561:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb5ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529583:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529588:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529592:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529596:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c9e000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065178.529598:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529603:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529613:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f200) 00010000:00010000:0.0:1746065178.529614:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065178.529616:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529620:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb5b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.529650:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e600/0x14b4f8542d4fb5a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc8b expref: 262 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.529659:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb5bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc8b expref: 261 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.529664:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065178.529666:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065178.529669:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c9ec00, rc 0) 00000100:00100000:0.0:1746065178.530230:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31457:x1830881262810368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1179us (1243us total) trans 8589944023 rc 0/0 00000100:00100000:0.0:1746065178.530237:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9830 00000100:00100000:1.0:1746065178.533341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.533414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.534694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.534906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.535771:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262811264 00000100:00100000:1.0:1746065178.535774:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262811264 00000100:00100000:0.0:1746065178.535871:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262811136 00000100:00100000:0.0:1746065178.535874:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262811136 00010000:00010000:0.0:1746065178.535888:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3c00/0x14b4f8542d4fb3f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fba4 expref: 27 pid: 21998 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746065178.536102:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7124 00000100:00100000:0.0:1746065178.536109:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881262811136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065178.536116:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065178.536128:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3c00/0x14b4f8542d4fb3f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fba4 expref: 27 pid: 21998 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.536136:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3c00/0x14b4f8542d4fb3f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fba4 expref: 27 pid: 21998 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.536148:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eeb3c00/0x14b4f8542d4fb3f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fba4 expref: 27 pid: 21998 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.536195:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.536197:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.536202:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.536208:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.536227:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065178.536235:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260267264:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065178.536367:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.537791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.538101:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260267264:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065178.538111:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.538127:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881262811136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2018us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.538133:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7124 00000100:00100000:0.0:1746065178.543881:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881262811392:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5391us (6083us total) trans 17179873528 rc 0/0 00000100:00100000:0.0:1746065178.543895:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2408 00002000:00100000:0.0:1746065178.543905:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3284991) req@ffff88012d7ff480 x1830881262811392/t17179873528(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/448 e 0 to 0 dl 1746065189 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.543914:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff480 with x1830881262811392 ext(3145728->3284991) 00010000:00010000:0.0:1746065178.543923:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 34 pid: 2462 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.543937:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 34 pid: 2462 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746065178.543943:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d7ff480 00000100:00100000:0.0:1746065178.545184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.548652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.548917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.549038:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262811904 00000100:00100000:0.0:1746065178.549045:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262811904 00010000:00010000:0.0:1746065178.549070:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 34 pid: 2462 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746065178.549101:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7125 00000100:00100000:0.0:1746065178.549106:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881262811904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065178.549116:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065178.549131:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 34 pid: 2462 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.549141:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 34 pid: 2462 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.549163:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f8f600/0x14b4f8542d4fb544 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc53 expref: 34 pid: 2462 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.549181:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.549182:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.549188:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f8ea00/0x14b4f8542d4fb5de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fca7 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.549195:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f8ea00/0x14b4f8542d4fb5de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fca7 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.549225:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f8ea00/0x14b4f8542d4fb5de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fca7 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065178.549603:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260267392:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065178.549628:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.553850:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.554370:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260267392:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065178.554381:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.554383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.554396:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881262811904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5290us (5479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.554403:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7125 00000100:00100000:0.0:1746065178.557066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.572335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.572382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.572623:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262812672 00000100:00100000:1.0:1746065178.572627:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262812672 00010000:00010000:1.0:1746065178.572644:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcaca00/0x14b4f8542d4fb591 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc76 expref: 24 pid: 8851 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.572659:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7126 00000100:00100000:1.0:1746065178.572663:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881262812672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.572670:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.572687:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcaca00/0x14b4f8542d4fb591 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc76 expref: 24 pid: 8851 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.572696:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcaca00/0x14b4f8542d4fb591 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc76 expref: 24 pid: 8851 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.572712:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcaca00/0x14b4f8542d4fb591 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc76 expref: 24 pid: 8851 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.572726:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.572727:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.572733:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.572740:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.572759:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065178.572767:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260267776:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065178.572788:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.575734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.576752:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260267776:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065178.576764:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.576781:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881262812672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4117us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.576787:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7126 00000100:00100000:0.0:1746065178.577046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.588898:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262813312 00000100:00100000:1.0:1746065178.588905:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262813312 00010000:00010000:1.0:1746065178.588932:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f8e000/0x14b4f8542d4fb53d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3629056->4194303] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc4c expref: 32 pid: 2462 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.589018:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7127 00000100:00100000:1.0:1746065178.589024:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881262813312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.589035:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065178.589049:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065178 -> 1746065179 00010000:00010000:1.0:1746065178.589053:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f8e000/0x14b4f8542d4fb53d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3629056->4194303] (req 3629056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc4c expref: 32 pid: 2462 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.589063:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f8e000/0x14b4f8542d4fb53d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3629056->4194303] (req 3629056->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc4c expref: 32 pid: 2462 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.589081:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f8e000/0x14b4f8542d4fb53d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3629056->4194303] (req 3629056->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc4c expref: 32 pid: 2462 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.589221:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.589223:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.589230:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcad400/0x14b4f8542d4fb5ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcb5 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.589238:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcad400/0x14b4f8542d4fb5ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcb5 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.589267:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcad400/0x14b4f8542d4fb5ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcb5 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065178.589278:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260267904:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065178.589630:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.591311:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260267904:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065178.591326:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.591520:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881262813312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2494us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.591529:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7127 00000100:00100000:1.0:1746065178.592378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.597464:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262813568 00000100:00100000:0.0:1746065178.597470:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262813568 00002000:00100000:0.0:1746065178.597500:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1417215) req@ffff88009bee0e00 x1830881262813568/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.597508:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0e00 with x1830881262813568 ext(1048576->1417215) 00010000:00010000:0.0:1746065178.597515:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 27 pid: 8851 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.597525:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 27 pid: 8851 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746065178.597531:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bee0e00 00000100:00100000:0.0:1746065178.597543:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262813952 00000100:00100000:0.0:1746065178.597545:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262813952 00002000:00100000:0.0:1746065178.597555:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009bee2d80 x1830881262813952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.597561:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2d80 with x1830881262813952 ext(3145728->4194303) 00002000:00010000:0.0:1746065178.597564:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee2d80 00000100:00100000:0.0:1746065178.597571:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262814080 00000100:00100000:0.0:1746065178.597573:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262814080 00002000:00100000:0.0:1746065178.597581:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009bee2300 x1830881262814080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.597587:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2300 with x1830881262814080 ext(3145728->4194303) 00002000:00010000:0.0:1746065178.597590:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee2300 00000100:00100000:0.0:1746065178.597597:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7881 00000100:00100000:0.0:1746065178.597601:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262813952:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065178.619776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.619796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.619860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.619876:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262814336 00000100:00100000:0.0:1746065178.619883:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262814336 00000100:00100000:0.0:1746065178.619909:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262814464 00000100:00100000:0.0:1746065178.619911:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262814464 00000100:00100000:0.0:1746065178.619931:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14061 00000100:00100000:0.0:1746065178.619937:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881262814336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065178.619949:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.619962:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fcca expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.619979:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.619981:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.619987:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 24 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.619999:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 24 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.620008:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c9e800, rc 0) 00000100:00100000:0.0:1746065178.620030:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262814336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.620035:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14061 00000100:00100000:0.0:1746065178.620047:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14062 00000100:00100000:0.0:1746065178.620051:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262814464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065178.620057:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.620064:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb601 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fcd1 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065178.620093:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260268160:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065178.621798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.621830:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262814592 00000100:00100000:1.0:1746065178.621833:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262814592 00010000:00010000:1.0:1746065178.621858:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 31 pid: 8851 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746065178.622566:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.623263:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7128 00000100:00100000:1.0:1746065178.623272:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881262814592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.623282:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065178.623295:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065178 -> 1746065179 00002000:00010000:1.0:1746065178.623298:0:10991:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065178 -> 1746065179 00010000:00010000:1.0:1746065178.623302:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 31 pid: 8851 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.623311:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 31 pid: 8851 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.623325:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.623326:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.623331:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb5f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcbc expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.623338:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb5f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcbc expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.623360:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb5f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcbc expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065178.623368:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260268288:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065178.623405:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065178.624159:0:25185:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88009ba1d180 x1830881260268160) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 31 pid: 8851 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.624182:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dcac200/0x14b4f8542d4fb59f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc84 expref: 31 pid: 8851 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.624582:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260268160:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065178.624603:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb601 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcd1 expref: 30 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.624613:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c9ea00/0x14b4f8542d4fb601 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcd1 expref: 30 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.624620:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c9ea00, rc 0) 00000100:00100000:1.0:1746065178.624654:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262814464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4601us (4793us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065178.624660:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14062 00000100:00100000:0.0:1746065178.625402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.628876:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262815104 00000100:00100000:1.0:1746065178.628880:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262815104 00000100:00100000:1.0:1746065178.628904:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14063 00000100:00100000:1.0:1746065178.628908:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881262815104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065178.628916:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.628929:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a43ce00/0x14b4f8542d4fb624 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fcd8 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.628944:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.628945:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.628951:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a43ce00/0x14b4f8542d4fb624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcd8 expref: 30 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.628964:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a43ce00/0x14b4f8542d4fb624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcd8 expref: 30 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.628972:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43ce00, rc 0) 00000100:00100000:1.0:1746065178.629000:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881262815104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 92us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.629006:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14063 00000100:00100000:0.0:1746065178.629188:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260268288:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065178.629201:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065178.629215:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262814592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5945us (7418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.629220:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7128 00000100:00100000:1.0:1746065178.633032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.633050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.633068:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262815360 00000100:00100000:1.0:1746065178.633075:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262815360 00000100:00100000:1.0:1746065178.633104:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262815616 00000100:00100000:1.0:1746065178.633105:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262815616 00000100:00100000:1.0:1746065178.633132:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14064 00000100:00100000:1.0:1746065178.633140:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262815360:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065178.633155:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.633168:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a43d200/0x14b4f8542d4fb62b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fce6 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.633186:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.633188:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.633194:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a43d200/0x14b4f8542d4fb62b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fce6 expref: 11 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.633206:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a43d200/0x14b4f8542d4fb62b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fce6 expref: 11 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.633214:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43d200, rc 0) 00000100:00100000:1.0:1746065178.633245:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262815360:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.633250:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14064 00000100:00100000:1.0:1746065178.633276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.633288:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262815232 00000100:00100000:1.0:1746065178.633290:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262815232 00000100:00100000:1.0:1746065178.633303:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14066 00000100:00100000:1.0:1746065178.633307:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262815232:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065178.633313:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.633319:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fcdf expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.633327:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.633328:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.633333:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.633341:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.633347:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43d400, rc 0) 00000100:00100000:1.0:1746065178.633361:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881262815232:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 54us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.633367:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14066 00000100:00100000:1.0:1746065178.633411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.633424:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262815488 00000100:00100000:1.0:1746065178.633427:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262815488 00000100:00100000:1.0:1746065178.633441:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14067 00000100:00100000:1.0:1746065178.633444:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262815488:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065178.633450:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.633456:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a43d800/0x14b4f8542d4fb640 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fced expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.633465:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.633466:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.633470:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a43d800/0x14b4f8542d4fb640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fced expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.633477:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a43d800/0x14b4f8542d4fb640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fced expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.633483:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43d800, rc 0) 00000100:00100000:1.0:1746065178.633496:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881262815488:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 51us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.633500:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14067 00000100:00100000:0.0:1746065178.641726:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.642220:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262815872 00000100:00100000:1.0:1746065178.642227:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262815872 00000100:00100000:1.0:1746065178.642262:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262816128 00000100:00100000:1.0:1746065178.642265:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262816128 00000100:00100000:1.0:1746065178.642288:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9833 00000100:00100000:1.0:1746065178.642292:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31462:x1830881262816128:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065178.642309:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.642323:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43dc00/0x14b4f8542d4fb647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd02 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.642395:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.642407:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f8e400/0x14b4f8542d4fb528 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc3e expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.642413:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc5a expref: 21 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.642418:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb5bb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc8b expref: 262 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.642424:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.643837:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb5bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc8b expref: 262 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.643858:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb5bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc8b expref: 262 pid: 20754 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.643869:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268416:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.643965:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc5a expref: 21 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.643973:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc5a expref: 21 pid: 20754 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.643985:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268544:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.644008:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094f8e400/0x14b4f8542d4fb528 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc3e expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.644014:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f8e400/0x14b4f8542d4fb528 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc3e expref: 10 pid: 14645 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.644021:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268672:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.644035:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.645490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.645493:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268416:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.645501:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268544:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.645507:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268672:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.645524:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065178.646447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.646478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.646490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.646515:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.646580:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14069 00000100:00100000:1.0:1746065178.646585:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881262816768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065178.646591:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.646598:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a43c600/0x14b4f8542d4fb66a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd10 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.646613:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.646615:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.646621:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a43c600/0x14b4f8542d4fb66a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd10 expref: 35 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.646633:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a43c600/0x14b4f8542d4fb66a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd10 expref: 35 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.646641:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43c600, rc 0) 00000100:00100000:1.0:1746065178.646668:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262816768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.646673:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14069 00000100:00100000:0.0:1746065178.646808:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7131 00000100:00100000:0.0:1746065178.646825:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881262816384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065178.646830:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065178.646833:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc5a expref: 22 pid: 20754 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.646853:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc5a expref: 22 pid: 20754 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.646989:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9ee00/0x14b4f8542d4fb560 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc5a expref: 22 pid: 20754 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746065178.647024:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065178.647026:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.647031:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065178.647035:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065178.647045:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881262816384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 233us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.647050:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7131 00010000:00010000:1.0:1746065178.647373:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.647379:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065178.647393:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065178.647416:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880133003400/0x14b4f8542d4fb65c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065178.647420:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133003400/0x14b4f8542d4fb65c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065178.647429:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:0.0:1746065178.647522:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133003a00/0x14b4f8542d4fb64e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcfb expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.647532:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133003400/0x14b4f8542d4fb65c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcfb expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.647537:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065178.647538:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065178.647541:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133003400, rc 0) 00000100:00100000:0.0:1746065178.647559:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31460:x1830881262815872:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 5286us (5835us total) trans 8589944025 rc 0/0 00000100:00100000:0.0:1746065178.647565:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9832 00010000:00010000:1.0:1746065178.647695:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43dc00/0x14b4f8542d4fb647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd02 expref: 263 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.647708:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd02 expref: 262 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.647789:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065178.647790:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065178.647792:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43de00, rc 0) 00000100:00100000:1.0:1746065178.647811:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:31462:x1830881262816128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5518us (5883us total) trans 8589944026 rc 0/0 00000100:00100000:1.0:1746065178.647834:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9833 00000100:00100000:0.0:1746065178.652792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.652896:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262816896 00000100:00100000:1.0:1746065178.652904:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262816896 00000100:00100000:1.0:1746065178.652943:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9834 00000100:00100000:1.0:1746065178.652950:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31460:x1830881262816896:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065178.652967:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.652982:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43ca00/0x14b4f8542d4fb67f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd17 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.653047:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.653058:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd02 expref: 261 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.653064:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133003400/0x14b4f8542d4fb65c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcfb expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.653069:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.653094:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133003400/0x14b4f8542d4fb65c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcfb expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.653103:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133003400/0x14b4f8542d4fb65c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcfb expref: 11 pid: 14645 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.653112:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268800:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.653200:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd02 expref: 261 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.653206:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb655 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd02 expref: 261 pid: 20754 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.653213:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268928:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.653229:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.658047:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268800:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.658060:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260268928:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.658080:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065178.658201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.658275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065178.659405:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.659412:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065178.659446:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00000004:00200000:1.0:1746065178.659449:0:20754:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065178.659462:0:20754:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.659487:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43ca00/0x14b4f8542d4fb67f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd17 expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065178.659492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065178.659510:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd17 expref: 10 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.659516:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065178.659518:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:0.0:1746065178.659518:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065178.659520:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43c200, rc 0) 00000100:00100000:1.0:1746065178.659543:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31460:x1830881262816896:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6594us (6758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.659549:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9834 00000100:00100000:0.0:1746065178.659550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.664691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.666569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.667284:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262818432 00000100:00100000:1.0:1746065178.667291:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262818432 00000100:00100000:1.0:1746065178.667326:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9835 00000100:00100000:1.0:1746065178.667332:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31460:x1830881262818432:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065178.667345:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.667358:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43d000/0x14b4f8542d4fb68d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd1e expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.667432:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667444:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667453:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667462:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667467:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667472:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667475:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a43c800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065178.667478:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667486:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667495:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065178.667497:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065178.667500:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667504:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb694 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065178.667526:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43d000/0x14b4f8542d4fb68d lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd1e expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.667532:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43d000/0x14b4f8542d4fb68d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd1e expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.667538:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43d000, rc 0) 00000100:00100000:1.0:1746065178.667569:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31460:x1830881262818432:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 237us (1003us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065178.667575:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9835 00000100:00100000:0.0:1746065178.675446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.688253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.691903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.691985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.692051:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262819200 00000100:00100000:1.0:1746065178.692059:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262819200 00010000:00010000:1.0:1746065178.692087:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd17 expref: 11 pid: 20754 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746065178.692109:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7134 00000100:00100000:1.0:1746065178.692115:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881262819200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.692125:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.692131:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd17 expref: 11 pid: 20754 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.692140:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd17 expref: 11 pid: 20754 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.692162:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a43c200/0x14b4f8542d4fb686 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd17 expref: 11 pid: 20754 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746065178.692186:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065178.692190:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009356f000/0x14b4f8542d4fb6a2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065178.692198:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356f000/0x14b4f8542d4fb6a2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065178.692203:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356f000/0x14b4f8542d4fb6a2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065178.692218:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.692255:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881262819200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 139us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.692260:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7134 00000100:00100000:1.0:1746065178.697144:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262819328 00000100:00100000:1.0:1746065178.697147:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262819328 00010000:00010000:1.0:1746065178.697165:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a43d800/0x14b4f8542d4fb640 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fced expref: 12 pid: 25185 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746065178.697182:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7135 00000100:00100000:1.0:1746065178.697187:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262819328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.697201:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.697220:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a43d800/0x14b4f8542d4fb640 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fced expref: 12 pid: 25185 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.697229:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a43d800/0x14b4f8542d4fb640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fced expref: 12 pid: 25185 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.697249:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a43d800/0x14b4f8542d4fb640 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fced expref: 12 pid: 25185 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.697259:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065178.697282:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262819328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 94us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.697287:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7135 00000100:00100000:0.0:1746065178.700902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.700952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.701101:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262819712 00000100:00100000:1.0:1746065178.701105:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262819712 00010000:00010000:1.0:1746065178.701119:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133003800/0x14b4f8542d4fb663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd09 expref: 34 pid: 2462 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746065178.701310:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.701325:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262819840 00000100:00100000:0.0:1746065178.701327:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262819840 00000100:00100000:0.0:1746065178.701350:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14072 00000100:00100000:0.0:1746065178.701354:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262819840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065178.701367:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.701376:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb6be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd3a expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.701388:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.701395:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb6be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd3a expref: 36 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.701403:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb6be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd3a expref: 36 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065178.701412:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c9ec00, rc 0) 00000100:00100000:0.0:1746065178.701430:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262819840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 76us (120us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065178.701435:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14072 00000100:00100000:0.0:1746065178.701488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.701510:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.701522:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262819968 00000100:00100000:0.0:1746065178.701524:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262819968 00010000:00010000:0.0:1746065178.701536:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f8e200/0x14b4f8542d4fb4d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc06 expref: 11 pid: 8428 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746065178.701756:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7137 00000100:00100000:1.0:1746065178.701762:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262819712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065178.701769:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065178.701778:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133003800/0x14b4f8542d4fb663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd09 expref: 35 pid: 2462 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.701786:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133003800/0x14b4f8542d4fb663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd09 expref: 35 pid: 2462 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.701797:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133003800/0x14b4f8542d4fb663 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd09 expref: 35 pid: 2462 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746065178.701806:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.701807:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065178.701828:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356f800/0x14b4f8542d4fb6a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3317760->4194303] (req 3317760->3616767) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd2c expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.701835:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356f800/0x14b4f8542d4fb6a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3317760->4194303] (req 3317760->3616767) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd2c expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.701869:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009356f800/0x14b4f8542d4fb6a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3317760->4194303] (req 3317760->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd2c expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065178.701880:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260269952:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065178.701930:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.702139:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7138 00000100:00100000:0.0:1746065178.702145:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262819968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065178.702151:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065178.702166:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f8e200/0x14b4f8542d4fb4d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc06 expref: 11 pid: 8428 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746065178.702173:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f8e200/0x14b4f8542d4fb4d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc06 expref: 11 pid: 8428 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746065178.702186:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065178.702200:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262819968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.702205:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7138 00000100:00100000:0.0:1746065178.703773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.705043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.705141:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260269952:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065178.705153:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065178.705173:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881262819712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3411us (4220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.705180:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7137 00000100:00100000:0.0:1746065178.706034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.708599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.709256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.711155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.714048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.715031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.723914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.723966:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262822016 00000100:00100000:1.0:1746065178.723975:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262822016 00000100:00100000:1.0:1746065178.724029:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14074 00000100:00100000:1.0:1746065178.724037:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881262822016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065178.724052:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.724070:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a43d000/0x14b4f8542d4fb6cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd48 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065178.724122:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260270208:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065178.724207:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.724248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065178.726760:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime: 1746065177 -> 1746065179 00002000:00010000:1.0:1746065178.726766:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime: 1746065177 -> 1746065179 00002000:00010000:1.0:1746065178.726768:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime: 1746065178 -> 1746065179 00000100:00100000:1.0:1746065178.726788:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260270208:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065178.726812:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a43d000/0x14b4f8542d4fb6cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd48 expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.726864:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a43d000/0x14b4f8542d4fb6cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd48 expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.726882:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43d000, rc 0) 00000100:00100000:1.0:1746065178.726927:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881262822016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2890us (3118us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065178.726933:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14074 00000100:00100000:0.0:1746065178.730007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.730081:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262822272 00000100:00100000:1.0:1746065178.730088:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262822272 00000100:00100000:1.0:1746065178.730133:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14076 00000100:00100000:1.0:1746065178.730140:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262822272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065178.730156:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.730170:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb6da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd56 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065178.730214:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260270336:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065178.730385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.730800:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065178.734198:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260270336:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065178.734226:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb6da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd56 expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.734236:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a43c800/0x14b4f8542d4fb6da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd56 expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.734487:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43c800, rc 0) 00000100:00100000:1.0:1746065178.734671:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262822272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4530us (4668us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065178.734677:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14076 00000100:00100000:0.0:1746065178.741918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.762231:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.762334:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262822784 00000100:00100000:1.0:1746065178.762342:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262822784 00000100:00100000:1.0:1746065178.762641:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14078 00000100:00100000:1.0:1746065178.762650:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881262822784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065178.762665:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.762679:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb6e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd64 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.762713:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb6e8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd64 expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.762721:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a43de00/0x14b4f8542d4fb6e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd64 expref: 29 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065178.763103:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43de00, rc 0) 00000100:00100000:1.0:1746065178.763144:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881262822784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 495us (921us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065178.763150:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14078 00000100:00100000:0.0:1746065178.775905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.775941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.775976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.779501:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7894 00000100:00100000:1.0:1746065178.779517:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7895 00000100:00100000:1.0:1746065178.779525:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881262823552:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065178.780535:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881262823296:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065178.805656:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881262823552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26124us (29669us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065178.805665:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7895 00002000:00100000:1.0:1746065178.805675:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880095352680 x1830881262823552/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/440 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.805682:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352680 with x1830881262823552 ext(1048576->2097151) 00002000:00010000:1.0:1746065178.805686:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095352680 00000100:00100000:1.0:1746065178.813722:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881262823296:12345-192.168.202.46@tcp:3:cat.0 Request processed in 34200us (37768us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065178.813733:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7894 00002000:00100000:1.0:1746065178.813744:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880095353800 x1830881262823296/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/440 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.813753:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353800 with x1830881262823296 ext(1048576->2097151) 00002000:00010000:1.0:1746065178.813759:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353800 00000100:00100000:0.0:1746065178.834319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.834631:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262823680 00000100:00100000:1.0:1746065178.834638:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262823680 00000100:00100000:1.0:1746065178.834689:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14079 00000100:00100000:1.0:1746065178.834696:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+28:31472:x1830881262823680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065178.834711:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065178.834725:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a43ca00/0x14b4f8542d4fb6ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd6b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.834749:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356f800/0x14b4f8542d4fb6a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3317760->4194303] (req 3317760->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd2c expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.834755:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065178.834756:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065178.834759:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a43ca00/0x14b4f8542d4fb6ef lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd6b expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.834783:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356f800/0x14b4f8542d4fb6a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3317760->4194303] (req 3317760->3616767) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd2c expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.834793:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356f800/0x14b4f8542d4fb6a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3317760->4194303] (req 3317760->3616767) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd2c expref: 32 pid: 8428 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746065178.834803:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260270464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065178.836221:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.841779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.841943:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260270464:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065178.841967:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a43ca00/0x14b4f8542d4fb6ef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd6b expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065178.841980:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a43ca00, rc 0) 00000100:00100000:1.0:1746065178.842026:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+29:31472:x1830881262823680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7323us (7707us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065178.842037:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14079 00000100:00100000:0.0:1746065178.853639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.853718:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262823936 00000100:00100000:0.0:1746065178.853724:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262823936 00000100:00100000:0.0:1746065178.853765:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14080 00000100:00100000:0.0:1746065178.853771:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+24:31474:x1830881262823936:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065178.853784:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.853796:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd72 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065178.856761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.859123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.859141:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262824192 00000100:00100000:0.0:1746065178.859146:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262824192 00010000:00010000:0.0:1746065178.859166:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092717000/0x14b4f8542d4fb4cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc0d expref: 12 pid: 2463 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746065178.859188:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7142 00000100:00100000:0.0:1746065178.859194:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1958:x1830881262824192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065178.859202:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065178.859217:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092717000/0x14b4f8542d4fb4cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc0d expref: 12 pid: 2463 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746065178.859226:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092717000/0x14b4f8542d4fb4cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc0d expref: 12 pid: 2463 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746065178.859244:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065178.859275:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1958:x1830881262824192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.859280:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7142 00000100:00100000:0.0:1746065178.859391:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260270592:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065178.859400:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092717000/0x14b4f8542d4fb4cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc0d expref: 11 pid: 2463 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746065178.859413:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260270720:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065178.859421:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260270848:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065178.859443:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->1245183] (req 1048576->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.859452:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db8d600, rc 0) 00000100:00100000:0.0:1746065178.859473:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+25:31474:x1830881262823936:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5702us (5835us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.859478:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14080 00000100:00100000:0.0:1746065178.863601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.863626:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262824320 00000100:00100000:0.0:1746065178.863633:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262824320 00010000:00010000:0.0:1746065178.863660:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 25 pid: 4544 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065178.863685:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7143 00000100:00100000:0.0:1746065178.863691:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881262824320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065178.863701:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065178.863720:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 25 pid: 4544 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065178.863734:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 25 pid: 4544 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065178.863751:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f362a00/0x14b4f8542d4fb2dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fae0 expref: 25 pid: 4544 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065178.863764:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065178.863790:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262824320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 99us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065178.863795:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7143 00000100:00100000:0.0:1746065178.863887:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.863900:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262824448 00000100:00100000:0.0:1746065178.863903:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262824448 00010000:00010000:0.0:1746065178.863915:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad9 expref: 35 pid: 8428 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065178.863929:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7144 00000100:00100000:0.0:1746065178.863933:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881262824448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065178.863940:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065178.863948:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad9 expref: 35 pid: 8428 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065178.863955:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad9 expref: 35 pid: 8428 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065178.863969:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f363e00/0x14b4f8542d4fb2d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fad9 expref: 35 pid: 8428 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065178.863978:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.863980:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065178.863986:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.863993:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.864020:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065178.864030:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260271104:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065178.864087:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.871893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.872871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.873041:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262824704 00000100:00100000:1.0:1746065178.873049:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262824704 00002000:00100000:1.0:1746065178.873087:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880095351880 x1830881262824704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.873095:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351880 with x1830881262824704 ext(3145728->4194303) 00002000:00010000:1.0:1746065178.873100:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351880 00000100:00100000:1.0:1746065178.873128:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262824960 00000100:00100000:1.0:1746065178.873131:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262824960 00002000:00100000:1.0:1746065178.873143:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1241088->1245183) req@ffff880095353100 x1830881262824960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.873150:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881262824960 ext(1241088->1245183) 00002000:00010000:1.0:1746065178.873153:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353100 00000100:00100000:1.0:1746065178.873164:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7896 00000100:00100000:1.0:1746065178.873170:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262824704:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065178.885220:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262824704:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12039us (13321us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065178.885232:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7896 00002000:00100000:1.0:1746065178.885243:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880095351880 x1830881262824704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/440 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.885251:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351880 with x1830881262824704 ext(3145728->4194303) 00002000:00010000:1.0:1746065178.885256:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351880 00000100:00100000:0.0:1746065178.956043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.964399:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262825472 00000100:00100000:0.0:1746065178.964404:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262825472 00000100:00100000:0.0:1746065178.964429:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14081 00000100:00100000:0.0:1746065178.964434:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31478:x1830881262825472:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065178.964446:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065178.964457:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db8d200/0x14b4f8542d4fb720 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fd80 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.964478:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.964484:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065178.964485:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065178.964488:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db8d200/0x14b4f8542d4fb720 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1941504->1953791] (req 1941504->1953791) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd80 expref: 35 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.964512:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065178.964523:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 23 pid: 21998 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065178.964999:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260271232:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065178.965357:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065178.968472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065178.968927:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262825600 00000100:00100000:1.0:1746065178.968933:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262825600 00002000:00100000:1.0:1746065178.968961:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1245183) req@ffff880095351c00 x1830881262825600/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065178.968969:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351c00 with x1830881262825600 ext(1048576->1245183) 00010000:00010000:1.0:1746065178.968974:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 24 pid: 21998 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746065178.968985:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db8d600/0x14b4f8542d4fb6f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd72 expref: 24 pid: 21998 timeout: 878 lvb_type: 0 00002000:00010000:1.0:1746065178.968990:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095351c00 00000100:00100000:1.0:1746065178.969003:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2413 00000100:00100000:1.0:1746065178.969008:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881262825600:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065178.981025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.985421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.985449:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262825984 00000100:00100000:0.0:1746065178.985454:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262825984 00002000:00100000:0.0:1746065178.985486:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1941504->1945599) req@ffff880095350000 x1830881262825984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/0 e 0 to 0 dl 1746065189 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.985495:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350000 with x1830881262825984 ext(1941504->1945599) 00002000:00010000:0.0:1746065178.985499:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350000 00000100:00100000:0.0:1746065178.985514:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7898 00000100:00100000:0.0:1746065178.985519:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881262825984:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065178.985628:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881262825984:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 109us (208us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065178.985633:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7898 00002000:00100000:0.0:1746065178.985639:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1941504->1945599) req@ffff880095350000 x1830881262825984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746065189 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065178.985646:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350000 with x1830881262825984 ext(1941504->1945599) 00002000:00010000:0.0:1746065178.985648:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350000 00000100:00100000:0.0:1746065178.986945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.987882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.989921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.991502:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.993912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065178.997378:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.000535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.009119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065179.009721:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065179.017876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.017925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.017993:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262828032 00000100:00100000:1.0:1746065179.017997:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262828032 00002000:00100000:1.0:1746065179.018012:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880094ff6a00 x1830881262828032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 504/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.018019:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6a00 with x1830881262828032 ext(1048576->2097151) 00002000:00010000:1.0:1746065179.018022:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff6a00 00000100:00100000:1.0:1746065179.018046:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7901 00000100:00100000:1.0:1746065179.018050:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881262828032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065179.028564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.029678:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881262828032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11621us (11747us total) trans 0 rc 1036288/1036288 00000100:00100000:1.0:1746065179.029913:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7901 00002000:00100000:1.0:1746065179.029925:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880094ff6a00 x1830881262828032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 504/440 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.029938:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6a00 with x1830881262828032 ext(1048576->2097151) 00002000:00010000:1.0:1746065179.029943:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff6a00 00000100:00100000:1.0:1746065179.034257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065179.035177:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065179.041985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.054779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.060749:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262828800 00000100:00100000:1.0:1746065179.060757:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262828800 00002000:00100000:1.0:1746065179.060790:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009baa3800 x1830881262828800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.060798:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3800 with x1830881262828800 ext(2097152->3145727) 00002000:00010000:1.0:1746065179.060803:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa3800 00000100:00100000:1.0:1746065179.060836:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7904 00000100:00100000:1.0:1746065179.060854:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881262828800:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065179.073399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.077257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.080620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.084066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.086806:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.087622:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262829824 00000100:00100000:1.0:1746065179.087627:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262829824 00002000:00100000:1.0:1746065179.087658:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f9cd500 x1830881262829824/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.087668:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd500 with x1830881262829824 ext(1048576->2097151) 00002000:00010000:1.0:1746065179.087671:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cd500 00000100:00100000:1.0:1746065179.087691:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7905 00000100:00100000:1.0:1746065179.087696:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881262829824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065179.102055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.103172:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262830080 00000100:00100000:1.0:1746065179.103179:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262830080 00000100:00100000:1.0:1746065179.103227:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4174 00000100:00100000:1.0:1746065179.103233:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:31481:x1830881262830080:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065179.103377:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:31481:x1830881262830080:12345-192.168.202.46@tcp:35:cat.0 Request processed in 145us (1330us total) trans 8589944034 rc 0/0 00000100:00100000:1.0:1746065179.103383:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4174 00000100:00080000:0.0:1746065179.103422:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065179.106016:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.106155:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262830208 00000100:00100000:0.0:1746065179.106162:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262830208 00000100:00100000:0.0:1746065179.106222:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9839 00000100:00100000:0.0:1746065179.106232:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31488:x1830881262830208:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065179.106256:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065179.106270:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8d200/0x14b4f8542d4fb77b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fdbf expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.106330:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8d600/0x14b4f8542d4fb782 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.106341:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8d600/0x14b4f8542d4fb782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.106349:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8d600/0x14b4f8542d4fb782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.106359:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8c800/0x14b4f8542d4fb789 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.106364:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8c800/0x14b4f8542d4fb789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.106369:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8c800/0x14b4f8542d4fb789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.106457:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8c600/0x14b4f8542d4fb790 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.106466:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356f000/0x14b4f8542d4fb6a2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd25 expref: 22 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.106472:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db8c600/0x14b4f8542d4fb790 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.106495:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009356f000/0x14b4f8542d4fb6a2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd25 expref: 22 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.106504:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356f000/0x14b4f8542d4fb6a2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd25 expref: 22 pid: 14645 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065179.106513:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260272256:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065179.106671:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065179.116732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.120288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.122349:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262830464 00000100:00100000:1.0:1746065179.122360:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262830464 00000100:00100000:1.0:1746065179.123622:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14089 00000100:00100000:1.0:1746065179.123632:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881262830464:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065179.123646:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.123661:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800911e3a00/0x14b4f8542d4fb797 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fdc6 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.123679:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.123681:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.123688:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800911e3a00/0x14b4f8542d4fb797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdc6 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.123701:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800911e3a00/0x14b4f8542d4fb797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdc6 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.123710:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e3a00, rc 0) 00000100:00100000:1.0:1746065179.124866:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881262830464:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1232us (4580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.124873:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14089 00000100:00100000:0.0:1746065179.125081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.125281:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262830592 00000100:00100000:1.0:1746065179.125287:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262830592 00000100:00100000:1.0:1746065179.125325:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14090 00000100:00100000:1.0:1746065179.125331:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881262830592:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065179.125341:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.125352:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800911e3800/0x14b4f8542d4fb79e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fdcd expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.125366:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.125367:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.125372:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800911e3800/0x14b4f8542d4fb79e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdcd expref: 12 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.125384:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800911e3800/0x14b4f8542d4fb79e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdcd expref: 12 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.125391:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e3800, rc 0) 00000100:00100000:1.0:1746065179.125417:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1959:x1830881262830592:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.125422:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14090 00000100:00100000:0.0:1746065179.129234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.129308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.129330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.129399:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262830720 00000100:00100000:1.0:1746065179.129407:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262830720 00000100:00100000:1.0:1746065179.129435:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262830848 00000100:00100000:1.0:1746065179.129436:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262830848 00000100:00100000:1.0:1746065179.129449:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14091 00000100:00100000:1.0:1746065179.129456:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881262830720:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065179.129469:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.129481:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800911e3400/0x14b4f8542d4fb7a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fdd4 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.129502:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.129504:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.129511:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800911e3400/0x14b4f8542d4fb7a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdd4 expref: 12 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.129522:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800911e3400/0x14b4f8542d4fb7a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdd4 expref: 12 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.129531:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e3400, rc 0) 00000100:00100000:1.0:1746065179.129566:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1959:x1830881262830720:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 111us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.129572:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14091 00000100:00100000:1.0:1746065179.129584:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14092 00000100:00100000:1.0:1746065179.129588:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:31487:x1830881262830848:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065179.129594:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.129609:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800911e3c00/0x14b4f8542d4fb7ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fddb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.129623:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f8ea00/0x14b4f8542d4fb5de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fca7 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.129629:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a43c600/0x14b4f8542d4fb66a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd10 expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.129636:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356e200/0x14b4f8542d4fb632 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcf4 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.129642:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.129644:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.129646:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800911e3c00/0x14b4f8542d4fb7ac lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2744320->3051519] (req 2744320->3051519) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fddb expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.129669:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009356e200/0x14b4f8542d4fb632 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcf4 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.129679:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009356e200/0x14b4f8542d4fb632 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcf4 expref: 11 pid: 8428 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746065179.129690:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260272384:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065179.129744:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a43c600/0x14b4f8542d4fb66a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd10 expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.129751:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a43c600/0x14b4f8542d4fb66a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd10 expref: 36 pid: 21998 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746065179.129759:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260272512:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065179.129795:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f8ea00/0x14b4f8542d4fb5de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fca7 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.129802:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f8ea00/0x14b4f8542d4fb5de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fca7 expref: 27 pid: 8428 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746065179.129835:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260272640:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065179.129863:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065179.132354:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260272384:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065179.132364:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260272512:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065179.132370:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260272640:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065179.132393:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800911e3c00/0x14b4f8542d4fb7ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2744320->3051519] (req 2744320->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fddb expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.132406:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e3c00, rc 0) 00000100:00100000:1.0:1746065179.132434:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:31487:x1830881262830848:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2844us (3102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.132440:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14092 00000100:00100000:0.0:1746065179.135270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.137709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.138565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.141259:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260272768:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065179.141268:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260272896:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065179.141285:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd4600/0x14b4f8542d4fb7dd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065179.142177:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.142271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.146971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065179.147594:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd4600/0x14b4f8542d4fb7dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.147601:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd4600/0x14b4f8542d4fb7dd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065179.147617:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:1.0:1746065179.147733:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd5200/0x14b4f8542d4fb7d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fde9 expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.147762:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd4600/0x14b4f8542d4fb7dd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fde9 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.147769:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065179.147771:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065179.147773:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcd4600, rc 0) 00000100:00100000:1.0:1746065179.147801:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31488:x1830881262831488:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 12417us (12538us total) trans 8589944036 rc 0/0 00000100:00100000:0.0:1746065179.147803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.147807:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9841 00000100:00100000:0.0:1746065179.150120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.150163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.150222:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262832640 00000100:00100000:1.0:1746065179.150227:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262832640 00000100:00100000:1.0:1746065179.150267:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9842 00000100:00100000:1.0:1746065179.150273:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31488:x1830881262832640:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065179.150287:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.150290:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065179.150307:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd4600/0x14b4f8542d4fb7dd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fde9 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.150320:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065179.150323:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065179.150331:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2400/0x14b4f8542d4fb7eb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fdf7 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.150391:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150400:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150407:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150416:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150421:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150426:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150430:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911e2200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065179.150434:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150439:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150445:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065179.150447:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065179.150449:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150453:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2200/0x14b4f8542d4fb7f2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.150470:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2400/0x14b4f8542d4fb7eb lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdf7 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.150476:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2400/0x14b4f8542d4fb7eb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdf7 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.150482:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e2400, rc 0) 00000100:00100000:1.0:1746065179.150508:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31488:x1830881262832640:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 235us (344us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065179.150514:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9842 00000100:00100000:0.0:1746065179.153424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.153763:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262832896 00000100:00100000:1.0:1746065179.153769:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262832896 00000100:00100000:1.0:1746065179.154190:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4175 00000100:00100000:1.0:1746065179.154197:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31488:x1830881262832896:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065179.154349:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31488:x1830881262832896:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 152us (930us total) trans 8589944037 rc 0/0 00000100:00100000:1.0:1746065179.154354:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4175 00000100:00100000:0.0:1746065179.154556:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.156162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.156249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.156377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.159650:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.160991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.164877:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.166484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.166570:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262834560 00000100:00100000:1.0:1746065179.166575:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262834560 00000100:00100000:1.0:1746065179.166611:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4177 00000100:00100000:1.0:1746065179.166617:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:31490:x1830881262834560:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065179.166762:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:31490:x1830881262834560:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 144us (279us total) trans 8589944039 rc 0/0 00000100:00100000:1.0:1746065179.166767:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4177 00000100:00100000:0.0:1746065179.290285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.354372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.354963:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9844 00000100:00100000:1.0:1746065179.354974:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:31501:x1830881262835072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065179.354995:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.355008:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3000/0x14b4f8542d4fb815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fe05 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.355096:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355111:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355121:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355132:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355136:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355140:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355224:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb82a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355231:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb82a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355236:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb82a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065179.355242:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:1.0:1746065179.355310:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355316:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355321:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355328:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911e2e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065179.355331:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355337:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355346:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065179.355348:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065179.355351:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.355356:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2e00/0x14b4f8542d4fb81c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.361054:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.361066:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.361073:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.361078:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911e2c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065179.361081:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.361087:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.361101:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18e00) 00010000:00010000:1.0:1746065179.361103:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065179.361107:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.361112:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2c00/0x14b4f8542d4fb823 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.361171:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3000/0x14b4f8542d4fb815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe05 expref: 272 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.361181:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb82a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe05 expref: 271 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.361188:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065179.361189:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065179.361191:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e2800, rc 0) 00000100:00100000:1.0:1746065179.361261:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:31501:x1830881262835072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6289us (6898us total) trans 8589944041 rc 0/0 00000100:00100000:1.0:1746065179.361268:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9844 00000100:00100000:0.0:1746065179.376553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.377654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.377688:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.377708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.377744:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262835968 00000100:00100000:0.0:1746065179.377747:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262835968 00010000:00010000:0.0:1746065179.377766:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a43d200/0x14b4f8542d4fb62b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fce6 expref: 11 pid: 25185 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746065179.377785:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262835840 00000100:00100000:0.0:1746065179.377787:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262835840 00010000:00010000:0.0:1746065179.377795:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a43ce00/0x14b4f8542d4fb624 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcd8 expref: 32 pid: 25185 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746065179.377812:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262836096 00000100:00100000:0.0:1746065179.377832:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262836096 00010000:00010000:0.0:1746065179.377853:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb5f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcbc expref: 36 pid: 8428 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065179.377975:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7157 00000100:00100000:0.0:1746065179.377982:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262835968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065179.377990:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065179.378008:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a43d200/0x14b4f8542d4fb62b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fce6 expref: 11 pid: 25185 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746065179.378017:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a43d200/0x14b4f8542d4fb62b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fce6 expref: 11 pid: 25185 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746065179.378033:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065179.378049:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262835968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065179.378061:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7157 00000100:00100000:0.0:1746065179.378076:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7158 00000100:00100000:0.0:1746065179.378081:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881262835840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065179.378086:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065179.378093:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a43ce00/0x14b4f8542d4fb624 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcd8 expref: 32 pid: 25185 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746065179.378105:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a43ce00/0x14b4f8542d4fb624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcd8 expref: 32 pid: 25185 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746065179.378115:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a43ce00/0x14b4f8542d4fb624 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcd8 expref: 32 pid: 25185 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746065179.378127:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065179.378141:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881262835840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065179.378146:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7158 00000100:00100000:0.0:1746065179.378178:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7159 00000100:00100000:0.0:1746065179.378182:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881262836096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065179.378187:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065179.378194:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb5f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcbc expref: 36 pid: 8428 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.378202:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb5f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcbc expref: 36 pid: 8428 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.378212:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133003c00/0x14b4f8542d4fb5f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcbc expref: 36 pid: 8428 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.378221:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065179.378222:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065179.378228:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.378236:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.378260:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065179.378271:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260274176:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065179.378309:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065179.387256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.387879:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260274176:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065179.387896:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065179.387947:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262836096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9762us (10237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.387957:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7159 00000100:00100000:0.0:1746065179.388129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.405255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.407047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.409355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.409420:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262837248 00000100:00100000:1.0:1746065179.409425:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262837248 00000100:00100000:1.0:1746065179.409467:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9845 00000100:00100000:1.0:1746065179.409473:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:31505:x1830881262837248:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065179.409488:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.409503:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3e00/0x14b4f8542d4fb85b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fe2f expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.409585:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409595:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409605:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409614:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409619:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409624:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409709:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb870 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409717:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb870 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409722:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb870 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065179.409729:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:1.0:1746065179.409797:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409803:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409808:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409828:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911e3600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065179.409831:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409845:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409854:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065179.409856:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065179.409860:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409864:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3600/0x14b4f8542d4fb862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409875:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409880:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409883:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409887:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800911e2a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065179.409889:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409893:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409902:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18000) 00010000:00010000:1.0:1746065179.409903:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065179.409905:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409909:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2a00/0x14b4f8542d4fb869 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.409939:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e3e00/0x14b4f8542d4fb85b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe2f expref: 273 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.409948:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb870 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe2f expref: 272 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.409952:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065179.409954:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065179.409956:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800911e2800, rc 0) 00000100:00100000:1.0:1746065179.409990:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:31505:x1830881262837248:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 517us (640us total) trans 8589944042 rc 0/0 00000100:00100000:1.0:1746065179.409995:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9845 00000100:00100000:1.0:1746065179.428347:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.428401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.428421:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262837632 00000100:00100000:1.0:1746065179.428428:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262837632 00000100:00100000:1.0:1746065179.428471:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 733 00000100:00100000:1.0:1746065179.428478:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:1960:x1830881262837632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065179.428489:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065179.428510:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911e2800/0x14b4f8542d4fb870 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe2f expref: 272 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.428527:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065179.428531:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065179.428563:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:1960:x1830881262837632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.428568:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 733 00000100:00100000:0.0:1746065179.429780:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262837504 00000100:00100000:0.0:1746065179.429785:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262837504 00002000:00100000:0.0:1746065179.429812:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1454080->2088959) req@ffff88008fc59500 x1830881262837504/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.432847:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59500 with x1830881262837504 ext(1454080->2088959) 00010000:00010000:0.0:1746065179.432862:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 31 pid: 8851 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.432876:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 31 pid: 8851 timeout: 878 lvb_type: 0 00002000:00010000:0.0:1746065179.432883:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc59500 00000100:00100000:0.0:1746065179.432918:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2417 00000100:00100000:0.0:1746065179.432931:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881262837504:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065179.453048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.459587:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1961:x1830881262837504:12345-192.168.202.46@tcp:4:cat.0 Request processed in 26652us (31238us total) trans 21474840789 rc 0/0 00000100:00100000:0.0:1746065179.459598:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2417 00002000:00100000:0.0:1746065179.459607:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1454080->2088959) req@ffff88008fc59500 x1830881262837504/t21474840789(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/448 e 0 to 0 dl 1746065190 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.459616:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59500 with x1830881262837504 ext(1454080->2088959) 00010000:00010000:0.0:1746065179.459625:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 33 pid: 8851 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.459638:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 33 pid: 8851 timeout: 878 lvb_type: 0 00002000:00010000:0.0:1746065179.459644:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc59500 00000100:00100000:0.0:1746065179.465407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.466053:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262837888 00000100:00100000:1.0:1746065179.466063:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262837888 00010000:00010000:1.0:1746065179.466102:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 33 pid: 8851 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746065179.466150:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7160 00000100:00100000:1.0:1746065179.466158:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881262837888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065179.466170:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065179.466186:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065179 -> 1746065180 00002000:00010000:1.0:1746065179.466188:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065179 -> 1746065180 00010000:00010000:1.0:1746065179.466193:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 33 pid: 8851 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746065179.466203:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 33 pid: 8851 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746065179.466225:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6c00/0x14b4f8542d4fb838 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->2088959) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe0c expref: 33 pid: 8851 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746065179.466254:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.466258:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.466266:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9d7200/0x14b4f8542d4fb854 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe28 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.466275:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9d7200/0x14b4f8542d4fb854 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe28 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.466283:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.466284:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.466288:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4600/0x14b4f8542d4fb87e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe36 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.466294:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4600/0x14b4f8542d4fb87e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe36 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.466326:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4600/0x14b4f8542d4fb87e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe36 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065179.466340:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260274432:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065179.466467:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9d7200/0x14b4f8542d4fb854 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe28 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065179.466475:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260274560:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065179.466492:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065179.472555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.476028:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260274432:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065179.476068:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260274560:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065179.476087:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065179.476131:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:1958:x1830881262837888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9972us (10730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.476141:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7160 00000100:00100000:0.0:1746065179.481026:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.505239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.506386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.507334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.510547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.510610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.515340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.516844:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.516857:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262839424 00000100:00100000:0.0:1746065179.516861:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262839424 00002000:00100000:0.0:1746065179.516876:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094a13b80 x1830881262839424/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.516882:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13b80 with x1830881262839424 ext(2097152->3145727) 00002000:00010000:0.0:1746065179.516885:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a13b80 00000100:00100000:0.0:1746065179.516909:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7916 00000100:00100000:0.0:1746065179.516914:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881262839424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065179.525866:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262840064 00000100:00100000:0.0:1746065179.525872:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262840064 00000100:00100000:0.0:1746065179.525908:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 392 00000100:00100000:0.0:1746065179.525914:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262840064:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:0.0:1746065179.525961:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262840064:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 47us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065179.525966:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 392 00000100:00100000:1.0:1746065179.528691:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881262839424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11770us (11849us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065179.528701:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7916 00002000:00100000:1.0:1746065179.528711:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094a13b80 x1830881262839424/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/440 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.528720:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13b80 with x1830881262839424 ext(2097152->3145727) 00002000:00010000:1.0:1746065179.528725:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a13b80 00000100:00100000:0.0:1746065179.531695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.537382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.543142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.546157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.549854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.550089:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262840960 00000100:00100000:1.0:1746065179.550096:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262840960 00000100:00100000:1.0:1746065179.550145:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4178 00000100:00100000:1.0:1746065179.550151:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:31505:x1830881262840960:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065179.550323:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:31505:x1830881262840960:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 171us (471us total) trans 8589944043 rc 0/0 00000100:00100000:1.0:1746065179.550330:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4178 00000100:00100000:1.0:1746065179.551736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.553422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.570518:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881262841216:12345-192.168.202.46@tcp:4:cat.0 Request processed in 15608us (17097us total) trans 17179873532 rc 0/0 00000100:00100000:0.0:1746065179.570529:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2419 00002000:00100000:0.0:1746065179.571491:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2744320->3051519) req@ffff880094a10380 x1830881262841216/t17179873532(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/448 e 0 to 0 dl 1746065190 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.571508:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10380 with x1830881262841216 ext(2744320->3051519) 00010000:00010000:0.0:1746065179.571518:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800911e3c00/0x14b4f8542d4fb7ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fddb expref: 28 pid: 8428 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.571532:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800911e3c00/0x14b4f8542d4fb7ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fddb expref: 28 pid: 8428 timeout: 878 lvb_type: 0 00002000:00010000:0.0:1746065179.571539:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a10380 00000100:00100000:0.0:1746065179.574450:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.576957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.583042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.583087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.583234:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7920 00000100:00100000:0.0:1746065179.583241:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881262842240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065179.585966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.585987:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262842368 00000100:00100000:0.0:1746065179.585993:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262842368 00000100:00100000:0.0:1746065179.586035:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14105 00000100:00100000:0.0:1746065179.586041:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+32:31508:x1830881262842368:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065179.586055:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065179.586069:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a43d200/0x14b4f8542d4fb8a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fe60 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.586089:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f461000/0x14b4f8542d4fb758 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd9c expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.586100:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800911e3a00/0x14b4f8542d4fb797 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdc6 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065179.586106:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f460e00/0x14b4f8542d4fb75f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fda3 expref: 33 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065179.586111:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065179.586112:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065179.586116:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a43d200/0x14b4f8542d4fb8a8 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [131072->573439] (req 131072->573439) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe60 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.586140:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f460e00/0x14b4f8542d4fb75f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fda3 expref: 33 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065179.586151:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f460e00/0x14b4f8542d4fb75f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fda3 expref: 33 pid: 21998 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746065179.586160:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260275584:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065179.586232:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800911e3a00/0x14b4f8542d4fb797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdc6 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065179.586240:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800911e3a00/0x14b4f8542d4fb797 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdc6 expref: 9 pid: 8428 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746065179.586247:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260275712:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065179.586273:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f461000/0x14b4f8542d4fb758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd9c expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.586280:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f461000/0x14b4f8542d4fb758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd9c expref: 37 pid: 21998 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065179.586287:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260275840:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065179.586302:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065179.595830:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881262842240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12566us (12718us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065179.595849:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7920 00002000:00100000:0.0:1746065179.595860:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a10000 x1830881262842240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/440 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.595868:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10000 with x1830881262842240 ext(2097152->3145727) 00002000:00010000:0.0:1746065179.595874:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10000 00000100:00100000:0.0:1746065179.595918:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.595991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.599984:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.600127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.600169:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.600368:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14107 00000100:00100000:0.0:1746065179.600375:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881262842880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065179.600382:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065179.600389:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fb8b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fe6e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065179.600426:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260275968:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065179.601033:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c780 going to sleep for 11 seconds 00002000:00010000:0.0:1746065179.603223:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065178 -> 1746065180 00000100:00100000:0.0:1746065179.603240:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260275968:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065179.603310:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fb8b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe6e expref: 33 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065179.603322:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fb8b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe6e expref: 33 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065179.603345:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c8c00, rc 0) 00000100:00100000:0.0:1746065179.603380:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+32:1958:x1830881262842880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3006us (3210us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065179.603386:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14107 00000100:00100000:1.0:1746065179.603686:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262843392 00000100:00100000:1.0:1746065179.603691:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262843392 00002000:00100000:1.0:1746065179.603714:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (131072->135167) req@ffff88009baa3100 x1830881262843392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.603721:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3100 with x1830881262843392 ext(131072->135167) 00002000:00010000:1.0:1746065179.603724:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa3100 00000100:00100000:1.0:1746065179.603747:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7921 00000100:00100000:1.0:1746065179.603751:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881262843392:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065179.603802:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262843136 00000100:00100000:0.0:1746065179.603806:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262843136 00000100:00100000:0.0:1746065179.603846:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14108 00000100:00100000:0.0:1746065179.603851:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:31501:x1830881262843136:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065179.603858:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065179.603867:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8400/0x14b4f8542d4fb8bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fe75 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065179.603889:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881262843392:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 137us (354us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065179.603895:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7921 00002000:00100000:1.0:1746065179.603900:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (131072->135167) req@ffff88009baa3100 x1830881262843392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.603906:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3100 with x1830881262843392 ext(131072->135167) 00002000:00010000:1.0:1746065179.603909:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa3100 00010000:00010000:0.0:1746065179.603930:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065179.603932:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065179.603938:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8400/0x14b4f8542d4fb8bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe75 expref: 38 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.603950:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8400/0x14b4f8542d4fb8bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe75 expref: 38 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.603958:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c8400, rc 0) 00000100:00100000:0.0:1746065179.603976:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:31501:x1830881262843136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 125us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065179.603981:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14108 00000100:00100000:0.0:1746065179.605739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.611625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.613419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.613454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.613502:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262844160 00000100:00100000:1.0:1746065179.613508:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262844160 00002000:00100000:1.0:1746065179.613532:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cdc700 x1830881262844160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.613539:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc700 with x1830881262844160 ext(3145728->4194303) 00002000:00010000:1.0:1746065179.613543:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdc700 00000100:00100000:1.0:1746065179.613568:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262844288 00000100:00100000:1.0:1746065179.613570:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262844288 00002000:00100000:1.0:1746065179.613582:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880135cdf800 x1830881262844288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.613588:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf800 with x1830881262844288 ext(3145728->4194303) 00002000:00010000:1.0:1746065179.613591:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf800 00000100:00100000:1.0:1746065179.613612:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7923 00000100:00100000:1.0:1746065179.613618:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881262844160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065179.617586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.629400:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881262844160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15780us (15981us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065179.629411:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7923 00002000:00100000:1.0:1746065179.629418:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cdc700 x1830881262844160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/440 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.629426:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc700 with x1830881262844160 ext(3145728->4194303) 00002000:00010000:1.0:1746065179.629429:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdc700 00000100:00100000:0.0:1746065179.643388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.652510:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.661150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.676769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.676879:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262844928 00000100:00100000:1.0:1746065179.676887:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262844928 00000100:00100000:1.0:1746065179.676946:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9846 00000100:00100000:1.0:1746065179.676955:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31512:x1830881262844928:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065179.676971:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.676990:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fe00/0x14b4f8542d4fb8e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fe9f expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.677037:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.677048:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.677057:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.677068:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.677073:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.677078:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.677170:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e400/0x14b4f8542d4fb8fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.677180:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fb807 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdfe expref: 24 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.677185:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e400/0x14b4f8542d4fb8fc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065179.677210:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fb807 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdfe expref: 24 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.677219:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fb807 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdfe expref: 24 pid: 20754 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746065179.677228:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260276864:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065179.677296:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065179.677900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.681120:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260276864:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065179.681142:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e400/0x14b4f8542d4fb8fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065179.686717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065179.687387:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e400/0x14b4f8542d4fb8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687393:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e400/0x14b4f8542d4fb8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065179.687427:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00000004:00200000:0.0:1746065179.687430:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065179.687441:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e400/0x14b4f8542d4fb8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687448:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e400/0x14b4f8542d4fb8fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687456:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687460:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687465:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687469:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c9fa00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065179.687472:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687476:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687483:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065179.687485:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065179.687488:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687491:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fa00/0x14b4f8542d4fb8ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687501:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687505:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687509:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687513:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c9e000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065179.687515:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687519:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687523:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18600) 00010000:00010000:0.0:1746065179.687524:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065179.687526:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687529:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e000/0x14b4f8542d4fb8f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065179.687552:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9fe00/0x14b4f8542d4fb8e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe9f expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.687560:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c9e400/0x14b4f8542d4fb8fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe9f expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.687565:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065179.687566:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065179.687568:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c9e400, rc 0) 00000100:00100000:0.0:1746065179.687588:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:31512:x1830881262844928:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 10635us (10828us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065179.687593:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9846 00000100:00100000:0.0:1746065179.689423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.691272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.691301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.691325:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.691360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.691375:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262845952 00000100:00100000:0.0:1746065179.691380:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262845952 00000100:00100000:0.0:1746065179.691407:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262846208 00000100:00100000:0.0:1746065179.691409:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262846208 00000100:00100000:0.0:1746065179.691418:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262846080 00000100:00100000:0.0:1746065179.691419:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262846080 00000100:00100000:0.0:1746065179.691427:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262846336 00000100:00100000:0.0:1746065179.691428:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262846336 00000100:00100000:0.0:1746065179.691440:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14114 00000100:00100000:0.0:1746065179.691445:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262845952:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065179.691454:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065179.691463:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4800/0x14b4f8542d4fb926 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fead expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065179.691501:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260276992:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065179.691552:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065179.691565:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14116 00000100:00100000:0.0:1746065179.691569:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881262846080:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065179.691574:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065179.691579:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4200/0x14b4f8542d4fb934 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5feb4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065179.691598:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260277120:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065179.691614:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065179.693144:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260276992:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065179.693157:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4800/0x14b4f8542d4fb926 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fead expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.693165:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4800/0x14b4f8542d4fb926 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fead expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.693187:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d8f4800, rc 0) 00000100:00100000:1.0:1746065179.693216:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262845952:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1770us (1946us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065179.693221:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14114 00000100:00100000:0.0:1746065179.699560:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262846720 00000100:00100000:0.0:1746065179.699564:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262846720 00000100:00100000:0.0:1746065179.699586:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14118 00000100:00100000:0.0:1746065179.699591:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:31514:x1830881262846720:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065179.699601:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065179.699613:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4e00/0x14b4f8542d4fb942 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5fed0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699636:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5200/0x14b4f8542d4fb893 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe4b expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699643:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6600/0x14b4f8542d4fb92d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5febb expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065179.699650:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8400/0x14b4f8542d4fb8bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe75 expref: 39 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699656:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f8f200/0x14b4f8542d4fb598 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc7d expref: 31 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699662:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5e00/0x14b4f8542d4fb88c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe3d expref: 39 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699667:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065179.699669:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065179.699672:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4e00/0x14b4f8542d4fb942 lrc: 8/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2461696->2695167] (req 2461696->2695167) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fed0 expref: 39 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699697:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5e00/0x14b4f8542d4fb88c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe3d expref: 39 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699707:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5e00/0x14b4f8542d4fb88c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe3d expref: 39 pid: 8851 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065179.699719:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260277248:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065179.699780:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f8f200/0x14b4f8542d4fb598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc7d expref: 31 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699787:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f8f200/0x14b4f8542d4fb598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc7d expref: 31 pid: 2462 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065179.699795:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260277376:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065179.699839:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8400/0x14b4f8542d4fb8bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe75 expref: 39 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699847:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8400/0x14b4f8542d4fb8bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe75 expref: 39 pid: 25185 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065179.699853:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260277504:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065179.699879:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6600/0x14b4f8542d4fb92d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5febb expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065179.699886:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9d6600/0x14b4f8542d4fb92d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5febb expref: 9 pid: 2463 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746065179.699897:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260277632:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065179.699914:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5200/0x14b4f8542d4fb893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe4b expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065179.699920:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5200/0x14b4f8542d4fb893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe4b expref: 31 pid: 8851 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746065179.699926:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260277760:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065179.699938:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065179.702884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.702919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.703012:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262846976 00000100:00100000:1.0:1746065179.703017:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262846976 00010000:00010000:1.0:1746065179.703043:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f8f200/0x14b4f8542d4fb598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc7d expref: 32 pid: 2462 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746065179.703062:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262846848 00000100:00100000:1.0:1746065179.703064:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262846848 00010000:00010000:1.0:1746065179.703071:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5e00/0x14b4f8542d4fb88c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe3d expref: 40 pid: 8851 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746065179.703083:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7169 00000100:00100000:1.0:1746065179.703088:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881262846976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065179.703096:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065179.703111:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f8f200/0x14b4f8542d4fb598 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc7d expref: 32 pid: 2462 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746065179.703119:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f8f200/0x14b4f8542d4fb598 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc7d expref: 32 pid: 2462 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746065179.703136:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f8f200/0x14b4f8542d4fb598 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fc7d expref: 32 pid: 2462 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746065179.703153:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065179.703178:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881262846976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.703183:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7169 00000100:00100000:0.0:1746065179.708081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.709893:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.709951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.712078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.712113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.712449:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7174 00000100:00100000:0.0:1746065179.712455:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:1960:x1830881262847360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065179.712464:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065179.712469:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd5c00/0x14b4f8542d4fb918 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fea6 expref: 275 pid: 20754 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.712478:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd5c00/0x14b4f8542d4fb918 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fea6 expref: 275 pid: 20754 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.712493:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd5c00/0x14b4f8542d4fb918 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fea6 expref: 275 pid: 20754 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746065179.712517:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065179.712521:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fb950 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.712527:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fb950 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.712533:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fb950 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065179.712548:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065179.712953:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:1960:x1830881262847360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 497us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065179.712959:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7174 00000100:00100000:0.0:1746065179.717385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.717535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.717948:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262848128 00000100:00100000:0.0:1746065179.717952:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262848128 00002000:00100000:0.0:1746065179.717974:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2461696->2465791) req@ffff88012b45df80 x1830881262848128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.717982:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45df80 with x1830881262848128 ext(2461696->2465791) 00002000:00010000:0.0:1746065179.717985:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45df80 00000100:00100000:0.0:1746065179.717996:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7925 00000100:00100000:0.0:1746065179.718001:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881262848128:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065179.718118:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881262848128:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 116us (582us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065179.718126:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7925 00002000:00100000:0.0:1746065179.718131:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2461696->2465791) req@ffff88012b45df80 x1830881262848128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.718137:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45df80 with x1830881262848128 ext(2461696->2465791) 00002000:00010000:0.0:1746065179.718139:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45df80 00000100:00100000:0.0:1746065179.720912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.724801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.725049:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262848640 00000100:00100000:1.0:1746065179.725057:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262848640 00002000:00100000:1.0:1746065179.725090:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2691072->2695167) req@ffff88012b45ea00 x1830881262848640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.725099:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881262848640 ext(2691072->2695167) 00002000:00010000:1.0:1746065179.725104:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:1.0:1746065179.725133:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7926 00000100:00100000:1.0:1746065179.725140:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881262848640:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065179.725276:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881262848640:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 135us (480us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065179.725282:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7926 00002000:00100000:1.0:1746065179.725287:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2691072->2695167) req@ffff88012b45ea00 x1830881262848640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.725293:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ea00 with x1830881262848640 ext(2691072->2695167) 00002000:00010000:1.0:1746065179.725295:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ea00 00000100:00100000:1.0:1746065179.732874:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262848896 00000100:00100000:1.0:1746065179.732882:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262848896 00000100:00100000:1.0:1746065179.733309:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4182 00000100:00100000:1.0:1746065179.733317:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:31514:x1830881262848896:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065179.733507:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:31514:x1830881262848896:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 190us (1253us total) trans 8589944049 rc 0/0 00000100:00100000:1.0:1746065179.733513:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4182 00000100:00100000:0.0:1746065179.747030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.772879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.774632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.780218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.799693:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.839213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.843803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.857709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.857752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.857781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.857812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.862992:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881262849920:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 23523us (23779us total) trans 21474840791 rc 0/0 00000100:00100000:1.0:1746065179.863004:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2420 00002000:00100000:1.0:1746065179.863013:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1306624->1863679) req@ffff88012b45ce00 x1830881262849920/t21474840791(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:95/0 lens 488/448 e 0 to 0 dl 1746065190 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.863022:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ce00 with x1830881262849920 ext(1306624->1863679) 00010000:00010000:1.0:1746065179.863030:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f9d7c00/0x14b4f8542d4fb885 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe44 expref: 44 pid: 9716 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065179.863043:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f9d7c00/0x14b4f8542d4fb885 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe44 expref: 44 pid: 9716 timeout: 879 lvb_type: 0 00002000:00010000:1.0:1746065179.863049:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45ce00 00000100:00100000:0.0:1746065179.872458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.879515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.882003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.882052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.882118:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262851328 00000100:00100000:1.0:1746065179.882126:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262851328 00000100:00100000:1.0:1746065179.882159:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14126 00000100:00100000:1.0:1746065179.882167:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+28:31518:x1830881262851328:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065179.882182:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.882197:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb9f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff24 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.882219:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4400/0x14b4f8542d4fb89a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe52 expref: 36 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.882226:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f9d7600/0x14b4f8542d4fb93b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fec2 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.882231:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4e00/0x14b4f8542d4fb8a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe59 expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.882236:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.882237:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.882240:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb9f8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2326528->2953215] (req 2326528->2953215) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff24 expref: 29 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.882264:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4e00/0x14b4f8542d4fb8a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe59 expref: 29 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.882273:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4e00/0x14b4f8542d4fb8a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe59 expref: 29 pid: 8851 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065179.882288:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260279040:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065179.882342:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f9d7600/0x14b4f8542d4fb93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fec2 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065179.882349:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f9d7600/0x14b4f8542d4fb93b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fec2 expref: 11 pid: 2463 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746065179.882357:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260279168:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065179.882395:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4400/0x14b4f8542d4fb89a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe52 expref: 36 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.882401:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4400/0x14b4f8542d4fb89a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe52 expref: 36 pid: 8851 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065179.882408:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260279296:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065179.882421:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065179.882994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.883800:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262851712 00000100:00100000:1.0:1746065179.883805:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262851712 00002000:00100000:1.0:1746065179.883865:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009c7ad500 x1830881262851712/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065179.883874:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ad500 with x1830881262851712 ext(1048576->2097151) 00002000:00010000:1.0:1746065179.883878:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ad500 00000100:00100000:1.0:1746065179.883893:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7928 00000100:00100000:1.0:1746065179.883899:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881262851712:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065179.889555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.891483:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260279040:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065179.891492:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260279168:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065179.891499:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260279296:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065179.891522:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb9f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2326528->2953215] (req 2326528->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff24 expref: 29 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.891538:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c9ec00, rc 0) 00000100:00100000:1.0:1746065179.891576:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:31518:x1830881262851328:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9409us (9578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.891583:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14126 00000100:00100000:0.0:1746065179.895254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.895678:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262851968 00000100:00100000:1.0:1746065179.895686:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262851968 00010000:00010000:1.0:1746065179.895721:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4e00/0x14b4f8542d4fb8a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe59 expref: 29 pid: 8851 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065179.895798:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7177 00000100:00100000:1.0:1746065179.895805:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881262851968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065179.895841:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065179.895863:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4e00/0x14b4f8542d4fb8a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe59 expref: 29 pid: 8851 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065179.895873:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4e00/0x14b4f8542d4fb8a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe59 expref: 29 pid: 8851 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065179.895894:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4e00/0x14b4f8542d4fb8a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fe59 expref: 29 pid: 8851 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065179.895912:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065179.895951:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881262851968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 146us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.895957:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7177 00000100:00100000:0.0:1746065179.898183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.898211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.903435:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881262851712:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 19527us (20432us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065179.903445:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7928 00002000:00100000:0.0:1746065179.903455:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009c7ad500 x1830881262851712/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/440 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.903463:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ad500 with x1830881262851712 ext(1048576->2097151) 00002000:00010000:0.0:1746065179.903469:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ad500 00000100:00100000:0.0:1746065179.903753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.903767:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262852480 00000100:00100000:0.0:1746065179.903773:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262852480 00002000:00100000:0.0:1746065179.903801:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2326528->2330623) req@ffff88009c7af100 x1830881262852480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/0 e 0 to 0 dl 1746065190 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.903807:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af100 with x1830881262852480 ext(2326528->2330623) 00002000:00010000:0.0:1746065179.903810:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7af100 00000100:00100000:0.0:1746065179.903848:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7929 00000100:00100000:0.0:1746065179.903855:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881262852480:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065179.903960:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881262852480:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 105us (206us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065179.903965:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7929 00002000:00100000:0.0:1746065179.903970:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2326528->2330623) req@ffff88009c7af100 x1830881262852480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746065190 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065179.903976:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af100 with x1830881262852480 ext(2326528->2330623) 00002000:00010000:0.0:1746065179.903979:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7af100 00000100:00100000:0.0:1746065179.912767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.912863:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262852608 00000100:00100000:1.0:1746065179.912871:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262852608 00000100:00100000:1.0:1746065179.913484:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14127 00000100:00100000:1.0:1746065179.913492:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+33:31522:x1830881262852608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065179.913507:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.913522:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd30a00/0x14b4f8542d4fb9ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff2b expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.913545:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4e00/0x14b4f8542d4fb942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2461696->4194303] (req 2461696->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fed0 expref: 38 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.913551:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065179.913553:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065179.913556:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd30a00/0x14b4f8542d4fb9ff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff2b expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.913581:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4e00/0x14b4f8542d4fb942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2461696->4194303] (req 2461696->2695167) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fed0 expref: 38 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.913590:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d8f4e00/0x14b4f8542d4fb942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2461696->4194303] (req 2461696->2695167) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fed0 expref: 38 pid: 8428 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065179.913600:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260279552:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065179.915274:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065179.923524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.923566:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.924099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.924301:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260279552:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065179.924325:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd30a00/0x14b4f8542d4fb9ff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff2b expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.924342:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd30a00, rc 0) 00000100:00100000:1.0:1746065179.924379:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+34:31522:x1830881262852608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10888us (11622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.924386:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14127 00000100:00100000:0.0:1746065179.933918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.935077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.952365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.953668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.953693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.953720:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065179.978260:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262854656 00000100:00100000:1.0:1746065179.978266:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262854656 00000100:00100000:1.0:1746065179.978307:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14128 00000100:00100000:1.0:1746065179.978313:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:31525:x1830881262854656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065179.978326:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065179.978340:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fba06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff32 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.978359:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.978361:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065179.978367:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fba06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff32 expref: 41 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.978379:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fba06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff32 expref: 41 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065179.978388:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b4f800, rc 0) 00000100:00100000:1.0:1746065179.978405:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:31525:x1830881262854656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 93us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065179.978410:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14128 00000100:00100000:0.0:1746065179.991574:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.997150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065179.999960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.000884:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262855168 00000100:00100000:1.0:1746065180.000891:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262855168 00000100:00100000:1.0:1746065180.000943:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14130 00000100:00100000:1.0:1746065180.000951:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881262855168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065180.000968:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.000983:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff40 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.001001:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.001002:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.001010:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.001024:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.001034:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b4e400, rc 0) 00000100:00100000:1.0:1746065180.001085:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+34:1958:x1830881262855168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 134us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.001091:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14130 00000100:00100000:0.0:1746065180.004124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.012038:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.012706:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.016121:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.016379:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262855680 00000100:00100000:1.0:1746065180.016387:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262855680 00000100:00100000:1.0:1746065180.016434:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14133 00000100:00100000:1.0:1746065180.016441:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1959:x1830881262855680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065180.016456:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.016472:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b4e200/0x14b4f8542d4fba29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff55 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.016495:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b4e200/0x14b4f8542d4fba29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff55 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.016505:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b4e200/0x14b4f8542d4fba29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff55 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.016516:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b4e200, rc 0) 00000100:00100000:1.0:1746065180.016552:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1959:x1830881262855680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 112us (438us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065180.016557:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14133 00000100:00100000:0.0:1746065180.019616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.021377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.025241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.034036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.043477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.054075:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881262856448:12345-192.168.202.46@tcp:4:cat.0 Request processed in 19704us (20035us total) trans 17179873533 rc 0/0 00000100:00100000:0.0:1746065180.054086:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2423 00002000:00100000:0.0:1746065180.054097:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2326528->2953215) req@ffff88008fc59880 x1830881262856448/t17179873533(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:96/0 lens 488/448 e 0 to 0 dl 1746065191 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.054107:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59880 with x1830881262856448 ext(2326528->2953215) 00010000:00010000:0.0:1746065180.054116:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2326528->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff24 expref: 30 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.054130:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093c9ec00/0x14b4f8542d4fb9f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2326528->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff24 expref: 30 pid: 25185 timeout: 879 lvb_type: 0 00002000:00010000:0.0:1746065180.054136:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc59880 00000100:00100000:0.0:1746065180.061904:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.101916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.101955:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262856960 00000100:00100000:0.0:1746065180.101964:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262856960 00002000:00100000:0.0:1746065180.102009:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880129b0f100 x1830881262856960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/0 e 0 to 0 dl 1746065191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.102018:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f100 with x1830881262856960 ext(2097152->3145727) 00002000:00010000:0.0:1746065180.102023:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f100 00000100:00100000:0.0:1746065180.102049:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7939 00000100:00100000:0.0:1746065180.102058:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881262856960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065180.115197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.115222:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262857216 00000100:00100000:0.0:1746065180.115228:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262857216 00002000:00100000:0.0:1746065180.115256:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3665920->3670015) req@ffff880129b0f480 x1830881262857216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/0 e 0 to 0 dl 1746065191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.115265:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f480 with x1830881262857216 ext(3665920->3670015) 00002000:00010000:0.0:1746065180.115269:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f480 00000100:00100000:0.0:1746065180.115285:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7940 00000100:00100000:0.0:1746065180.115290:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1959:x1830881262857216:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065180.115404:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1959:x1830881262857216:12345-192.168.202.46@tcp:3:cat.0 Request processed in 113us (212us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065180.115409:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7940 00002000:00100000:0.0:1746065180.115413:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3665920->3670015) req@ffff880129b0f480 x1830881262857216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/4536 e 0 to 0 dl 1746065191 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.115421:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f480 with x1830881262857216 ext(3665920->3670015) 00002000:00010000:0.0:1746065180.115423:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f480 00000100:00100000:0.0:1746065180.117530:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.118315:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881262856960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16257us (16405us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065180.118322:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7939 00002000:00100000:0.0:1746065180.118331:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880129b0f100 x1830881262856960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/440 e 0 to 0 dl 1746065191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.118340:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f100 with x1830881262856960 ext(2097152->3145727) 00002000:00010000:0.0:1746065180.118344:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f100 00000100:00100000:0.0:1746065180.144013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.144042:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262857600 00000100:00100000:0.0:1746065180.144049:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262857600 00000100:00100000:0.0:1746065180.144080:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14136 00000100:00100000:0.0:1746065180.144086:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:31525:x1830881262857600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065180.144099:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065180.144113:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff6a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.144138:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.144146:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065180.144147:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065180.144150:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff6a expref: 44 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.144171:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 44 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.144180:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 44 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.144190:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260280576:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065180.144244:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065180.145680:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260280576:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065180.145699:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff6a expref: 44 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.145710:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092774000, rc 0) 00000100:00100000:0.0:1746065180.145736:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:31525:x1830881262857600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1649us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.145742:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14136 00000100:00100000:0.0:1746065180.147181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.147202:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262857728 00000100:00100000:0.0:1746065180.147207:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262857728 00002000:00100000:0.0:1746065180.148555:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3993600->4194303) req@ffff880129b0dc00 x1830881262857728/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/0 e 0 to 0 dl 1746065191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.148565:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0dc00 with x1830881262857728 ext(3993600->4194303) 00010000:00010000:0.0:1746065180.148572:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 44 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.148584:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 44 pid: 21998 timeout: 879 lvb_type: 0 00002000:00010000:0.0:1746065180.148590:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129b0dc00 00000100:00100000:0.0:1746065180.148782:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2424 00000100:00100000:0.0:1746065180.148789:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881262857728:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065180.161206:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1960:x1830881262857728:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12409us (14020us total) trans 21474840794 rc 0/0 00000100:00100000:0.0:1746065180.161216:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2424 00002000:00100000:0.0:1746065180.161226:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3993600->4194303) req@ffff880129b0dc00 x1830881262857728/t21474840794(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/448 e 0 to 0 dl 1746065191 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.161234:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0dc00 with x1830881262857728 ext(3993600->4194303) 00010000:00010000:0.0:1746065180.161242:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 46 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.161254:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 46 pid: 21998 timeout: 879 lvb_type: 0 00002000:00010000:0.0:1746065180.161259:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129b0dc00 00000100:00100000:0.0:1746065180.173186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.173224:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262857856 00000100:00100000:0.0:1746065180.173231:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262857856 00010000:00010000:0.0:1746065180.173256:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 46 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.173277:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7184 00000100:00100000:0.0:1746065180.173283:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1959:x1830881262857856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065180.173293:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065180.173306:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065180 -> 1746065181 00002000:00010000:0.0:1746065180.173309:0:15963:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065179 -> 1746065180 00002000:00010000:0.0:1746065180.173310:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065178 -> 1746065180 00010000:00010000:0.0:1746065180.173315:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 46 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.173324:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 46 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.173341:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5600/0x14b4f8542d4fba0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff39 expref: 46 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.173351:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.173352:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.174946:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff6a expref: 45 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.174958:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff6a expref: 45 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.175041:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff6a expref: 45 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065180.175052:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260280704:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065180.175347:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065180.190006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.190028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.190065:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260280704:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065180.190078:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.190110:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1959:x1830881262857856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 16827us (16930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.190119:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7184 00000100:00100000:0.0:1746065180.190150:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262858240 00000100:00100000:0.0:1746065180.190155:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262858240 00002000:00100000:0.0:1746065180.190179:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880129b0e680 x1830881262858240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/0 e 0 to 0 dl 1746065191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.190188:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0e680 with x1830881262858240 ext(3145728->4194303) 00002000:00010000:0.0:1746065180.190192:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0e680 00000100:00100000:0.0:1746065180.190202:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262858368 00000100:00100000:0.0:1746065180.190204:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262858368 00002000:00100000:0.0:1746065180.190213:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3670016->4194303) req@ffff880129b0c000 x1830881262858368/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/0 e 0 to 0 dl 1746065191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.190224:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c000 with x1830881262858368 ext(3670016->4194303) 00002000:00010000:0.0:1746065180.190227:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0c000 00000100:00100000:0.0:1746065180.190238:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7941 00000100:00100000:0.0:1746065180.190244:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1959:x1830881262858240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065180.190287:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7942 00000100:00100000:0.0:1746065180.190292:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881262858368:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065180.207950:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881262858368:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17656us (17919us total) trans 0 rc 524288/524288 00000100:00100000:0.0:1746065180.207957:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7942 00002000:00100000:0.0:1746065180.207962:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3670016->4194303) req@ffff880129b0c000 x1830881262858368/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:96/0 lens 488/440 e 0 to 0 dl 1746065191 ref 1 fl Complete:/200/0 rc 524288/524288 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065180.207969:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c000 with x1830881262858368 ext(3670016->4194303) 00002000:00010000:0.0:1746065180.207972:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0c000 00000100:00100000:0.0:1746065180.219701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.219725:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262858496 00000100:00100000:0.0:1746065180.219732:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262858496 00000100:00100000:0.0:1746065180.219763:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14137 00000100:00100000:0.0:1746065180.219771:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881262858496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065180.219785:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065180.219798:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d11dc00/0x14b4f8542d4fba45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff71 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065180.219872:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260280832:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065180.219935:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59e40 going to sleep for 11 seconds 00002000:00010000:1.0:1746065180.225722:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime: 1746065180 -> 1746065181 00002000:00010000:1.0:1746065180.225729:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065180 -> 1746065181 00002000:00010000:1.0:1746065180.225730:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime: 1746065180 -> 1746065181 00000100:00100000:1.0:1746065180.225934:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260280832:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065180.225962:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d11dc00/0x14b4f8542d4fba45 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff71 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.226094:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d11dc00/0x14b4f8542d4fba45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff71 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.226107:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d11dc00, rc 0) 00000100:00100000:1.0:1746065180.226327:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881262858496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6554us (6629us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065180.226334:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14137 00000100:00100000:1.0:1746065180.244959:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262858624 00000100:00100000:1.0:1746065180.244967:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262858624 00000100:00100000:1.0:1746065180.245002:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14138 00000100:00100000:1.0:1746065180.245008:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881262858624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065180.245022:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.245034:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1c000/0x14b4f8542d4fba4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff78 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065180.245079:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260280960:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065180.245264:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065180.247792:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260280960:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065180.248163:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1c000/0x14b4f8542d4fba4c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff78 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.248177:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1c000/0x14b4f8542d4fba4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff78 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.248187:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1c000, rc 0) 00000100:00100000:0.0:1746065180.248235:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881262858624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3226us (4325us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065180.248242:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14138 00000100:00100000:0.0:1746065180.258890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.259054:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262858752 00000100:00100000:1.0:1746065180.259063:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262858752 00000100:00100000:1.0:1746065180.259095:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14139 00000100:00100000:1.0:1746065180.259101:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881262858752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065180.259115:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.259128:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1ce00/0x14b4f8542d4fba53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff7f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065180.259506:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260281088:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065180.259572:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5425780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065180.261425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.261648:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262858880 00000100:00100000:1.0:1746065180.261654:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262858880 00000100:00100000:1.0:1746065180.261684:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14140 00000100:00100000:1.0:1746065180.261690:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+9:31532:x1830881262858880:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065180.261702:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.262598:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1da00/0x14b4f8542d4fba5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff86 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.262623:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fba22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff4e expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.262632:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff6a expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.262638:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065180.262640:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065180.262643:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1da00/0x14b4f8542d4fba5a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3051520->3145727] (req 3051520->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff86 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.262668:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff6a expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.262679:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4fba3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff6a expref: 16 pid: 8851 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.262690:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260281216:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065180.262751:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fba22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff4e expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.262759:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fba22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff4e expref: 16 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.262766:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260281344:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065180.262783:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a55bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065180.262853:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260281088:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065180.262873:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1ce00/0x14b4f8542d4fba53 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff7f expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.262884:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1ce00/0x14b4f8542d4fba53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff7f expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.262896:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1ce00, rc 0) 00000100:00100000:1.0:1746065180.262916:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881262858752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3815us (4105us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065180.262922:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14139 00000100:00100000:0.0:1746065180.263335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.263520:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262859008 00000100:00100000:1.0:1746065180.263524:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262859008 00000100:00100000:1.0:1746065180.263662:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14141 00000100:00100000:1.0:1746065180.263667:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262859008:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065180.263676:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.263682:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fba61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff8d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.263692:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.263696:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fba61 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff8d expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.263703:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fba61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff8d expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.263709:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1d600, rc 0) 00000100:00100000:1.0:1746065180.263854:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262859008:12345-192.168.202.46@tcp:101:cat.0 Request processed in 186us (518us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065180.263861:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14141 00000100:00100000:1.0:1746065180.267976:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260281216:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065180.267987:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260281344:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065180.268013:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1da00/0x14b4f8542d4fba5a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3051520->3145727] (req 3051520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff86 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.268027:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1da00, rc 0) 00000100:00100000:1.0:1746065180.268088:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+10:31532:x1830881262858880:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6397us (6666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.268095:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14140 00000100:00100000:1.0:1746065180.268594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.268625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.268641:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262859136 00000100:00100000:1.0:1746065180.268646:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262859136 00000100:00100000:1.0:1746065180.268672:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14142 00000100:00100000:1.0:1746065180.268678:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+7:1961:x1830881262859136:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065180.268691:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.268703:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1dc00/0x14b4f8542d4fba68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ff94 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065180.268740:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260281472:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065180.268779:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a55bae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065180.268934:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262859264 00000100:00100000:0.0:1746065180.268938:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262859264 00010000:00010000:0.0:1746065180.268954:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fba22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff4e expref: 17 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.268980:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7185 00000100:00100000:0.0:1746065180.268986:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881262859264:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065180.268993:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065180.269009:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fba22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff4e expref: 17 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.269018:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fba22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff4e expref: 17 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.269034:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd4a00/0x14b4f8542d4fba22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff4e expref: 17 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.269047:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.269064:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881262859264:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.269069:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7185 00000100:00100000:0.0:1746065180.272014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.272083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.272560:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260281472:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065180.272579:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1dc00/0x14b4f8542d4fba68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff94 expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.272588:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1dc00/0x14b4f8542d4fba68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff94 expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.272595:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1dc00, rc 0) 00000100:00100000:1.0:1746065180.272620:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+7:1961:x1830881262859136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3942us (3993us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065180.272625:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14142 00000100:00100000:0.0:1746065180.287467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.289714:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.289755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.289761:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262860544 00000100:00100000:1.0:1746065180.289767:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262860544 00000100:00100000:0.0:1746065180.289807:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14143 00000100:00100000:0.0:1746065180.289850:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+7:31532:x1830881262860544:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065180.289861:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065180.289877:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ffa2 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.289898:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fba37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff63 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.289905:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065180.289906:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065180.289909:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->2863103] (req 2097152->2863103) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.289931:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fba37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff63 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.289946:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fba37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff63 expref: 21 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.289957:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260281728:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065180.289993:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065180.291590:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260281728:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065180.291609:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->2863103] (req 2097152->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.291619:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcd4200, rc 0) 00000100:00100000:1.0:1746065180.291653:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:31532:x1830881262860544:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1839us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.291658:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14143 00000100:00100000:0.0:1746065180.292639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.292698:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262860800 00000100:00100000:1.0:1746065180.292704:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262860800 00010000:00010000:1.0:1746065180.292721:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fba37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff63 expref: 22 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.292750:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7187 00000100:00100000:1.0:1746065180.292756:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262860800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.292767:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.292782:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fba37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff63 expref: 22 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.292791:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fba37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff63 expref: 22 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.292807:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fba37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff63 expref: 22 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.292838:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.292840:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.292846:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.292852:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.292874:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065180.292888:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260281856:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065180.292950:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a55bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065180.295430:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260281856:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065180.295448:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.295478:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881262860800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2721us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.295489:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7187 00000100:00100000:0.0:1746065180.305097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.313078:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262861184 00000100:00100000:1.0:1746065180.313086:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262861184 00000100:00100000:1.0:1746065180.313133:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14144 00000100:00100000:1.0:1746065180.313140:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:31538:x1830881262861184:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065180.313155:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.313170:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1ce00/0x14b4f8542d4fba99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ffa9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.313195:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f8fc00/0x14b4f8542d4fb392 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb5e expref: 9 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.313202:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356fc00/0x14b4f8542d4fb6c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd41 expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.313208:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065180.313209:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065180.313212:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1ce00/0x14b4f8542d4fba99 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->4452351] (req 4194304->4452351) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa9 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.313239:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356fc00/0x14b4f8542d4fb6c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd41 expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.313249:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356fc00/0x14b4f8542d4fb6c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd41 expref: 16 pid: 8428 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.313259:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260281984:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065180.315002:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f8fc00/0x14b4f8542d4fb392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb5e expref: 9 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.315016:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f8fc00/0x14b4f8542d4fb392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb5e expref: 9 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.315028:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260282112:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065180.315440:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a55bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065180.315797:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260281984:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065180.316092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.316612:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262861312 00000100:00100000:1.0:1746065180.316617:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262861312 00010000:00010000:1.0:1746065180.316641:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009356fc00/0x14b4f8542d4fb6c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd41 expref: 16 pid: 8428 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.316660:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7188 00000100:00100000:1.0:1746065180.316666:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881262861312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.316676:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.316694:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009356fc00/0x14b4f8542d4fb6c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd41 expref: 16 pid: 8428 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.316703:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009356fc00/0x14b4f8542d4fb6c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd41 expref: 16 pid: 8428 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.316721:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356fc00/0x14b4f8542d4fb6c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fd41 expref: 16 pid: 8428 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.316738:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.316757:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881262861312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.316763:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7188 00000100:00100000:0.0:1746065180.318141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.322251:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.322283:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.322397:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14146 00000100:00100000:0.0:1746065180.322405:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:1958:x1830881262861696:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065180.322413:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065180.322422:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fbaa7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ffb7 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065180.322454:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f49ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260282496:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065180.322719:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065180.324300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.326885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.327069:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f49ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260282496:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065180.327086:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fbaa7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffb7 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.327095:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5a00/0x14b4f8542d4fbaa7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffb7 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.327106:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcd5a00, rc 0) 00000100:00100000:1.0:1746065180.327126:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:1958:x1830881262861696:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4722us (4842us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065180.327131:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14146 00000100:00100000:0.0:1746065180.331178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.331322:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262862336 00000100:00100000:1.0:1746065180.331329:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262862336 00000100:00100000:1.0:1746065180.331377:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14147 00000100:00100000:1.0:1746065180.331384:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:31537:x1830881262862336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065180.331398:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.331412:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1c200/0x14b4f8542d4fbaae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ffbe expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.331437:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1da00/0x14b4f8542d4fba5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3051520->4194303] (req 3051520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff86 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.331444:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065180.331446:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065180.331448:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1c200/0x14b4f8542d4fbaae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffbe expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.331475:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1da00/0x14b4f8542d4fba5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3051520->4194303] (req 3051520->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff86 expref: 10 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.331486:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1da00/0x14b4f8542d4fba5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3051520->4194303] (req 3051520->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff86 expref: 10 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.331496:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260282624:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065180.331569:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a55bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065180.332965:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260282624:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065180.332988:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1c200/0x14b4f8542d4fbaae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffbe expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.333001:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1c200, rc 0) 00000100:00100000:1.0:1746065180.333028:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:31537:x1830881262862336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1644us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.333035:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14147 00000100:00100000:0.0:1746065180.333376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.339308:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.343408:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260282752:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065180.343427:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.343474:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881262862592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3889us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.343483:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7190 00000100:00100000:0.0:1746065180.346905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.349610:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.350396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.350490:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262863104 00000100:00100000:1.0:1746065180.350498:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262863104 00002000:00100000:1.0:1746065180.350528:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba3c380 x1830881262863104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:96/0 lens 488/0 e 0 to 0 dl 1746065191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065180.350542:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c380 with x1830881262863104 ext(3145728->4194303) 00002000:00010000:1.0:1746065180.350546:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3c380 00000100:00100000:1.0:1746065180.350560:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262863360 00000100:00100000:1.0:1746065180.350562:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262863360 00002000:00100000:1.0:1746065180.350573:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2863104->3145727) req@ffff88009ba3d500 x1830881262863360/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:96/0 lens 488/0 e 0 to 0 dl 1746065191 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065180.350579:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d500 with x1830881262863360 ext(2863104->3145727) 00002000:00010000:1.0:1746065180.350582:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3d500 00000100:00100000:1.0:1746065180.350592:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7948 00000100:00100000:1.0:1746065180.350598:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881262863104:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065180.351099:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7949 00000100:00100000:0.0:1746065180.351106:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881262863360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065180.361349:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262863104:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10743us (11736us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065180.361358:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7948 00002000:00100000:1.0:1746065180.361367:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba3c380 x1830881262863104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:96/0 lens 488/440 e 0 to 0 dl 1746065191 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065180.361374:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c380 with x1830881262863104 ext(3145728->4194303) 00002000:00010000:1.0:1746065180.361378:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3c380 00000100:00100000:0.0:1746065180.370068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.370233:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262863488 00000100:00100000:1.0:1746065180.370240:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262863488 00000100:00100000:1.0:1746065180.370297:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14148 00000100:00100000:1.0:1746065180.370304:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:31537:x1830881262863488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065180.370321:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.370335:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fbab5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e5ffc5 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.370361:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5c00/0x14b4f8542d4fba30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff5c expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.370368:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065180.370369:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065180.370373:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fbab5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffc5 expref: 9 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.370404:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5c00/0x14b4f8542d4fba30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff5c expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.370414:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5c00/0x14b4f8542d4fba30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3670015) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff5c expref: 20 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.370424:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260282880:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065180.370713:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a55bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065180.372016:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260282880:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065180.372036:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fbab5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffc5 expref: 9 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.372048:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1d600, rc 0) 00000100:00100000:1.0:1746065180.372076:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:31537:x1830881262863488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1773us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.372083:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14148 00000100:00100000:0.0:1746065180.372449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.381381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.385060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.399236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.400944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.404803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.408430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.417100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.423658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.440672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.447463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.457045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.461467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.465972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.470437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.470474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.470504:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.470532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.473478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.476766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.476911:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262866560 00000100:00100000:1.0:1746065180.476917:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262866560 00010000:00010000:1.0:1746065180.476943:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fbaf4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffef expref: 17 pid: 14645 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.476968:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7194 00000100:00100000:1.0:1746065180.476975:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1961:x1830881262866560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.476986:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.477090:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fbaf4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffef expref: 17 pid: 14645 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.477101:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fbaf4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffef expref: 17 pid: 14645 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.477120:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fbaf4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffef expref: 17 pid: 14645 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.477147:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065180.477152:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fbb1e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065180.477163:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fbb1e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065180.477168:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fbb1e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065180.477188:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.477219:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:1961:x1830881262866560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 245us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.477225:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7194 00000100:00100000:0.0:1746065180.480018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.481912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.486718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.486754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.487226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.487418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.487435:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262867200 00000100:00100000:1.0:1746065180.487443:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262867200 00000100:00100000:1.0:1746065180.487477:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262867072 00000100:00100000:1.0:1746065180.487479:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262867072 00000100:00100000:0.0:1746065180.487955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.487987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.488001:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262867712 00000100:00100000:0.0:1746065180.488005:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262867712 00000100:00100000:0.0:1746065180.488019:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262867328 00000100:00100000:0.0:1746065180.488021:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262867328 00000100:00100000:0.0:1746065180.488028:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262867584 00000100:00100000:0.0:1746065180.488030:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262867584 00000100:00100000:0.0:1746065180.488040:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14160 00000100:00100000:0.0:1746065180.488045:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881262867072:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065180.488059:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.488068:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5800/0x14b4f8542d4fb9f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff16 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.488075:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f758600/0x14b4f8542d4fbafb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fff6 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.488085:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 11 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.488090:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.488092:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.488094:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.488106:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 11 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.488113:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 11 pid: 25185 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746065180.488120:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260284544:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065180.488141:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f758600/0x14b4f8542d4fbafb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fff6 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.488148:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f758600/0x14b4f8542d4fbafb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fff6 expref: 11 pid: 8428 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746065180.488154:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260284672:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065180.488169:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5800/0x14b4f8542d4fb9f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff16 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.488180:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5800/0x14b4f8542d4fb9f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff16 expref: 15 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.488187:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260284928:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065180.488198:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065180.488209:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14162 00000100:00100000:0.0:1746065180.488213:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881262867328:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065180.488226:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.488235:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.488241:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.488247:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.488252:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.488253:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.488255:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.488267:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.488275:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 8 pid: 25185 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746065180.488281:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260285184:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065180.488298:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.488304:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 10 pid: 21998 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746065180.488311:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260285440:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065180.488324:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.488331:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 21 pid: 8428 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.488338:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260285696:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065180.488346:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065180.502646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.502677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.502690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.502722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.502734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.502752:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262867968 00000100:00100000:1.0:1746065180.502757:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262867968 00010000:00010000:1.0:1746065180.502785:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4800/0x14b4f8542d4fb76d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdb1 expref: 9 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.502806:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262867840 00000100:00100000:1.0:1746065180.502808:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262867840 00010000:00010000:1.0:1746065180.503037:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911e3800/0x14b4f8542d4fb79e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdcd expref: 11 pid: 8428 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746065180.503050:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262868096 00000100:00100000:1.0:1746065180.503052:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262868096 00010000:00010000:1.0:1746065180.503062:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f758000/0x14b4f8542d4fbb02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fffd expref: 12 pid: 8428 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746065180.503070:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262868480 00000100:00100000:1.0:1746065180.503071:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262868480 00010000:00010000:1.0:1746065180.503080:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5e00/0x14b4f8542d4fb98f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fef3 expref: 12 pid: 8428 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.503088:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262868224 00000100:00100000:1.0:1746065180.503090:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262868224 00010000:00010000:1.0:1746065180.503098:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fba06 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff32 expref: 16 pid: 25185 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.503109:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7195 00000100:00100000:1.0:1746065180.503115:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881262867968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.503126:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.503146:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4800/0x14b4f8542d4fb76d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdb1 expref: 9 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.503155:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4800/0x14b4f8542d4fb76d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdb1 expref: 9 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.503469:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.503504:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881262867968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 388us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.503510:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7195 00000100:00100000:1.0:1746065180.503528:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7196 00000100:00100000:1.0:1746065180.503532:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262867840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.503538:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.503546:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911e3800/0x14b4f8542d4fb79e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdcd expref: 11 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.503554:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911e3800/0x14b4f8542d4fb79e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdcd expref: 11 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.503565:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911e3800/0x14b4f8542d4fb79e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdcd expref: 11 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.503579:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.503594:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262867840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.503598:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7196 00000100:00100000:1.0:1746065180.503628:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7197 00000100:00100000:1.0:1746065180.503632:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262868096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.503638:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065180.503647:0:10991:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:1.0:1746065180.503651:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f758000/0x14b4f8542d4fbb02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fffd expref: 12 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.503658:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f758000/0x14b4f8542d4fbb02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fffd expref: 12 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.503668:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.503677:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881262868096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.503693:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7197 00000100:00100000:1.0:1746065180.503701:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7198 00000100:00100000:1.0:1746065180.503704:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881262868480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.503709:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.503714:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5e00/0x14b4f8542d4fb98f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fef3 expref: 12 pid: 8428 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.503725:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5e00/0x14b4f8542d4fb98f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fef3 expref: 12 pid: 8428 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.503733:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.503745:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881262868480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 40us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.503749:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7198 00000100:00100000:1.0:1746065180.503757:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7199 00000100:00100000:1.0:1746065180.503761:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881262868224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.503766:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.503772:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fba06 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff32 expref: 16 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.503778:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fba06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff32 expref: 16 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.503788:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.503789:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.503793:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f758a00/0x14b4f8542d4fbb4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.503812:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f758a00/0x14b4f8542d4fbb4f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.503857:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.503871:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881262868224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 110us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.503877:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7199 00000100:00100000:1.0:1746065180.503960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.503971:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262868352 00000100:00100000:1.0:1746065180.503974:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262868352 00010000:00010000:1.0:1746065180.503984:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5000/0x14b4f8542d4fb774 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdb8 expref: 22 pid: 21998 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746065180.503996:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7200 00000100:00100000:1.0:1746065180.504000:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262868352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.504005:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.504012:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5000/0x14b4f8542d4fb774 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdb8 expref: 22 pid: 21998 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.504019:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcd5000/0x14b4f8542d4fb774 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fdb8 expref: 22 pid: 21998 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.504028:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.504029:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.504032:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c25de00/0x14b4f8542d4fbb48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.504038:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c25de00/0x14b4f8542d4fbb48 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.504045:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.504056:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262868352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.504064:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7200 00000100:00100000:1.0:1746065180.504094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.504102:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262868608 00000100:00100000:1.0:1746065180.504104:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262868608 00010000:00010000:1.0:1746065180.504120:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f758600/0x14b4f8542d4fbafb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fff6 expref: 11 pid: 8428 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746065180.504132:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7201 00000100:00100000:1.0:1746065180.504136:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881262868608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.504142:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065180.504149:0:7079:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1821 -> 1957 00010000:00010000:1.0:1746065180.504153:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f758600/0x14b4f8542d4fbafb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fff6 expref: 10 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.504160:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f758600/0x14b4f8542d4fbafb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fff6 expref: 10 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.504169:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.504182:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262868608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 45us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.504186:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7201 00000100:00100000:1.0:1746065180.504215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.504222:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262868736 00000100:00100000:1.0:1746065180.504225:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262868736 00010000:00010000:1.0:1746065180.504232:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 11 pid: 25185 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746065180.504245:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7202 00000100:00100000:1.0:1746065180.504249:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881262868736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.504253:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.504258:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 11 pid: 25185 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.504265:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 11 pid: 25185 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.504273:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.504285:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881262868736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 35us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.504289:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7202 00010000:00010000:0.0:1746065180.504305:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b4e400/0x14b4f8542d4fba14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff40 expref: 10 pid: 25185 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746065180.504329:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260284544:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065180.504340:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f758600/0x14b4f8542d4fbafb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fff6 expref: 9 pid: 8428 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746065180.504346:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260284672:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065180.505365:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260285184:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065180.505420:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260285440:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065180.505440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.505481:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260285696:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065180.505509:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065180.505554:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2428 00000100:00100000:1.0:1746065180.505560:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+8:1958:x1830881262868864:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065180.505619:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260284928:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065180.505635:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065180.506236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.506392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.506406:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262869120 00000100:00100000:0.0:1746065180.506409:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262869120 00010000:00010000:0.0:1746065180.506422:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1c200/0x14b4f8542d4fbaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffbe expref: 10 pid: 25185 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.506437:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262869376 00000100:00100000:0.0:1746065180.506439:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262869376 00010000:00010000:0.0:1746065180.506447:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f758200/0x14b4f8542d4fbb09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60004 expref: 9 pid: 8428 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746065180.506459:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7203 00000100:00100000:0.0:1746065180.506464:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262869120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065180.506471:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065180.506484:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1c200/0x14b4f8542d4fbaae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffbe expref: 10 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.506496:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1c200/0x14b4f8542d4fbaae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffbe expref: 10 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.506510:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1c200/0x14b4f8542d4fbaae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffbe expref: 10 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.506523:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.506548:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881262869120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.506554:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7203 00000100:00100000:0.0:1746065180.506652:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7204 00000100:00100000:0.0:1746065180.506658:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262869376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065180.506664:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065180.506671:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f758200/0x14b4f8542d4fbb09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60004 expref: 9 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746065180.506678:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f758200/0x14b4f8542d4fbb09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60004 expref: 9 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746065180.506689:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f758200/0x14b4f8542d4fbb09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60004 expref: 9 pid: 8428 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746065180.506697:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.506710:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262869376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.506718:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7204 00000100:00100000:0.0:1746065180.506742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.506753:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262868992 00000100:00100000:0.0:1746065180.506756:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262868992 00010000:00010000:0.0:1746065180.506765:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 10 pid: 25185 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746065180.506778:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7205 00000100:00100000:0.0:1746065180.506782:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262868992:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065180.506788:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065180.506794:0:15963:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2077 -> 2079 00010000:00010000:0.0:1746065180.506798:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 10 pid: 25185 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746065180.506805:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 10 pid: 25185 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746065180.506841:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fb5fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcca expref: 10 pid: 25185 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746065180.506848:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.506863:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881262868992:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.506868:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7205 00000100:00100000:1.0:1746065180.507120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.507430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.507442:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262869248 00000100:00100000:1.0:1746065180.507445:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262869248 00010000:00010000:1.0:1746065180.507458:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 9 pid: 21998 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746065180.507483:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262869632 00000100:00100000:1.0:1746065180.507486:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262869632 00010000:00010000:1.0:1746065180.507493:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fbab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffc5 expref: 9 pid: 25185 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.507511:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7206 00000100:00100000:1.0:1746065180.507515:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262869248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.507521:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.507530:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 9 pid: 21998 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.507538:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 9 pid: 21998 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.507549:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a43d400/0x14b4f8542d4fb639 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcdf expref: 9 pid: 21998 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746065180.507557:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.507571:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262869248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.507575:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7206 00000100:00100000:1.0:1746065180.507585:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7207 00000100:00100000:1.0:1746065180.507590:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881262869632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.507595:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.507602:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fbab5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffc5 expref: 9 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.507609:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fbab5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffc5 expref: 9 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.507618:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1d600/0x14b4f8542d4fbab5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffc5 expref: 9 pid: 25185 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.507625:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.507637:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881262869632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.507641:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7207 00000100:00100000:1.0:1746065180.507665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.507674:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262869504 00000100:00100000:1.0:1746065180.507676:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262869504 00010000:00010000:1.0:1746065180.507686:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5800/0x14b4f8542d4fb9f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff16 expref: 15 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.507698:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7208 00000100:00100000:1.0:1746065180.507702:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881262869504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.507708:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065180.507897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.507908:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262869760 00000100:00100000:0.0:1746065180.507911:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262869760 00010000:00010000:0.0:1746065180.507923:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 21 pid: 8428 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.507937:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7209 00000100:00100000:0.0:1746065180.507940:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881262869760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065180.507945:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065180.507952:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 21 pid: 8428 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.507959:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 21 pid: 8428 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.507969:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcade00/0x14b4f8542d4fb5e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fcae expref: 21 pid: 8428 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.507977:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.507978:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.507982:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.507989:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508003:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.508017:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881262869760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.508022:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7209 00000100:00100000:0.0:1746065180.508082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.508093:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262869888 00000100:00100000:0.0:1746065180.508095:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262869888 00010000:00010000:0.0:1746065180.508105:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fbaca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffda expref: 9 pid: 21998 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.508114:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7210 00000100:00100000:0.0:1746065180.508118:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881262869888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065180.508124:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065180.508131:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fbaca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffda expref: 9 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.508138:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fbaca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffda expref: 9 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.508147:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fbaca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffda expref: 9 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.508154:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.508156:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.508158:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801298de000/0x14b4f8542d4fbb6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508164:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801298de000/0x14b4f8542d4fbb6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508175:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.508189:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881262869888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.508195:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7210 00010000:00010000:1.0:1746065180.508610:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5800/0x14b4f8542d4fb9f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff16 expref: 15 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.508623:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5800/0x14b4f8542d4fb9f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff16 expref: 15 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.508633:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dcd5800/0x14b4f8542d4fb9f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ff16 expref: 15 pid: 21998 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.508641:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.508643:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.508645:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508650:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508669:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.508684:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881262869504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 981us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.508689:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7208 00010000:00010000:1.0:1746065180.508720:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508726:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508739:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508748:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508753:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508757:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c5b000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065180.508760:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508765:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508773:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.508779:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c5b000/0x14b4f8542d4fbb64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065180.508810:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881262867328:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 20596us (20856us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065180.508855:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508861:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508874:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508880:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508886:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508891:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c8fa00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065180.508893:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508898:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508906:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065180.508911:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0x14b4f8542d4fbb56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065180.508938:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881262867072:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 20893us (21712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.508944:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14160 00000100:00100000:1.0:1746065180.509204:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14162 00000100:00100000:1.0:1746065180.521782:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+8:1958:x1830881262868864:12345-192.168.202.46@tcp:4:cat.0 Request processed in 16214us (16332us total) trans 17179873535 rc 0/0 00000100:00100000:1.0:1746065180.521793:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2428 00002000:00100000:1.0:1746065180.521804:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2863103) req@ffff88008fc5a300 x1830881262868864/t17179873535(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:96/0 lens 488/448 e 0 to 0 dl 1746065191 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065180.521837:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5a300 with x1830881262868864 ext(2097152->2863103) 00010000:00010000:1.0:1746065180.521845:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 8 pid: 8851 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.521859:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 8 pid: 8851 timeout: 879 lvb_type: 0 00002000:00010000:1.0:1746065180.521865:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5a300 00000100:00100000:0.0:1746065180.526791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.527114:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262870016 00000100:00100000:1.0:1746065180.527122:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262870016 00010000:00010000:1.0:1746065180.527152:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 8 pid: 8851 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.527810:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7211 00000100:00100000:1.0:1746065180.527850:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881262870016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.527862:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.527882:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 8 pid: 8851 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.527894:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 8 pid: 8851 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.527912:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcd4200/0x14b4f8542d4fba92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2863103) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5ffa2 expref: 8 pid: 8851 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.527940:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.527942:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.527948:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093967600/0x14b4f8542d4fbb5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.527956:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093967600/0x14b4f8542d4fbb5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065180.529856:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.529914:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+7:1961:x1830881262870016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2062us (3126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.529924:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7211 00000100:00100000:0.0:1746065180.532539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.539257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.539288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.539313:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.539327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.539332:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262870528 00000100:00100000:1.0:1746065180.539336:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262870528 00000100:00100000:0.0:1746065180.539338:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065180.539356:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135496200/0x14b4f8542d4fb361 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb34 expref: 281 pid: 20754 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.539371:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262870400 00000100:00100000:1.0:1746065180.539373:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262870400 00010000:00010000:1.0:1746065180.539380:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135496000/0x14b4f8542d4fb330 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb1f expref: 28 pid: 14645 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.539397:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262870912 00000100:00100000:1.0:1746065180.539399:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262870912 00010000:00010000:1.0:1746065180.539406:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3e2c00/0x14b4f8542d4fb2c0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fac4 expref: 29 pid: 20754 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746065180.539408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.539414:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262871040 00000100:00100000:1.0:1746065180.539416:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262871040 00000100:00100000:0.0:1746065180.539417:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262871168 00000100:00100000:0.0:1746065180.539419:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262871168 00010000:00010000:1.0:1746065180.539423:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f11ea00/0x14b4f8542d4fb2b9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fabd expref: 282 pid: 24350 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.539428:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f223000/0x14b4f8542d4fb2ab lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fab6 expref: 30 pid: 14645 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746065180.539432:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7212 00000100:00100000:1.0:1746065180.539436:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:1961:x1830881262870528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065180.539438:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7213 00000100:00100000:0.0:1746065180.539441:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881262870400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065180.539444:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065180.539446:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065180.539448:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135496200/0x14b4f8542d4fb361 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb34 expref: 282 pid: 20754 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.539448:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135496000/0x14b4f8542d4fb330 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb1f expref: 30 pid: 14645 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.539456:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135496200/0x14b4f8542d4fb361 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb34 expref: 282 pid: 20754 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.540165:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135496000/0x14b4f8542d4fb330 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fb1f expref: 30 pid: 14645 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.540315:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065180.540323:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065180.540330:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.540349:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881262870400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 906us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.540355:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7213 00000100:00100000:0.0:1746065180.540367:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7216 00000100:00100000:0.0:1746065180.540372:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881262871168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065180.540377:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065180.540380:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f223000/0x14b4f8542d4fb2ab lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fab6 expref: 29 pid: 14645 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746065180.540387:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f223000/0x14b4f8542d4fb2ab lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5fab6 expref: 29 pid: 14645 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746065180.540406:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065180.540409:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065180.540414:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065180.540432:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:1961:x1830881262870528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 995us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.540437:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7212 00010000:00010000:0.0:1746065180.541132:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065180.541136:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065180.541141:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065180.541160:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881262871168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 787us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.541165:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7216 00000100:00100000:0.0:1746065180.543181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000001:00080000:1.0:1746065180.583676:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944025 is committed 00000001:00080000:1.0:1746065180.583685:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944023 is committed 00000001:00080000:1.0:1746065180.583688:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944020 is committed 00000001:00080000:1.0:1746065180.583698:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944049 is committed 00000001:00080000:1.0:1746065180.583710:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944037 is committed 00000001:00080000:1.0:1746065180.583728:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944060 is committed 00000001:00080000:1.0:1746065180.583734:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944056 is committed 00000001:00080000:1.0:1746065180.583749:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944047 is committed 00000001:00080000:1.0:1746065180.583768:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944061 is committed 00000004:00080000:1.0:1746065180.583772:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2334 committed 00000004:00080000:1.0:1746065180.583777:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2300 committed 00000004:00080000:1.0:1746065180.583780:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2299 committed 00000004:00080000:1.0:1746065180.583782:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2298 committed 00000004:00080000:1.0:1746065180.583783:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2297 committed 00000004:00080000:1.0:1746065180.583785:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2333 committed 00000004:00080000:1.0:1746065180.583786:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2296 committed 00000004:00080000:1.0:1746065180.583787:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2332 committed 00000004:00080000:1.0:1746065180.583793:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2295 committed 00000004:00080000:1.0:1746065180.583795:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2331 committed 00000004:00080000:1.0:1746065180.583797:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2330 committed 00000004:00080000:1.0:1746065180.583798:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2329 committed 00000004:00080000:1.0:1746065180.583799:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2294 committed 00000004:00080000:1.0:1746065180.583800:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2293 committed 00000004:00080000:1.0:1746065180.583801:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2328 committed 00000004:00080000:1.0:1746065180.583803:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2327 committed 00000004:00080000:1.0:1746065180.583804:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2292 committed 00010000:00010000:0.0:1746065180.583921:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065180.583928:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065180.583935:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065180.583941:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065180.583944:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065180.583950:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065180.583962:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065180.583965:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065180.583968:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065180.583973:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fbb72 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065180.584114:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260286848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065180.584150:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065180.584183:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260287360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065180.584197:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065180.584211:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065180.584215:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260286976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065180.584227:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065180.584237:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260287488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065180.584248:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065180.584266:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260286848 00000100:00100000:0.0:1746065180.584272:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260286848 00000100:00100000:0.0:1746065180.584301:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260287360 00000100:00100000:0.0:1746065180.584303:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260287360 00000100:00100000:0.0:1746065180.584312:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260286976 00000100:00100000:0.0:1746065180.584314:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260286976 00000100:00100000:0.0:1746065180.584321:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260287488 00000100:00100000:0.0:1746065180.584323:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260287488 00000100:00100000:0.0:1746065180.584333:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14164 00000100:00100000:0.0:1746065180.584338:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881260286848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065180.584395:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14165 00000100:00100000:1.0:1746065180.584401:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881260287360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065180.584459:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14166 00000100:00100000:0.0:1746065180.584463:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260286976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065180.584473:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14167 00000100:00100000:0.0:1746065180.584476:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260287488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065180.584506:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260287360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (307us total) trans 21474840797 rc 0/0 00000100:00100000:1.0:1746065180.584512:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14165 00000100:00100000:1.0:1746065180.584539:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840779 gen 2 00000004:00080000:1.0:1746065180.584542:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90ad880, transno 21474840750 00000004:00080000:1.0:1746065180.584547:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90adc00, transno 21474840751 00000004:00080000:1.0:1746065180.584549:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa1880, transno 21474840752 00000004:00080000:1.0:1746065180.584551:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fe680, transno 21474840753 00002000:00010000:0.0:1746065180.584552:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1746065180.584553:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9cc380, transno 21474840754 00002000:00010000:0.0:1746065180.584554:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00000004:00080000:1.0:1746065180.584555:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fdf80, transno 21474840755 00002000:00010000:0.0:1746065180.584556:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:1.0:1746065180.584557:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fe300, transno 21474840756 00002000:00010000:0.0:1746065180.584558:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00000004:00080000:1.0:1746065180.584559:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fea00, transno 21474840757 00002000:00010000:0.0:1746065180.584559:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1746065180.584561:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fd880, transno 21474840758 00000004:00080000:1.0:1746065180.584563:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd83480, transno 21474840762 00000004:00080000:1.0:1746065180.584565:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd82a00, transno 21474840763 00000004:00080000:1.0:1746065180.584567:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd82680, transno 21474840764 00000004:00080000:1.0:1746065180.584569:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd81880, transno 21474840765 00000004:00080000:1.0:1746065180.584571:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd81180, transno 21474840766 00000004:00080000:1.0:1746065180.584573:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd80e00, transno 21474840767 00000004:00080000:1.0:1746065180.584575:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd81500, transno 21474840768 00000100:00100000:0.0:1746065180.584576:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260287488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (327us total) trans 21474840798 rc 0/0 00000004:00080000:1.0:1746065180.584577:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd83100, transno 21474840769 00000100:00100000:0.0:1746065180.584580:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14167 00000100:00100000:0.0:1746065180.584677:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260286976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (448us total) trans 21474840799 rc 0/0 00000100:00100000:0.0:1746065180.584682:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14166 00000004:00080000:1.0:1746065180.585145:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4eb800, transno 21474840770 00000004:00080000:1.0:1746065180.585149:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49f100, transno 21474840771 00000004:00080000:1.0:1746065180.585151:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49d180, transno 21474840772 00000004:00080000:1.0:1746065180.585153:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49e680, transno 21474840773 00000004:00080000:1.0:1746065180.585155:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49d500, transno 21474840774 00000004:00080000:1.0:1746065180.585156:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49c380, transno 21474840775 00000004:00080000:1.0:1746065180.585158:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49c000, transno 21474840776 00000004:00080000:1.0:1746065180.585160:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b6a00, transno 21474840777 00000004:00080000:1.0:1746065180.585162:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49d880, transno 21474840778 00000004:00080000:1.0:1746065180.585163:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49f480, transno 21474840779 00000100:00100000:1.0:1746065180.585168:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008fd05880 x1830881260287360/t21474840797(21474840797) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065196 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065180.585176:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05880/2, rc 0, transno 21474840797 00000100:00100000:1.0:1746065180.585180:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260287360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065180.587495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.587587:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260288000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065180.587618:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065180.587646:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260288512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065180.587660:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065180.587673:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065180.587677:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260287872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065180.587689:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065180.587698:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260288384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065180.587708:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065180.587724:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260288000 00000100:00100000:0.0:1746065180.587728:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260288000 00000100:00100000:0.0:1746065180.587746:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260288512 00000100:00100000:0.0:1746065180.587748:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260288512 00000100:00100000:0.0:1746065180.587755:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260287872 00000100:00100000:0.0:1746065180.587757:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260287872 00000100:00100000:0.0:1746065180.587764:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260288384 00000100:00100000:0.0:1746065180.587765:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260288384 00000100:00100000:0.0:1746065180.587773:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14176 00000100:00100000:0.0:1746065180.587777:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260288000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065180.587925:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260288000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (305us total) trans 17179873540 rc 0/0 00000100:00100000:0.0:1746065180.587930:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14176 00000100:00100000:0.0:1746065180.587944:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14177 00000100:00100000:0.0:1746065180.587947:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260288512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065180.588022:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260288512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (360us total) trans 17179873541 rc 0/0 00000100:00100000:0.0:1746065180.588026:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14177 00000100:00100000:0.0:1746065180.588036:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14178 00000100:00100000:0.0:1746065180.588040:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260287872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065180.588152:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260287872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (462us total) trans 17179873542 rc 0/0 00000100:00100000:0.0:1746065180.588158:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14178 00000100:00100000:0.0:1746065180.588168:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14179 00000100:00100000:0.0:1746065180.588172:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260288384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065180.588245:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260288384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (536us total) trans 17179873543 rc 0/0 00000100:00100000:0.0:1746065180.588250:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14179 00000004:00080000:0.0:1746065180.588280:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c1c00/2, rc 0, transno 17179873542 00000100:00100000:0.0:1746065180.588284:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260287872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065180.588289:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c3480/2, rc 0, transno 17179873543 00000100:00100000:0.0:1746065180.588292:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260288384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065180.588297:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c2300/2, rc 0, transno 17179873540 00000100:00100000:0.0:1746065180.588299:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260288000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065180.588304:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c0a80/2, rc 0, transno 17179873541 00000100:00100000:0.0:1746065180.588306:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260288512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065180.588405:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06680/2, rc 0, transno 21474840799 00000100:00100000:1.0:1746065180.588409:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260286976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065180.588418:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05c00/2, rc 0, transno 21474840798 00000100:00100000:1.0:1746065180.588420:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260287488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065180.588621:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 1 in flight, 27 done 00000100:00100000:1.0:1746065180.588721:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260286848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4382us (4569us total) trans 21474840804 rc 0/0 00000100:00100000:1.0:1746065180.588727:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14164 00000100:00100000:1.0:1746065180.589020:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260288768 00000100:00100000:1.0:1746065180.589023:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260288768 00000100:00100000:1.0:1746065180.589043:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14180 00000100:00100000:1.0:1746065180.589047:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881260288768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065180.589148:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881260288768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (159us total) trans 21474840805 rc 0/0 00000100:00100000:1.0:1746065180.589154:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14180 00000004:00080000:0.0:1746065180.589408:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd07100/2, rc 0, transno 21474840804 00000100:00100000:0.0:1746065180.589412:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260286848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065180.598920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.599151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.599179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.599230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.599297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065180.599336:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262871936 00000100:00100000:1.0:1746065180.599340:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262871936 00000100:00100000:1.0:1746065180.599354:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262871808 00000100:00100000:1.0:1746065180.599356:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262871808 00000100:00100000:1.0:1746065180.599368:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14181 00000100:00100000:1.0:1746065180.599374:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881262871680:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065180.599388:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.599404:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60035 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065180.599424:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d71c, atime: 0x6812d71c, ctime: 0x6812d71c, blocks: 0x7a5 00010000:00010000:1.0:1746065180.599439:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.599440:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.599449:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.599461:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.599469:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b418fe00, rc 0) 00000100:00100000:1.0:1746065180.599840:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262871680:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 466us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.599845:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14181 00000100:00100000:1.0:1746065180.599854:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262872064 00000100:00100000:1.0:1746065180.599857:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262872064 00000100:00100000:1.0:1746065180.599869:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14185 00000100:00100000:1.0:1746065180.599872:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262872064:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065180.599877:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065180.599883:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4fbbaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6004a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065180.599892:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d71c, atime: 0x6812d71a, ctime: 0x6812d71c, blocks: 0x821 00010000:00010000:1.0:1746065180.599898:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.599899:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065180.599903:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4fbbaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6004a expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.599911:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4fbbaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6004a expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065180.599918:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b530cc00, rc 0) 00000100:00100000:1.0:1746065180.599932:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262872064:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 59us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065180.600017:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14185 00000100:00100000:0.0:1746065180.600694:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065180.600784:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262872320 00000100:00100000:0.0:1746065180.600788:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262872320 00000100:00100000:0.0:1746065180.605047:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14186 00000100:00100000:0.0:1746065180.605065:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262872320:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065180.605083:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065180.605103:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c8f600/0x14b4f8542d4fbbb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60058 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065180.605124:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d71d, atime: 0x6812d71d, ctime: 0x6812d71d, blocks: 0x1029 00010000:00010000:0.0:1746065180.605140:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.605142:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065180.605149:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8f600/0x14b4f8542d4fbbb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60058 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.605162:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c8f600/0x14b4f8542d4fbbb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60058 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065180.605171:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c8f600, rc 0) 00000100:00100000:0.0:1746065180.605229:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262872320:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 171us (4534us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065180.605234:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14186 00010000:00010000:0.0:1746065180.991086:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065181.626660:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262872704 00000100:00100000:1.0:1746065181.626670:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262872704 00000100:00100000:1.0:1746065181.626744:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262872832 00000100:00100000:1.0:1746065181.626747:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262872832 00000100:00100000:1.0:1746065181.626767:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7952 00000100:00100000:1.0:1746065181.626774:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262872704:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065181.626803:0:21487:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.626838:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065181.626840:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065181.626844:0:21487:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.626855:0:21487:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065181.629364:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7954 00000100:00100000:0.0:1746065181.629374:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881262873088:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065181.629395:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094c8e800/0x14b4f8542d4fbbc6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.629403:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065181.629405:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065181.629408:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8e800/0x14b4f8542d4fbbc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.629416:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c8e800/0x14b4f8542d4fbbc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065181.633768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065181.635014:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262874368 00000100:00100000:1.0:1746065181.635024:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262874368 00000100:00100000:1.0:1746065181.635069:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7959 00000100:00100000:1.0:1746065181.635077:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1960:x1830881262874368:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065181.635103:0:21483:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.635115:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065181.635117:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065181.635122:0:21483:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.635147:0:21483:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.660073:0:21487:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.660088:0:21487:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.660095:0:21487:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.660101:0:21487:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a003ba00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065181.660105:0:21487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.660111:0:21487:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.660128:0:21487:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.660134:0:21487:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a003ba00/0x14b4f8542d4fbbb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065181.660226:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1960:x1830881262872704:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 33447us (34993us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065181.660237:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7952 00010000:00010000:0.0:1746065181.694548:0:21486:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fbbe2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.694564:0:21486:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fbbe2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.694571:0:21486:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fbbe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.694576:0:21486:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c9e800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065181.694580:0:21486:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fbbe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.694586:0:21486:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fbbe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.694603:0:21486:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fbbe2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.694607:0:21486:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c9e800/0x14b4f8542d4fbbe2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21486 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065181.694720:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881262874112:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 64261us (64368us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065181.694730:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7958 00010000:00010000:0.0:1746065181.709985:0:21483:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.709997:0:21483:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.710004:0:21483:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.710009:0:21483:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c733200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065181.710012:0:21483:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.710018:0:21483:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.710032:0:21483:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.710038:0:21483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c733200/0x14b4f8542d4fbbe9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065181.712003:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262874368:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 76919us (78234us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065181.712014:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7959 00000100:00100000:0.0:1746065181.719104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065181.719390:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065181.721268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.727015:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.748459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.748511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065181.750090:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065181.755943:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262876544 00000100:00100000:0.0:1746065181.755950:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262876544 00000100:00100000:0.0:1746065181.755997:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9863 00000100:00100000:0.0:1746065181.756004:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31554:x1830881262876544:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065181.756022:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065181.756036:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2a00/0x14b4f8542d4fbc36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60097 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.756107:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065181.756118:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbb87 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6002e expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.756123:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fbc05 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6005f expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.756130:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093894200/0x14b4f8542d4fbc28 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60066 expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.756135:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065181.756159:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093894200/0x14b4f8542d4fbc28 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60066 expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.756170:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093894200/0x14b4f8542d4fbc28 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60066 expref: 7 pid: 20754 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065181.756181:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260288896:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065181.756280:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fbc05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6005f expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.756289:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fbc05 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6005f expref: 250 pid: 20754 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065181.756296:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260289024:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065181.756334:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbb87 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6002e expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.756343:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbb87 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6002e expref: 9 pid: 20754 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065181.756350:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260289152:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065181.756374:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065181.770659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065181.770857:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260288896:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065181.770868:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260289152:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065181.772511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.772540:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.772588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065181.772609:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260289024:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065181.772614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065181.772630:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065181.772634:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262877056 00000100:00100000:0.0:1746065181.772638:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262877056 00010000:00010000:0.0:1746065181.772895:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbb87 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6002e expref: 10 pid: 20754 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065181.772920:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7219 00000100:00100000:0.0:1746065181.772925:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262877056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065181.772931:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065181.772935:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbb87 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6002e expref: 10 pid: 20754 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065181.772942:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbb87 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6002e expref: 10 pid: 20754 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065181.772952:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbb87 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6002e expref: 10 pid: 20754 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065181.772972:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065181.772975:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065181.772980:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065181.772983:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065181.772998:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262877056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065181.773002:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7219 00000100:00100000:0.0:1746065181.773027:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262877312 00000100:00100000:0.0:1746065181.773030:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262877312 00000100:00100000:0.0:1746065181.773042:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9865 00000100:00100000:0.0:1746065181.773047:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:31556:x1830881262877312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065181.773056:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065181.773063:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800953fa000/0x14b4f8542d4fbc83 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e600a5 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.773089:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800953fa000/0x14b4f8542d4fbc83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600a5 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.773097:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800953fa000/0x14b4f8542d4fbc83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600a5 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.773112:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065181.773114:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065181.773115:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953fa000, rc 0) 00000100:00100000:0.0:1746065181.773132:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31556:x1830881262877312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 85us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065181.773137:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9865 00010000:00010000:1.0:1746065181.774692:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065181.774698:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065181.774713:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9183680 00010000:00010000:1.0:1746065181.774811:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2a00/0x14b4f8542d4fbc36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60097 expref: 252 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.774848:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60097 expref: 251 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.774854:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065181.774856:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065181.774858:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b2400, rc 0) 00000100:00100000:1.0:1746065181.774878:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31554:x1830881262876544:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 18875us (19015us total) trans 8589944067 rc 0/0 00000100:00100000:1.0:1746065181.774883:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9863 00000100:00100000:1.0:1746065181.779517:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262877440 00000100:00100000:1.0:1746065181.779525:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262877440 00000100:00100000:1.0:1746065181.779559:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9866 00000100:00100000:1.0:1746065181.779566:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:31557:x1830881262877440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065181.779589:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065181.779604:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732e00/0x14b4f8542d4fbc91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e600ac expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.779686:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732400/0x14b4f8542d4fbc98 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065181.779699:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60097 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.779705:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732400/0x14b4f8542d4fbc98 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065181.779737:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60097 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.779748:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fbc3d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60097 expref: 250 pid: 14645 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065181.779760:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260289280:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065181.779882:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065181.795348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.795438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065181.796188:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262877824 00000100:00100000:1.0:1746065181.796193:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262877824 00002000:00100000:1.0:1746065181.796218:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88008fd73480 x1830881262877824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065181.796226:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73480 with x1830881262877824 ext(0->1048575) 00002000:00010000:1.0:1746065181.796230:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd73480 00000100:00100000:1.0:1746065181.796253:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7960 00000100:00100000:1.0:1746065181.796259:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881262877824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065181.806199:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.806227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.806260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.806278:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262878080 00000100:00100000:0.0:1746065181.806284:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262878080 00002000:00100000:0.0:1746065181.806313:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a90ad880 x1830881262878080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.806321:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad880 with x1830881262878080 ext(1048576->2097151) 00002000:00010000:0.0:1746065181.806326:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ad880 00000100:00100000:0.0:1746065181.806335:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262878336 00000100:00100000:0.0:1746065181.806337:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262878336 00002000:00100000:0.0:1746065181.806343:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8800a90adc00 x1830881262878336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.806349:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90adc00 with x1830881262878336 ext(1048576->2097151) 00002000:00010000:0.0:1746065181.806351:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90adc00 00000100:00100000:0.0:1746065181.806356:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262878592 00000100:00100000:0.0:1746065181.806357:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262878592 00002000:00100000:0.0:1746065181.806364:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800a90af800 x1830881262878592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.806370:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af800 with x1830881262878592 ext(1048576->2097151) 00002000:00010000:0.0:1746065181.806372:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90af800 00000100:00100000:0.0:1746065181.806381:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7961 00000100:00100000:0.0:1746065181.806386:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881262878080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065181.808048:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7963 00000100:00100000:0.0:1746065181.808054:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881262878592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065181.828641:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3295:1830881260289408:0@lo:400:kworker.0 00000100:00100000:1.0:1746065181.828681:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1830881260289536:0@lo:400:kworker.0 00000100:00100000:0.0:1746065181.828691:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.828703:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.828723:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260289536 00000100:00100000:1.0:1746065181.828729:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260289536 00000100:00100000:1.0:1746065181.828738:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830881260290048:0@lo:400:kworker.0 00000100:00100000:0.0:1746065181.828738:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260289920:0@lo:400:kworker.0 00000100:00100000:1.0:1746065181.828752:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065181.828755:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.828770:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260289920 00000100:00100000:1.0:1746065181.828772:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260289920 00000100:00100000:1.0:1746065181.828810:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1746065181.828837:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260289920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065181.828875:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260289920:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065181.828880:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1746065181.828911:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260290048 00000100:00100000:1.0:1746065181.828913:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260290048 00000100:00100000:1.0:1746065181.828923:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1746065181.828926:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830881260289536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065181.828946:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830881260289536:12345-0@lo:400:kworker.0 Request processed in 20us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065181.828951:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1746065181.828973:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1830881260289536:0@lo:400:kworker.0 00000100:00080000:1.0:1746065181.828990:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065181.828999:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1746065181.829004:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830881260290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065181.829027:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830881260290048:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065181.829032:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1746065181.829051:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830881260290048:0@lo:400:kworker.0 00000100:00100000:1.0:1746065181.829215:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262878720 00000100:00100000:1.0:1746065181.829218:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262878720 00000100:00100000:1.0:1746065181.829238:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14193 00000100:00100000:1.0:1746065181.829242:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881262878720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065181.829251:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065181.829265:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e600b3 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.829282:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065181.829283:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065181.829290:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065181.829304:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065181.829314:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5e00, rc 0) 00000100:00100000:1.0:1746065181.829344:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881262878720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 101us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065181.829349:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14193 00000100:00100000:1.0:1746065181.829359:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14194 00000100:00100000:1.0:1746065181.829364:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+7:1961:x1830881262878848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065181.829371:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065181.829381:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4fbca6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e600ba expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.829390:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065181.829391:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065181.829395:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4fbca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600ba expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065181.829404:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4fbca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600ba expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065181.829411:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5200, rc 0) 00000100:00100000:1.0:1746065181.829424:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881262878848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065181.829429:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14194 00000100:00080000:1.0:1746065181.829583:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065181.829585:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065181.831552:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260289920:0@lo:400:kworker.0 00000100:00100000:1.0:1746065181.833287:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3295:1830881260289408:0@lo:400:kworker.0 00000100:00100000:0.0:1746065181.838674:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262878080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 32277us (32470us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065181.838688:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7961 00002000:00100000:0.0:1746065181.838699:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a90ad880 x1830881262878080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/440 e 0 to 0 dl 1746065192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.838707:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad880 with x1830881262878080 ext(1048576->2097151) 00002000:00010000:0.0:1746065181.838712:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ad880 00000100:00080000:0.0:1746065181.838754:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065181.838796:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260289792:0@lo:400:kworker.0 00000100:00100000:0.0:1746065181.838811:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260290176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065181.839155:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881262877824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 42890us (43711us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065181.839163:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7960 00002000:00100000:1.0:1746065181.839171:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88008fd73480 x1830881262877824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/440 e 0 to 0 dl 1746065192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065181.839179:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73480 with x1830881262877824 ext(0->1048575) 00002000:00010000:1.0:1746065181.839183:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd73480 00000100:00100000:1.0:1746065181.845107:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881262878592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 37049us (38842us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065181.845114:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7963 00002000:00100000:1.0:1746065181.845121:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800a90af800 x1830881262878592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/440 e 0 to 0 dl 1746065192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065181.845127:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af800 with x1830881262878592 ext(1048576->2097151) 00002000:00010000:1.0:1746065181.845131:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90af800 00000100:00100000:0.0:1746065181.868473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.868517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.868544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.868571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.868598:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262880000 00000100:00100000:0.0:1746065181.868602:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262880000 00002000:00100000:0.0:1746065181.869177:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a90af100 x1830881262880000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.869183:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af100 with x1830881262880000 ext(1048576->2097151) 00002000:00010000:0.0:1746065181.869186:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90af100 00000100:00100000:0.0:1746065181.869446:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7965 00000100:00100000:0.0:1746065181.869453:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262880000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065181.869547:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7966 00000100:00100000:0.0:1746065181.869551:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262880128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065181.885275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.885299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.885332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.885346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.885413:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262880640 00000100:00100000:0.0:1746065181.885420:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262880640 00002000:00100000:0.0:1746065181.885463:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009bee3800 x1830881262880640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.885473:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3800 with x1830881262880640 ext(2097152->3145727) 00002000:00010000:0.0:1746065181.885478:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee3800 00000100:00100000:0.0:1746065181.885495:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262880768 00000100:00100000:0.0:1746065181.885497:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262880768 00002000:00100000:0.0:1746065181.885506:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009bee3100 x1830881262880768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.885512:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3100 with x1830881262880768 ext(3145728->4194303) 00002000:00010000:0.0:1746065181.885514:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee3100 00000100:00100000:0.0:1746065181.885520:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262881280 00000100:00100000:0.0:1746065181.885521:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262881280 00002000:00100000:0.0:1746065181.885529:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009bee2680 x1830881262881280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.885535:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2680 with x1830881262881280 ext(3145728->4194303) 00002000:00010000:0.0:1746065181.885537:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee2680 00000100:00100000:0.0:1746065181.885543:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262881152 00000100:00100000:0.0:1746065181.885544:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262881152 00002000:00100000:0.0:1746065181.885550:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009bee1c00 x1830881262881152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/0 e 0 to 0 dl 1746065192 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065181.885555:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1c00 with x1830881262881152 ext(2097152->3145727) 00002000:00010000:0.0:1746065181.885558:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee1c00 00000100:00100000:0.0:1746065181.885566:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7968 00000100:00100000:0.0:1746065181.885572:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881262880640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065181.886796:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7969 00000100:00100000:0.0:1746065181.886806:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262880768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065181.903636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065181.906690:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881262880000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 37233us (38168us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065181.906700:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7965 00002000:00100000:1.0:1746065181.906709:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a90af100 x1830881262880000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:97/0 lens 488/440 e 0 to 0 dl 1746065192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065181.906718:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af100 with x1830881262880000 ext(1048576->2097151) 00002000:00010000:1.0:1746065181.906722:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90af100 00000100:00100000:1.0:1746065181.918199:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881262880128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 48644us (49651us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065181.918211:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7966 00002000:00100000:1.0:1746065181.918222:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8800a90ac000 x1830881262880128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:97/0 lens 488/440 e 0 to 0 dl 1746065192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065181.918231:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ac000 with x1830881262880128 ext(1048576->2097151) 00002000:00010000:1.0:1746065181.918236:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ac000 00000100:00100000:0.0:1746065181.925073:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.925113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065181.927092:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881262880640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 41515us (41818us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065181.927100:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7968 00002000:00100000:1.0:1746065181.927109:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009bee3800 x1830881262880640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:97/0 lens 488/440 e 0 to 0 dl 1746065192 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065181.927116:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3800 with x1830881262880640 ext(2097152->3145727) 00002000:00010000:1.0:1746065181.927121:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee3800 00000100:00100000:0.0:1746065181.928631:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262882048 00000100:00100000:0.0:1746065181.928637:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262882048 00000100:00100000:0.0:1746065181.928671:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9868 00000100:00100000:0.0:1746065181.928678:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:31557:x1830881262882048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065181.928692:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065181.928705:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9c00/0x14b4f8542d4fbcd7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e600e4 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.928742:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4d200/0x14b4f8542d4fbcd0 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065181.928749:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9c00/0x14b4f8542d4fbcd7 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600e4 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.928762:0:14645:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4d200/0x14b4f8542d4fbcd0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065181.928772:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9c00/0x14b4f8542d4fbcd7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600e4 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.928786:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065181.928788:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065181.928791:0:14645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9c00/0x14b4f8542d4fbcd7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600e4 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065181.928797:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0f9c00, rc 0) 00000100:00100000:0.0:1746065181.928871:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:31557:x1830881262882048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 193us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065181.928876:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9868 00000100:00100000:0.0:1746065181.941038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065181.941167:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262882176 00000100:00100000:1.0:1746065181.941173:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262882176 00000100:00100000:1.0:1746065181.941204:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9869 00000100:00100000:1.0:1746065181.941209:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31556:x1830881262882176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065181.941228:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065181.941243:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801330e1000/0x14b4f8542d4fbcde lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e600eb expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.941286:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801330e1000/0x14b4f8542d4fbcde lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600eb expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.941297:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801330e1000/0x14b4f8542d4fbcde lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600eb expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.941307:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065181.941310:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065181.941313:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9c00/0x14b4f8542d4fbcd7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600e4 expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065181.941318:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801330e1000, rc 0) 00000100:00100000:1.0:1746065181.941366:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31556:x1830881262882176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 155us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065181.941372:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9869 00000001:00080000:1.0:1746065181.965686:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944067 is committed 00000001:00080000:1.0:1746065181.965699:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944062 is committed 00000001:00080000:1.0:1746065181.965703:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944068 is committed 00000004:00080000:1.0:1746065181.965706:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2342 committed 00000004:00080000:1.0:1746065181.965712:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2309 committed 00000004:00080000:1.0:1746065181.965716:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2308 committed 00000004:00080000:1.0:1746065181.965717:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2307 committed 00000004:00080000:1.0:1746065181.965719:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2306 committed 00000004:00080000:1.0:1746065181.965720:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2341 committed 00000004:00080000:1.0:1746065181.965721:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2305 committed 00000004:00080000:1.0:1746065181.965723:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2340 committed 00000004:00080000:1.0:1746065181.965724:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2304 committed 00000004:00080000:1.0:1746065181.965726:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2339 committed 00000004:00080000:1.0:1746065181.965727:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2338 committed 00000004:00080000:1.0:1746065181.965729:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2337 committed 00000004:00080000:1.0:1746065181.965730:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2303 committed 00000004:00080000:1.0:1746065181.965731:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2302 committed 00000004:00080000:1.0:1746065181.965733:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2336 committed 00000004:00080000:1.0:1746065181.965734:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2335 committed 00000004:00080000:1.0:1746065181.965735:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2301 committed 00000001:00080000:1.0:1746065181.965744:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944063 is committed 00000100:00100000:1.0:1746065181.966188:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260290688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966221:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.966242:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065181.966246:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260290816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966258:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.966299:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260291584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966311:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.966320:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065181.966323:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260291456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966332:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.966339:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260291968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966348:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.966362:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260290688 00000100:00100000:1.0:1746065181.966367:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260290688 00000100:00100000:1.0:1746065181.966388:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260290816 00000100:00100000:1.0:1746065181.966389:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260290816 00000100:00100000:1.0:1746065181.966395:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260291584 00000100:00100000:1.0:1746065181.966397:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260291584 00000100:00100000:1.0:1746065181.966403:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260291456 00000100:00100000:1.0:1746065181.966404:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260291456 00000100:00100000:1.0:1746065181.966411:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260291968 00000100:00100000:1.0:1746065181.966412:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260291968 00000100:00100000:1.0:1746065181.966421:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14199 00000100:00100000:1.0:1746065181.966426:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260290688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065181.966566:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065181.966569:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065181.966571:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065181.966572:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065181.966573:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1957 -> 1957 00000100:00100000:1.0:1746065181.966595:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1830881260290688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (375us total) trans 21474840806 rc 0/0 00000100:00100000:1.0:1746065181.966601:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14199 00000100:00100000:1.0:1746065181.966614:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14200 00000100:00100000:1.0:1746065181.966618:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260290816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065181.966685:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065181.966687:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065181.966689:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065178 -> 1746065178 00002000:00010000:1.0:1746065181.966691:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065181.966692:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065181.966708:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1830881260290816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (449us total) trans 21474840807 rc 0/0 00000100:00100000:1.0:1746065181.966713:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14200 00000100:00100000:1.0:1746065181.966722:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14201 00000100:00100000:1.0:1746065181.966726:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881260291584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966794:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881260291584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (481us total) trans 21474840808 rc 0/0 00000100:00100000:1.0:1746065181.966799:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14201 00000100:00100000:1.0:1746065181.966806:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14202 00000100:00100000:1.0:1746065181.966810:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881260291456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966841:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14203 00000100:00100000:1.0:1746065181.966844:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881260291968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966906:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881260291968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (557us total) trans 21474840809 rc 0/0 00000100:00100000:1.0:1746065181.966910:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14203 00000004:00080000:1.0:1746065181.966935:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a12300/2, rc 0, transno 21474840809 00000100:00100000:1.0:1746065181.966940:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260291968:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065181.966945:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5883480/2, rc 0, transno 21474840808 00000100:00100000:1.0:1746065181.966948:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260291584:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065181.966956:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5883800/2, rc 0, transno 21474840807 00000100:00100000:1.0:1746065181.966958:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260290816:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065181.966964:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880380/2, rc 0, transno 21474840806 00000100:00100000:1.0:1746065181.966966:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260290688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966984:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260292096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.966997:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.967009:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260292096 00000100:00100000:1.0:1746065181.967011:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260292096 00000100:00100000:1.0:1746065181.967021:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14204 00000100:00100000:1.0:1746065181.967024:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881260292096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065181.967082:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260292096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (84us total) trans 21474840810 rc 0/0 00000100:00100000:1.0:1746065181.967086:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14204 00000004:00080000:1.0:1746065181.967100:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59c00/2, rc 0, transno 21474840810 00000100:00100000:1.0:1746065181.967103:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260292096:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065181.967149:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065181.967151:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065181.967153:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065181.967154:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065181.967156:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065181.967170:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260291456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 360us (837us total) trans 21474840811 rc 0/0 00000100:00100000:1.0:1746065181.967174:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14202 00000004:00080000:1.0:1746065181.967186:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5881c00/2, rc 0, transno 21474840811 00000100:00100000:1.0:1746065181.967189:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260291456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065181.970275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065181.970630:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260292480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065181.970659:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.970676:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260292992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065181.970688:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.970699:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065181.970704:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260292608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065181.970717:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065181.971598:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260292480 00000100:00100000:1.0:1746065181.971601:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260292480 00000100:00100000:1.0:1746065181.971618:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14213 00000100:00100000:1.0:1746065181.971622:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260292480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065181.971750:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065181.971753:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065181.971755:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065181.971756:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065181.971758:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065181.971782:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3295:x1830881260292480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (1122us total) trans 17179873549 rc 0/0 00000100:00100000:1.0:1746065181.971787:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14213 00000100:00100000:1.0:1746065181.971796:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260292992 00000100:00100000:1.0:1746065181.971798:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260292992 00000100:00100000:1.0:1746065181.971808:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260292608 00000100:00100000:1.0:1746065181.971810:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260292608 00000100:00100000:1.0:1746065181.971845:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14214 00000100:00100000:1.0:1746065181.971849:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881260292992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065181.971918:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881260292992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1228us total) trans 17179873550 rc 0/0 00000100:00100000:1.0:1746065181.971923:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14214 00000100:00100000:1.0:1746065181.971932:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14215 00000100:00100000:1.0:1746065181.971936:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881260292608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065181.971992:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065181.971994:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065181.971996:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065181.971997:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065181.971998:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065181.972015:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881260292608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (1297us total) trans 17179873551 rc 0/0 00000100:00100000:1.0:1746065181.972019:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14215 00000004:00080000:1.0:1746065181.972052:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd73b80/2, rc 0, transno 17179873551 00000100:00100000:1.0:1746065181.972056:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260292608:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065181.972063:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd70000/2, rc 0, transno 17179873549 00000100:00100000:1.0:1746065181.972065:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260292480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065181.972070:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c1500/2, rc 0, transno 17179873550 00000100:00100000:1.0:1746065181.972072:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260292992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065181.998397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065181.998450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.019667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.019947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.019977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.019992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.020887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.020911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:0.0:1746065182.020923:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065182.020926:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065182.020934:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262883968 00000100:00100000:0.0:1746065182.020937:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262883968 00010000:00010000:0.0:1746065182.020951:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093f0c600/0x14b4f8542d4fbcb4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600d6 expref: 14 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.020965:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262884096 00000100:00100000:0.0:1746065182.020967:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262884096 00010000:00010000:0.0:1746065182.020976:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8f600/0x14b4f8542d4fbbb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60058 expref: 9 pid: 8428 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.020987:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7224 00000100:00100000:0.0:1746065182.020990:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262883968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.020998:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.021009:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093f0c600/0x14b4f8542d4fbcb4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600d6 expref: 13 pid: 21235 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.021017:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093f0c600/0x14b4f8542d4fbcb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600d6 expref: 13 pid: 21235 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.021036:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.021050:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881262883968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.021054:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7224 00000100:00100000:0.0:1746065182.021072:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7225 00000100:00100000:0.0:1746065182.021077:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262884096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.021082:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.021088:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c8f600/0x14b4f8542d4fbbb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60058 expref: 9 pid: 8428 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.021096:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c8f600/0x14b4f8542d4fbbb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60058 expref: 9 pid: 8428 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.021105:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.021116:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262884096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 40us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.021121:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7225 00000100:00080000:0.0:1746065182.021131:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065182.021138:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262883840 00000100:00100000:0.0:1746065182.021140:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262883840 00000100:00100000:0.0:1746065182.021152:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14217 00000100:00100000:0.0:1746065182.021156:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:31554:x1830881262883840:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065182.021162:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.021173:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9a00/0x14b4f8542d4fbcec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e600f9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.021187:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b4e000/0x14b4f8542d4fbba3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60051 expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.021194:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e800/0x14b4f8542d4fbcc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600cf expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.021200:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fbc60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60089 expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.021204:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.021206:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.021208:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9a00/0x14b4f8542d4fbcec lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f9 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.021230:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fbc60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60089 expref: 19 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.021242:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fbc60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60089 expref: 19 pid: 9716 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.021252:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260293504:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.021291:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f14e800/0x14b4f8542d4fbcc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600cf expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.021298:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f14e800/0x14b4f8542d4fbcc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600cf expref: 10 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.021304:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260293632:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.021319:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129b4e000/0x14b4f8542d4fbba3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60051 expref: 8 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.021324:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129b4e000/0x14b4f8542d4fbba3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60051 expref: 8 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.021330:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260293760:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.021341:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.021390:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260293120:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.021397:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f0c600/0x14b4f8542d4fbcb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600d6 expref: 11 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.021413:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260293248:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.021419:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c8f600/0x14b4f8542d4fbbb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60058 expref: 8 pid: 8428 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.021427:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260293376:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.021449:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c394000/0x14b4f8542d4fbce5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f2 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.021455:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c394000, rc 0) 00000100:00100000:0.0:1746065182.021468:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:31552:x1830881262882688:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 22964us (23080us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.021473:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14216 00000100:00100000:0.0:1746065182.025718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.025734:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262884224 00000100:00100000:0.0:1746065182.025740:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262884224 00010000:00010000:0.0:1746065182.025764:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14e800/0x14b4f8542d4fbcc2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600cf expref: 11 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.025784:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7226 00000100:00100000:0.0:1746065182.025790:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262884224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.025800:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.025839:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f14e800/0x14b4f8542d4fbcc2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600cf expref: 11 pid: 21235 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.025853:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f14e800/0x14b4f8542d4fbcc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600cf expref: 11 pid: 21235 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.025873:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.025889:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262884224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 100us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.025894:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7226 00000100:00100000:0.0:1746065182.025935:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260293504:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.025943:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e800/0x14b4f8542d4fbcc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600cf expref: 10 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.025952:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260293632:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.026032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.026043:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262884352 00000100:00100000:0.0:1746065182.026046:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262884352 00010000:00010000:0.0:1746065182.026058:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129b4e000/0x14b4f8542d4fbba3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60051 expref: 9 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.026070:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7227 00000100:00100000:0.0:1746065182.026074:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881262884352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.026078:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.026085:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129b4e000/0x14b4f8542d4fbba3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60051 expref: 9 pid: 21235 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.026097:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129b4e000/0x14b4f8542d4fbba3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60051 expref: 9 pid: 21235 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.026107:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.026121:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881262884352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.026126:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7227 00010000:00010000:0.0:1746065182.026147:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b4e000/0x14b4f8542d4fbba3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60051 expref: 8 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.026156:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260293760:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.026175:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9a00/0x14b4f8542d4fbcec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f9 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.026184:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0f9a00, rc 0) 00000100:00100000:0.0:1746065182.026202:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:31554:x1830881262883840:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5045us (6209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.026207:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14217 00000100:00100000:0.0:1746065182.039360:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.039908:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262884608 00000100:00100000:1.0:1746065182.039917:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262884608 00002000:00100000:1.0:1746065182.039951:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009a4e9880 x1830881262884608/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.039960:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9880 with x1830881262884608 ext(1048576->2097151) 00002000:00010000:1.0:1746065182.039965:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9880 00000100:00100000:1.0:1746065182.039981:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7974 00000100:00100000:1.0:1746065182.039988:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881262884608:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065182.052213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.053200:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881262884608:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13212us (13846us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065182.053208:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7974 00002000:00100000:1.0:1746065182.053216:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009a4e9880 x1830881262884608/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.053224:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9880 with x1830881262884608 ext(1048576->2097151) 00002000:00010000:1.0:1746065182.053228:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9880 00000100:00100000:0.0:1746065182.058160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.060217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.060347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.060788:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262885248 00000100:00100000:1.0:1746065182.060793:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262885248 00002000:00100000:1.0:1746065182.060848:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2818048->2822143) req@ffff88009a4e8700 x1830881262885248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.060856:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8700 with x1830881262885248 ext(2818048->2822143) 00010000:00010000:1.0:1746065182.060861:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9a00/0x14b4f8542d4fbcec lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f9 expref: 20 pid: 8851 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.060871:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9a00/0x14b4f8542d4fbcec lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f9 expref: 20 pid: 8851 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746065182.060876:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e8700 00000100:00100000:1.0:1746065182.060887:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2431 00000100:00100000:1.0:1746065182.060892:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881262885248:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065182.061007:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881262885248:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 114us (659us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065182.061012:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2431 00002000:00100000:1.0:1746065182.061017:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2818048->2822143) req@ffff88009a4e8700 x1830881262885248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/4536 e 0 to 0 dl 1746065193 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.061029:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8700 with x1830881262885248 ext(2818048->2822143) 00010000:00010000:1.0:1746065182.061033:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9a00/0x14b4f8542d4fbcec lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f9 expref: 20 pid: 8851 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.061041:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9a00/0x14b4f8542d4fbcec lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f9 expref: 20 pid: 8851 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746065182.061046:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e8700 00000100:00100000:0.0:1746065182.063248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.063365:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.068986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.069025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.069065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.069432:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262886144 00000100:00100000:1.0:1746065182.069437:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262886144 00000100:00100000:1.0:1746065182.069469:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14220 00000100:00100000:1.0:1746065182.069473:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31554:x1830881262886144:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065182.069479:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.069491:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982af600/0x14b4f8542d4fbcfa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60107 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.069510:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c394000/0x14b4f8542d4fbce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f2 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.069516:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065182.069517:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065182.069521:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982af600/0x14b4f8542d4fbcfa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->2732031] (req 2097152->2732031) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60107 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.069542:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c394000/0x14b4f8542d4fbce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f2 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.069554:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c394000/0x14b4f8542d4fbce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f2 expref: 9 pid: 2462 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065182.069563:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260294272:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065182.069609:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065182.073863:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260294272:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.073893:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982af600/0x14b4f8542d4fbcfa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->2732031] (req 2097152->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60107 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.073908:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982af600, rc 0) 00000100:00100000:1.0:1746065182.074385:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31554:x1830881262886144:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4908us (5355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.074393:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14220 00000100:00100000:1.0:1746065182.075183:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262886400 00000100:00100000:1.0:1746065182.075189:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262886400 00002000:00100000:1.0:1746065182.075216:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2732032->3145727) req@ffff880135cdce00 x1830881262886400/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.075224:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdce00 with x1830881262886400 ext(2732032->3145727) 00010000:00010000:1.0:1746065182.075231:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c394000/0x14b4f8542d4fbce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f2 expref: 10 pid: 2462 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.075240:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c394000/0x14b4f8542d4fbce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f2 expref: 10 pid: 2462 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746065182.075250:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135cdce00 00000100:00100000:1.0:1746065182.075264:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2433 00000100:00100000:1.0:1746065182.075269:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881262886400:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065182.085542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.088504:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262886528 00000100:00100000:0.0:1746065182.088514:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262886528 00000100:00100000:0.0:1746065182.088571:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14221 00000100:00100000:0.0:1746065182.088579:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:31557:x1830881262886528:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.088593:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.088606:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8a00/0x14b4f8542d4fbd08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60115 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.088623:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.088625:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.088632:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8a00/0x14b4f8542d4fbd08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60115 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.088643:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8a00/0x14b4f8542d4fbd08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60115 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.088651:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0f8a00, rc 0) 00000100:00100000:0.0:1746065182.088707:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:31557:x1830881262886528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 128us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.088712:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14221 00000100:00100000:1.0:1746065182.090787:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881262886400:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 15511us (15675us total) trans 17179873552 rc 0/0 00000100:00100000:1.0:1746065182.090796:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2433 00002000:00100000:1.0:1746065182.090804:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2732032->3145727) req@ffff880135cdce00 x1830881262886400/t17179873552(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/448 e 0 to 0 dl 1746065193 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.090832:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdce00 with x1830881262886400 ext(2732032->3145727) 00010000:00010000:1.0:1746065182.090840:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c394000/0x14b4f8542d4fbce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f2 expref: 12 pid: 2462 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.090852:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c394000/0x14b4f8542d4fbce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600f2 expref: 12 pid: 2462 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746065182.090858:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135cdce00 00000100:00100000:0.0:1746065182.093720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.093807:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.093924:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262886912 00000100:00100000:1.0:1746065182.093933:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262886912 00002000:00100000:1.0:1746065182.093969:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880134d87800 x1830881262886912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.093978:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d87800 with x1830881262886912 ext(3145728->4194303) 00010000:00010000:1.0:1746065182.093985:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f363600/0x14b4f8542d4fbcf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60100 expref: 19 pid: 8851 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.093996:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f363600/0x14b4f8542d4fbcf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60100 expref: 19 pid: 8851 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746065182.094002:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d87800 00000100:00100000:1.0:1746065182.094017:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2434 00000100:00100000:1.0:1746065182.094023:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262886912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065182.095808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.104179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.107935:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262886912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13902us (14211us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065182.107946:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2434 00002000:00100000:1.0:1746065182.107956:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880134d87800 x1830881262886912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.107964:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d87800 with x1830881262886912 ext(3145728->4194303) 00010000:00010000:1.0:1746065182.107973:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f363600/0x14b4f8542d4fbcf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60100 expref: 19 pid: 8851 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.107986:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f363600/0x14b4f8542d4fbcf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60100 expref: 19 pid: 8851 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746065182.107991:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134d87800 00000100:00100000:0.0:1746065182.110546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.115685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.121552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.121613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.123274:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7232 00000100:00100000:1.0:1746065182.123802:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881262888320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.123960:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.123986:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f363600/0x14b4f8542d4fbcf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60100 expref: 19 pid: 8851 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.124001:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f363600/0x14b4f8542d4fbcf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60100 expref: 19 pid: 8851 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.124020:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f363600/0x14b4f8542d4fbcf3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60100 expref: 19 pid: 8851 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.124045:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.124047:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.124053:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6010e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.124060:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6010e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.124084:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6010e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065182.124094:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260294912:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065182.124626:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.129260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.129711:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260294912:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065182.129722:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065182.129752:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881262888320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6471us (8138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.129759:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7232 00000100:00100000:0.0:1746065182.131779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.132533:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262888704 00000100:00100000:1.0:1746065182.132541:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262888704 00002000:00100000:1.0:1746065182.132577:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3371008->3375103) req@ffff880134d85180 x1830881262888704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.132586:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85180 with x1830881262888704 ext(3371008->3375103) 00002000:00010000:1.0:1746065182.132590:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d85180 00000100:00100000:1.0:1746065182.132621:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7980 00000100:00100000:1.0:1746065182.132628:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262888704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065182.132859:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262888704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 181us (1036us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065182.132867:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7980 00002000:00100000:1.0:1746065182.132873:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3371008->3375103) req@ffff880134d85180 x1830881262888704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/4536 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.132879:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d85180 with x1830881262888704 ext(3371008->3375103) 00002000:00010000:1.0:1746065182.132882:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d85180 00000100:00100000:1.0:1746065182.137299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.138339:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262888960 00000100:00100000:0.0:1746065182.138343:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262888960 00000100:00100000:0.0:1746065182.138362:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14224 00000100:00100000:0.0:1746065182.138368:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881262888960:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.138375:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.138738:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fbd1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6012a expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065182.138763:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d85f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260295168:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065182.138796:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21da80 going to sleep for 11 seconds 00002000:00010000:1.0:1746065182.142996:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065181 -> 1746065183 00000100:00100000:1.0:1746065182.143009:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260295168:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065182.143027:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fbd1d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6012a expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.143232:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fbd1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6012a expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.143250:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f6a00, rc 0) 00000100:00100000:1.0:1746065182.143570:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881262888960:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4917us (5139us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065182.143578:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14224 00000100:00100000:0.0:1746065182.146258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.146337:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262889344 00000100:00100000:1.0:1746065182.146345:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262889344 00000100:00100000:1.0:1746065182.146418:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14225 00000100:00100000:1.0:1746065182.146426:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:31556:x1830881262889344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065182.146440:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.146454:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fbd24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60131 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.146477:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6010e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.146483:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065182.146484:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065182.146487:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fbd24 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4993023] (req 4194304->4993023) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60131 expref: 19 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.146511:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6010e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.146521:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6010e expref: 11 pid: 8851 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065182.146531:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260295296:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.147437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.147477:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.149288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.149351:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260295296:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.149373:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fbd24 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4993023] (req 4194304->4993023) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60131 expref: 19 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.149382:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec4b600, rc 0) 00000100:00100000:1.0:1746065182.149408:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:31556:x1830881262889344:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2983us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.149416:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14225 00000100:00100000:0.0:1746065182.154542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.155125:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262889856 00000100:00100000:1.0:1746065182.155132:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262889856 00002000:00100000:1.0:1746065182.155165:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012e8b6a00 x1830881262889856/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.155176:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6a00 with x1830881262889856 ext(2097152->3145727) 00002000:00010000:1.0:1746065182.155181:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b6a00 00000100:00100000:1.0:1746065182.155392:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7981 00000100:00100000:1.0:1746065182.155401:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262889856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065182.163136:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262889856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7725us (8585us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065182.163146:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7981 00002000:00100000:1.0:1746065182.163156:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012e8b6a00 x1830881262889856/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.163164:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6a00 with x1830881262889856 ext(2097152->3145727) 00002000:00010000:1.0:1746065182.163169:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b6a00 00000100:00100000:0.0:1746065182.167522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.169353:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262890240 00000100:00100000:1.0:1746065182.169364:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262890240 00002000:00100000:1.0:1746065182.170305:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88012e8b5180 x1830881262890240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.170315:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5180 with x1830881262890240 ext(4194304->4993023) 00002000:00010000:1.0:1746065182.170320:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b5180 00000100:00100000:1.0:1746065182.170356:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7982 00000100:00100000:1.0:1746065182.170365:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262890240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.171441:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.178944:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262890240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8571us (11418us total) trans 0 rc 798720/798720 00000100:00100000:1.0:1746065182.178955:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7982 00002000:00100000:1.0:1746065182.178966:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4993023) req@ffff88012e8b5180 x1830881262890240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.178974:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5180 with x1830881262890240 ext(4194304->4993023) 00002000:00010000:1.0:1746065182.178979:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b5180 00000100:00100000:0.0:1746065182.192331:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.192377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.192420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.193269:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7984 00000100:00100000:0.0:1746065182.193277:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262891008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.200699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.219547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.242517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.258421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.369960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.385096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.419181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.419997:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262892672 00000100:00100000:0.0:1746065182.420005:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262892672 00000100:00100000:0.0:1746065182.420036:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14228 00000100:00100000:0.0:1746065182.420042:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31562:x1830881262892672:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065182.420054:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.420068:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6015b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.420090:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c394a00/0x14b4f8542d4fbd0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6011c expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.420097:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6013f expref: 26 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.420102:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.420103:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.420105:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6015b expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.420127:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6013f expref: 26 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.420138:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6013f expref: 26 pid: 2462 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.420147:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260295680:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.420226:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c394a00/0x14b4f8542d4fbd0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6011c expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.420232:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c394a00/0x14b4f8542d4fbd0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6011c expref: 11 pid: 2462 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.420239:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260295808:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.420252:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.421871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.429517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.439319:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260295680:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.439384:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260295808:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.439408:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6015b expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.439422:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012daa2400, rc 0) 00000100:00100000:0.0:1746065182.439446:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31562:x1830881262892672:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 19405us (20273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.439452:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14228 00000100:00100000:0.0:1746065182.439480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.439537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.439557:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262893312 00000100:00100000:0.0:1746065182.439562:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262893312 00010000:00010000:0.0:1746065182.439580:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6013f expref: 26 pid: 2462 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.439595:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262893440 00000100:00100000:0.0:1746065182.439597:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262893440 00010000:00010000:0.0:1746065182.439605:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c394a00/0x14b4f8542d4fbd0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6011c expref: 12 pid: 2462 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.439616:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7235 00000100:00100000:0.0:1746065182.439621:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262893312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.439630:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.439646:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6013f expref: 26 pid: 2462 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.439654:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6013f expref: 26 pid: 2462 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.439671:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c394e00/0x14b4f8542d4fbd32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6013f expref: 26 pid: 2462 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.439681:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.439693:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262893312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.439698:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7235 00000100:00100000:0.0:1746065182.439708:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7236 00000100:00100000:0.0:1746065182.439711:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262893440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.439716:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.439721:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c394a00/0x14b4f8542d4fbd0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6011c expref: 12 pid: 2462 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.439728:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c394a00/0x14b4f8542d4fbd0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6011c expref: 12 pid: 2462 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.439737:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c394a00/0x14b4f8542d4fbd0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6011c expref: 12 pid: 2462 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.439743:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.439744:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.439749:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6015b expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.439756:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6015b expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.439775:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6015b expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065182.439784:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260295936:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065182.439848:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.454223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.454244:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262893696 00000100:00100000:0.0:1746065182.454252:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262893696 00002000:00100000:0.0:1746065182.454286:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (4165632->4169727) req@ffff88009c3f9180 x1830881262893696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.454295:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830881262893696 ext(4165632->4169727) 00002000:00010000:0.0:1746065182.454299:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:0.0:1746065182.454313:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7987 00000100:00100000:0.0:1746065182.454318:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881262893696:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.454459:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881262893696:12345-192.168.202.46@tcp:3:cat.0 Request processed in 140us (244us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065182.454465:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7987 00002000:00100000:0.0:1746065182.454470:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (4165632->4169727) req@ffff88009c3f9180 x1830881262893696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/4536 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.454476:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830881262893696 ext(4165632->4169727) 00002000:00010000:0.0:1746065182.454478:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:1.0:1746065182.455515:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260295936:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065182.455531:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065182.455548:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881262893440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 15836us (16010us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.455555:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7236 00000100:00100000:0.0:1746065182.459570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.474310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.475084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.475104:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262894336 00000100:00100000:0.0:1746065182.475110:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262894336 00002000:00100000:0.0:1746065182.475141:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009c3f8e00 x1830881262894336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.475149:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8e00 with x1830881262894336 ext(1048576->2097151) 00002000:00010000:0.0:1746065182.475153:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f8e00 00000100:00100000:0.0:1746065182.475183:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262894592 00000100:00100000:0.0:1746065182.475185:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262894592 00002000:00100000:0.0:1746065182.475197:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009c3fa300 x1830881262894592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.475202:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830881262894592 ext(1048576->2097151) 00002000:00010000:0.0:1746065182.475205:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fa300 00000100:00100000:0.0:1746065182.475216:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7989 00000100:00100000:0.0:1746065182.475223:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881262894336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.476380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.476396:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262894848 00000100:00100000:0.0:1746065182.476400:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262894848 00002000:00100000:0.0:1746065182.476417:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009c3f8a80 x1830881262894848/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.476424:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8a80 with x1830881262894848 ext(1048576->2097151) 00002000:00010000:0.0:1746065182.476428:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f8a80 00000100:00100000:0.0:1746065182.476439:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7990 00000100:00100000:0.0:1746065182.476445:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881262894592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.478722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.478757:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262894976 00000100:00100000:0.0:1746065182.478763:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262894976 00010000:00010000:0.0:1746065182.478787:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e23200/0x14b4f8542d4fbd2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60138 expref: 14 pid: 8427 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.478844:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7237 00000100:00100000:0.0:1746065182.478851:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881262894976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.478860:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.478875:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e23200/0x14b4f8542d4fbd2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60138 expref: 14 pid: 8427 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.478886:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e23200/0x14b4f8542d4fbd2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60138 expref: 14 pid: 8427 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.478907:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.478932:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881262894976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.478937:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7237 00000100:00100000:0.0:1746065182.479063:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7991 00000100:00100000:0.0:1746065182.479070:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262894848:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065182.480258:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e23200/0x14b4f8542d4fbd2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60138 expref: 13 pid: 8427 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.480276:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260296064:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.480286:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260296192:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.480309:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e22800/0x14b4f8542d4fbdb0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60169 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.480319:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e22800, rc 0) 00000100:00100000:0.0:1746065182.480341:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:31562:x1830881262893824:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 19326us (20779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.480347:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14229 00000100:00100000:0.0:1746065182.490604:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262895104 00000100:00100000:0.0:1746065182.490612:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262895104 00000100:00100000:1.0:1746065182.490651:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262895232 00000100:00100000:1.0:1746065182.490654:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262895232 00000100:00100000:1.0:1746065182.490683:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14230 00000100:00100000:1.0:1746065182.490689:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881262895232:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065182.490703:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.490718:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fbdb7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60170 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065182.490745:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262895360 00000100:00100000:1.0:1746065182.490747:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262895360 00010000:00010000:0.0:1746065182.490869:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fbd24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60131 expref: 24 pid: 8427 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065182.490881:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14231 00000100:00100000:0.0:1746065182.490886:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7238 00000100:00100000:1.0:1746065182.490887:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881262895360:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065182.490890:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881262895104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.490895:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.490898:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.490904:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c67000/0x14b4f8542d4fbdbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60177 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.490916:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fbd24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60131 expref: 24 pid: 8427 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.490925:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fbd24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60131 expref: 24 pid: 8427 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065182.490939:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260296320:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065182.490941:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec4b600/0x14b4f8542d4fbd24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4993023) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60131 expref: 24 pid: 8427 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.490953:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.490955:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.490961:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e22800/0x14b4f8542d4fbdb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60169 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.490967:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e22800/0x14b4f8542d4fbdb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60169 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.490984:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094e22800/0x14b4f8542d4fbdb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60169 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065182.490991:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260296448:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065182.491418:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065182.491440:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260296576:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065182.491459:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.491694:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.500233:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260296576:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065182.500270:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fbdb7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60170 expref: 14 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.500284:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fbdb7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60170 expref: 14 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.500299:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c66e00, rc 0) 00000100:00100000:0.0:1746065182.500371:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881262895232:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9681us (9760us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065182.500378:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14230 00000100:00100000:1.0:1746065182.503968:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260296320:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065182.504002:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c67000/0x14b4f8542d4fbdbe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60177 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.504016:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c67000/0x14b4f8542d4fbdbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60177 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.504045:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c67000, rc 0) 00000100:00100000:1.0:1746065182.504093:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881262895360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 13204us (13382us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065182.504100:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14231 00000100:00100000:1.0:1746065182.508131:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881262894336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 32823us (33744us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065182.508143:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7989 00002000:00100000:1.0:1746065182.508153:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009c3f8e00 x1830881262894336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.508161:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8e00 with x1830881262894336 ext(1048576->2097151) 00002000:00010000:1.0:1746065182.508166:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f8e00 00000100:00100000:0.0:1746065182.512085:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.513750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.514495:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262895744 00000100:00100000:1.0:1746065182.514501:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262895744 00000100:00100000:1.0:1746065182.514529:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14232 00000100:00100000:1.0:1746065182.514535:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:31569:x1830881262895744:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065182.514546:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.514563:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c66400/0x14b4f8542d4fbdc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6017e expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.514587:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6015b expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.514594:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065182.514596:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065182.514599:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c66400/0x14b4f8542d4fbdc5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6017e expref: 12 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.514627:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6015b expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.514637:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012daa2400/0x14b4f8542d4fbd94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6015b expref: 26 pid: 8427 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065182.514654:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260296704:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065182.515337:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065182.520984:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260296704:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.521009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065182.521017:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c66400/0x14b4f8542d4fbdc5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6017e expref: 12 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.521384:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c66400, rc 0) 00000100:00100000:1.0:1746065182.521413:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:31569:x1830881262895744:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6877us (7663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.521419:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14232 00000100:00100000:0.0:1746065182.528635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.528688:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.528699:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262896000 00000100:00100000:1.0:1746065182.528762:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262896000 00000100:00100000:1.0:1746065182.528839:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14233 00000100:00100000:1.0:1746065182.528847:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:31566:x1830881262896000:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065182.528865:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.528880:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c67a00/0x14b4f8542d4fbdcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60185 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.528906:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4fbbaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6004a expref: 7 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.528914:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0d600/0x14b4f8542d4fbcad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600c8 expref: 14 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.528924:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fbc59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60082 expref: 18 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.528929:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.528930:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.528933:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c67a00/0x14b4f8542d4fbdcc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60185 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.528956:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fbc59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60082 expref: 18 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.528965:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fbc59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60082 expref: 18 pid: 8427 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.528977:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260296832:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.529050:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0d600/0x14b4f8542d4fbcad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600c8 expref: 14 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.529057:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f0d600/0x14b4f8542d4fbcad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600c8 expref: 14 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.529064:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260296960:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.529081:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4fbbaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6004a expref: 7 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.529092:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4fbbaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6004a expref: 7 pid: 8429 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.529099:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260297088:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065182.529114:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.532057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.532129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.533151:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260296832:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.533160:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b530cc00/0x14b4f8542d4fbbaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6004a expref: 7 pid: 8429 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.533172:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260297088:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065182.534958:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260296960:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.534972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065182.534989:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c67a00/0x14b4f8542d4fbdcc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60185 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.535000:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c67a00, rc 0) 00000100:00100000:1.0:1746065182.535037:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+14:31566:x1830881262896000:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6190us (6410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.535044:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14233 00000100:00100000:0.0:1746065182.538319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.538405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.543880:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.545450:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262897152 00000100:00100000:1.0:1746065182.545477:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262897152 00002000:00100000:1.0:1746065182.545532:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880134d84000 x1830881262897152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.545541:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84000 with x1830881262897152 ext(2097152->3145727) 00002000:00010000:1.0:1746065182.545547:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84000 00000100:00100000:1.0:1746065182.545574:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7993 00000100:00100000:1.0:1746065182.545582:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262897152:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.548975:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260297344:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065182.548992:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.549024:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881262896640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 10584us (10712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.549033:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7242 00000100:00100000:1.0:1746065182.549137:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262897536 00000100:00100000:1.0:1746065182.549142:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262897536 00002000:00100000:1.0:1746065182.549164:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1789952->1794047) req@ffff88009baa0e00 x1830881262897536/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.549173:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0e00 with x1830881262897536 ext(1789952->1794047) 00002000:00010000:1.0:1746065182.549177:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa0e00 00000100:00100000:1.0:1746065182.549199:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7994 00000100:00100000:1.0:1746065182.549203:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881262897536:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065182.549316:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881262897536:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 112us (367us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065182.549321:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7994 00002000:00100000:1.0:1746065182.549326:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1789952->1794047) req@ffff88009baa0e00 x1830881262897536/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/4536 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.549332:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0e00 with x1830881262897536 ext(1789952->1794047) 00002000:00010000:1.0:1746065182.549334:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa0e00 00000100:00100000:0.0:1746065182.558302:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.558856:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262897152:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13273us (14986us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065182.558866:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7993 00002000:00100000:1.0:1746065182.558877:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880134d84000 x1830881262897152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.558890:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d84000 with x1830881262897152 ext(2097152->3145727) 00002000:00010000:1.0:1746065182.558894:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134d84000 00000100:00100000:0.0:1746065182.559788:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262897792 00000100:00100000:0.0:1746065182.559791:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262897792 00000100:00100000:0.0:1746065182.559837:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14236 00000100:00100000:0.0:1746065182.559843:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:31569:x1830881262897792:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.559850:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.559856:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4fbdfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e601a1 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.559865:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.559867:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.559873:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4fbdfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601a1 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.559883:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4fbdfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601a1 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.559892:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a9400, rc 0) 00000100:00100000:0.0:1746065182.559911:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:31569:x1830881262897792:12345-192.168.202.46@tcp:101:cat.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.559916:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14236 00000100:00100000:0.0:1746065182.569708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.569749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.569782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.569805:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262897920 00000100:00100000:0.0:1746065182.569842:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262897920 00000100:00100000:0.0:1746065182.569871:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262898176 00000100:00100000:0.0:1746065182.569874:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262898176 00000100:00100000:0.0:1746065182.569882:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262898048 00000100:00100000:0.0:1746065182.569883:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262898048 00000100:00100000:0.0:1746065182.569895:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14237 00000100:00100000:0.0:1746065182.569901:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013071a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262897920:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065182.569916:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.569929:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a8800/0x14b4f8542d4fbe04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e601a8 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065182.569968:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260297728:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065182.570043:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.570137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.570156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.570170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.570184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.570197:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262898944 00000100:00100000:0.0:1746065182.570200:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262898944 00010000:00010000:0.0:1746065182.570215:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8a00/0x14b4f8542d4fbd08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60115 expref: 16 pid: 8427 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.570231:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7243 00000100:00100000:0.0:1746065182.570236:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881262898944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.570242:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.570259:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8a00/0x14b4f8542d4fbd08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60115 expref: 16 pid: 8427 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.570273:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8a00/0x14b4f8542d4fbd08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60115 expref: 16 pid: 8427 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.570292:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.570315:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881262898944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.570322:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7243 00000100:00100000:0.0:1746065182.570369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.570382:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262899072 00000100:00100000:0.0:1746065182.570385:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262899072 00010000:00010000:0.0:1746065182.570395:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fbdd3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6018c expref: 19 pid: 8427 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.570407:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7244 00000100:00100000:0.0:1746065182.570411:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881262899072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.570417:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.570423:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fbdd3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6018c expref: 19 pid: 8427 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.570431:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fbdd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6018c expref: 19 pid: 8427 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.570441:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.570443:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.570448:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a275e00/0x14b4f8542d4fbdf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2580479) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6019a expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.570455:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a275e00/0x14b4f8542d4fbdf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2580479) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6019a expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.570477:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a275e00/0x14b4f8542d4fbdf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2580479) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6019a expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065182.570485:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260297856:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065182.570503:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.570551:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262898816 00000100:00100000:0.0:1746065182.570554:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262898816 00000100:00100000:0.0:1746065182.570573:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14238 00000100:00100000:0.0:1746065182.570578:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262898176:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065182.570584:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.570593:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0a8e00/0x14b4f8542d4fbe0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e601b6 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.570604:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.570605:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.570609:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a8e00/0x14b4f8542d4fbe0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601b6 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.570618:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a8e00/0x14b4f8542d4fbe0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601b6 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.570625:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a8e00, rc 0) 00000100:00100000:0.0:1746065182.570642:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262898176:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 64us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.570647:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14238 00000100:00100000:0.0:1746065182.570657:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14239 00000100:00100000:0.0:1746065182.570662:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262898048:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065182.570666:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.570670:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9000/0x14b4f8542d4fbe12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e601af expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065182.570688:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260297984:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065182.570705:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b6a03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.570717:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14240 00000100:00100000:0.0:1746065182.570722:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31572:x1830881262898816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.570726:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.570732:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a2b800/0x14b4f8542d4fbe19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e601bd expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.570740:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.570741:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.570745:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a2b800/0x14b4f8542d4fbe19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601bd expref: 27 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.570752:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a2b800/0x14b4f8542d4fbe19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601bd expref: 27 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.570758:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a2b800, rc 0) 00000100:00100000:0.0:1746065182.570770:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31572:x1830881262898816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 48us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.570774:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14240 00000100:00100000:0.0:1746065182.570790:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262898432 00000100:00100000:0.0:1746065182.570793:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262898432 00002000:00100000:0.0:1746065182.570839:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012e8b7480 x1830881262898432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.570847:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7480 with x1830881262898432 ext(3145728->4194303) 00002000:00010000:0.0:1746065182.570851:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b7480 00000100:00100000:0.0:1746065182.570861:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262898688 00000100:00100000:0.0:1746065182.570864:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262898688 00002000:00100000:0.0:1746065182.570874:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012e8b5500 x1830881262898688/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.570880:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5500 with x1830881262898688 ext(3145728->4194303) 00002000:00010000:0.0:1746065182.570882:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b5500 00000100:00100000:0.0:1746065182.570891:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7995 00000100:00100000:0.0:1746065182.570895:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881262898432:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065182.572385:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7996 00000100:00100000:1.0:1746065182.572395:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881262898688:12345-192.168.202.46@tcp:3:multiop.0 00002000:00010000:0.0:1746065182.580754:0:2462:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065180 -> 1746065183 00002000:00010000:0.0:1746065182.580761:0:2462:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065178 -> 1746065183 00002000:00010000:0.0:1746065182.580763:0:2462:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065180 -> 1746065183 00000100:00100000:0.0:1746065182.580783:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260297728:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065182.580834:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a8800/0x14b4f8542d4fbe04 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601a8 expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.580848:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a8800/0x14b4f8542d4fbe04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601a8 expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.583156:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a8800, rc 0) 00000100:00100000:0.0:1746065182.583223:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013071a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262897920:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 13317us (13517us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065182.583231:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14237 00002000:00010000:0.0:1746065182.583387:0:2463:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size: 4989376 -> 5012160 00000100:00100000:0.0:1746065182.583401:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260297984:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065182.583425:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9000/0x14b4f8542d4fbe12 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601af expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.583436:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9000/0x14b4f8542d4fbe12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601af expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.583445:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a9000, rc 0) 00000100:00100000:0.0:1746065182.583461:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881262898048:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 12799us (13679us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065182.583466:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14239 00000100:00100000:0.0:1746065182.583494:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260297856:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065182.583502:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.583517:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881262899072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 13105us (13148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.583524:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7244 00000100:00100000:0.0:1746065182.592983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.594882:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.598150:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881262898432:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 27250us (28009us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065182.598159:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7995 00002000:00100000:1.0:1746065182.598166:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012e8b7480 x1830881262898432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.598174:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7480 with x1830881262898432 ext(3145728->4194303) 00002000:00010000:1.0:1746065182.598178:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b7480 00000100:00100000:1.0:1746065182.599686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.602829:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881262898688:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 30415us (32654us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065182.602838:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7996 00002000:00100000:0.0:1746065182.602846:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012e8b5500 x1830881262898688/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.602854:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5500 with x1830881262898688 ext(3145728->4194303) 00002000:00010000:0.0:1746065182.602859:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b5500 00000100:00100000:1.0:1746065182.610017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.610028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.610046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.610956:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262900096 00000100:00100000:0.0:1746065182.610963:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262900096 00010000:00010000:0.0:1746065182.610989:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3400/0x14b4f8542d4fbd71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6014d expref: 14 pid: 14644 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.611006:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262899968 00000100:00100000:0.0:1746065182.611008:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262899968 00010000:00010000:0.0:1746065182.611014:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a275200/0x14b4f8542d4fbdef lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60193 expref: 9 pid: 14645 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.611028:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262900224 00000100:00100000:0.0:1746065182.611029:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262900224 00010000:00010000:0.0:1746065182.611036:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3600/0x14b4f8542d4fbd4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60146 expref: 255 pid: 14644 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746065182.611046:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7245 00000100:00100000:0.0:1746065182.611051:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881262900096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.611061:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.611065:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3400/0x14b4f8542d4fbd71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6014d expref: 14 pid: 14644 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611072:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3400/0x14b4f8542d4fbd71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6014d expref: 14 pid: 14644 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611087:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3400/0x14b4f8542d4fbd71 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6014d expref: 14 pid: 14644 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611102:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065182.611106:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3800/0x14b4f8542d4fbe27 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.611113:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3800/0x14b4f8542d4fbe27 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.611117:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.611147:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881262900096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.611153:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7245 00000100:00100000:0.0:1746065182.611168:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7246 00000100:00100000:0.0:1746065182.611172:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881262899968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.611177:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.611180:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a275200/0x14b4f8542d4fbdef lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60193 expref: 9 pid: 14645 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611186:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a275200/0x14b4f8542d4fbdef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60193 expref: 9 pid: 14645 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611194:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a275200/0x14b4f8542d4fbdef lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60193 expref: 9 pid: 14645 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611201:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065182.611204:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3800/0x14b4f8542d4fbe27 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.611208:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3800/0x14b4f8542d4fbe27 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.611213:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.611222:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881262899968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.611226:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7246 00000100:00100000:0.0:1746065182.611233:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7247 00000100:00100000:0.0:1746065182.611236:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1960:x1830881262900224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.611240:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.611243:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3600/0x14b4f8542d4fbd4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60146 expref: 255 pid: 14644 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611250:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3600/0x14b4f8542d4fbd4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60146 expref: 255 pid: 14644 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611258:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3600/0x14b4f8542d4fbd4e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60146 expref: 255 pid: 14644 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746065182.611264:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065182.611266:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3800/0x14b4f8542d4fbe27 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.611271:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3800/0x14b4f8542d4fbe27 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.611276:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d3800/0x14b4f8542d4fbe27 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065182.611354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065182.612333:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.612362:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1960:x1830881262900224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1124us (2313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.612368:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7247 00000100:00100000:0.0:1746065182.616386:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262900608 00000100:00100000:0.0:1746065182.616398:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262900608 00000100:00100000:0.0:1746065182.616459:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14241 00000100:00100000:0.0:1746065182.616467:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262900608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.616483:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.616496:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fbe35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e601cb expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065182.616540:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260298496:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065182.616637:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.619064:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.619858:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260298496:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065182.619881:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fbe35 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601cb expref: 15 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.619889:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fbe35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601cb expref: 15 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.619896:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c757e00, rc 0) 00000100:00100000:0.0:1746065182.619913:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262900608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3448us (5648us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065182.619919:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14241 00000100:00100000:0.0:1746065182.629113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.629155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.629175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.629205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.630696:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8000 00000100:00100000:1.0:1746065182.630706:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262901632:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.641718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.649377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.649411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.649428:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262902016 00000100:00100000:1.0:1746065182.649435:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262902016 00000100:00100000:1.0:1746065182.649462:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262902272 00000100:00100000:1.0:1746065182.649464:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262902272 00000100:00100000:1.0:1746065182.649481:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14244 00000100:00100000:1.0:1746065182.649486:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881262902016:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065182.649517:0:2463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.649531:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.649538:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 14 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.649544:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fbc44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6006d expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.649549:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.649550:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.649552:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.649574:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fbc44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6006d expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.649582:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fbc44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6006d expref: 22 pid: 8427 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.649592:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260298752:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.650408:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 14 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.650417:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 14 pid: 4545 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.650425:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260299008:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.650888:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.650895:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 7 pid: 8429 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.650902:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260299392:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065182.650917:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065182.657732:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881262901632:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27019us (28517us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065182.657743:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8000 00002000:00100000:1.0:1746065182.657753:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012f10d880 x1830881262901632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.657762:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f10d880 with x1830881262901632 ext(3145728->4194303) 00010000:00010000:1.0:1746065182.657770:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135474a00/0x14b4f8542d4fbe3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d2 expref: 21 pid: 2462 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.657782:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135474a00/0x14b4f8542d4fbe3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d2 expref: 21 pid: 2462 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746065182.657794:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f10d880 00000100:00100000:0.0:1746065182.673244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.673268:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262903040 00000100:00100000:0.0:1746065182.673275:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262903040 00010000:00010000:0.0:1746065182.673302:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8e00/0x14b4f8542d4fbb8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60043 expref: 12 pid: 9716 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.673327:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7248 00000100:00100000:0.0:1746065182.673334:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881262903040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.673344:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.673362:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8e00/0x14b4f8542d4fbb8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60043 expref: 12 pid: 9716 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.673372:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8e00/0x14b4f8542d4fbb8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60043 expref: 12 pid: 9716 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.673393:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.673427:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881262903040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.673433:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7248 00000100:00100000:0.0:1746065182.673467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.673478:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262902912 00000100:00100000:0.0:1746065182.673480:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262902912 00010000:00010000:0.0:1746065182.673490:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f14e000/0x14b4f8542d4fbcbb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600c1 expref: 12 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.673507:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7249 00000100:00100000:0.0:1746065182.673511:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262902912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.673517:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.673523:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f14e000/0x14b4f8542d4fbcbb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600c1 expref: 12 pid: 21235 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.673529:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260298752:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.673530:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f14e000/0x14b4f8542d4fbcbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600c1 expref: 12 pid: 21235 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.673540:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.673552:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262902912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 41us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.673557:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7249 00000100:00100000:0.0:1746065182.673595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.673695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.673705:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262902784 00000100:00100000:0.0:1746065182.673708:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262902784 00010000:00010000:0.0:1746065182.673719:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fbc44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6006d expref: 21 pid: 8427 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.673722:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262903168 00000100:00100000:1.0:1746065182.673726:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262903168 00000100:00100000:0.0:1746065182.673734:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7250 00000100:00100000:0.0:1746065182.673739:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881262902784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.673741:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 15 pid: 4545 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.673746:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.673758:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fbc44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6006d expref: 21 pid: 8427 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.673765:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fbc44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6006d expref: 21 pid: 8427 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.673766:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7251 00000100:00100000:1.0:1746065182.673771:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881262903168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.673778:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.673778:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fbc44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6006d expref: 21 pid: 8427 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.673787:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 15 pid: 4545 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.673791:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065182.673795:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 15 pid: 4545 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.673830:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.673835:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881262902784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.673841:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7250 00000100:00100000:1.0:1746065182.673848:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881262903168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.673854:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7251 00000100:00100000:0.0:1746065182.673884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065182.673894:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5e00/0x14b4f8542d4fbc9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600b3 expref: 14 pid: 4545 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.673905:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260299008:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.673907:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.673915:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130447480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260299392:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.673917:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262903424 00000100:00100000:0.0:1746065182.673929:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262903424 00010000:00010000:1.0:1746065182.673935:0:2463:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.673940:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4fbdfd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601a1 expref: 14 pid: 8851 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065182.673946:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262903680 00000100:00100000:1.0:1746065182.673949:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262903680 00000100:00100000:0.0:1746065182.673954:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7252 00010000:00010000:1.0:1746065182.673958:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093f0d000/0x14b4f8542d4fbc4b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60074 expref: 27 pid: 8427 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.673958:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881262903424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.673963:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065182.673970:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7253 00010000:00010000:0.0:1746065182.673971:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4fbdfd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601a1 expref: 14 pid: 8851 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065182.673974:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881262903680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.673978:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0a9400/0x14b4f8542d4fbdfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601a1 expref: 14 pid: 8851 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.673979:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.673988:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093f0d000/0x14b4f8542d4fbc4b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60074 expref: 27 pid: 8427 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.673992:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065182.673994:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093f0d000/0x14b4f8542d4fbc4b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60074 expref: 27 pid: 8427 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.674003:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.674004:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881262903424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.674009:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7252 00000100:00100000:1.0:1746065182.674016:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881262903680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 42us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.674021:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7253 00000100:00100000:0.0:1746065182.674042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.674059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.674103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.674130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.674140:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262903296 00000100:00100000:0.0:1746065182.674143:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262903296 00010000:00010000:0.0:1746065182.674153:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 10 pid: 8429 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.674165:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262903552 00000100:00100000:0.0:1746065182.674167:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262903552 00010000:00010000:0.0:1746065182.674175:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093f0c400/0x14b4f8542d4fbc52 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6007b expref: 27 pid: 8427 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.674187:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262903936 00000100:00100000:0.0:1746065182.674189:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262903936 00000100:00100000:1.0:1746065182.674191:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7254 00000100:00100000:1.0:1746065182.674197:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881262903296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.674197:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fbb9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6003c expref: 12 pid: 9716 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.674203:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065182.674207:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7255 00000100:00100000:0.0:1746065182.674212:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881262903552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.674213:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 10 pid: 8429 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.674217:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.674220:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 10 pid: 8429 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.674231:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b418fe00/0x14b4f8542d4fbb95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60035 expref: 10 pid: 8429 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.674231:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093f0c400/0x14b4f8542d4fbc52 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6007b expref: 26 pid: 8427 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.674238:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093f0c400/0x14b4f8542d4fbc52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6007b expref: 26 pid: 8427 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.674239:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.674241:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.674244:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.674247:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.674248:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.674250:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.674251:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135475800/0x14b4f8542d4fbe6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.674262:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135475800/0x14b4f8542d4fbe6d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.674264:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065182.674272:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065182.674277:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881262903296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.674282:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7254 00000100:00100000:0.0:1746065182.674288:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881262903552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.674293:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7256 00000100:00100000:1.0:1746065182.674297:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881262903936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.674302:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.674309:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fbb9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6003c expref: 11 pid: 9716 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.674317:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fbb9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6003c expref: 11 pid: 9716 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.674327:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fbb9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6003c expref: 11 pid: 9716 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.674334:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065182.674346:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262903936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.675291:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7255 00000100:00100000:0.0:1746065182.675329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.675341:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262904064 00000100:00100000:0.0:1746065182.675343:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262904064 00010000:00010000:0.0:1746065182.675355:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4fbca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600ba expref: 11 pid: 4545 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746065182.675368:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7257 00000100:00100000:0.0:1746065182.675373:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881262904064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.675379:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.675388:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4fbca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600ba expref: 11 pid: 4545 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.675395:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4fbca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600ba expref: 11 pid: 4545 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.675406:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a5200/0x14b4f8542d4fbca6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600ba expref: 11 pid: 4545 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746065182.675414:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.675415:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.675417:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1000/0x14b4f8542d4fbe7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.675423:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b1000/0x14b4f8542d4fbe7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.675435:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.675450:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262904064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.675455:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7257 00000100:00100000:1.0:1746065182.675754:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7256 00010000:00010000:1.0:1746065182.675780:0:2463:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.675786:0:2463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.675802:0:2463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.675831:0:2463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.675836:0:2463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.675840:0:2463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2e5a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065182.675843:0:2463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.675852:0:2463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.675861:0:2463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.675865:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2e5a00/0x14b4f8542d4fbe66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065182.675900:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262902016:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 26414us (26530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.675905:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14244 00000100:00100000:1.0:1746065182.675923:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2440 00000100:00100000:1.0:1746065182.675929:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881262904192:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065182.680457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.680519:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262904320 00000100:00100000:1.0:1746065182.680528:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262904320 00010000:00010000:1.0:1746065182.680566:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a8e00/0x14b4f8542d4fbe0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601b6 expref: 8 pid: 2463 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746065182.680610:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7258 00000100:00100000:1.0:1746065182.680618:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262904320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.680631:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.680653:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0a8e00/0x14b4f8542d4fbe0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601b6 expref: 8 pid: 2463 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.680668:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0a8e00/0x14b4f8542d4fbe0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601b6 expref: 8 pid: 2463 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.680688:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a8e00/0x14b4f8542d4fbe0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601b6 expref: 8 pid: 2463 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746065182.680701:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065182.680747:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881262904320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.680753:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7258 00000100:00100000:0.0:1746065182.681050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.681429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.681507:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262904576 00000100:00100000:1.0:1746065182.681510:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262904576 00010000:00010000:1.0:1746065182.681519:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a2b800/0x14b4f8542d4fbe19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601bd expref: 25 pid: 21235 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746065182.681532:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7260 00000100:00100000:1.0:1746065182.681537:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881262904576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.681542:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.681554:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a2b800/0x14b4f8542d4fbe19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601bd expref: 25 pid: 21235 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.681561:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a2b800/0x14b4f8542d4fbe19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601bd expref: 25 pid: 21235 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.681571:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a2b800/0x14b4f8542d4fbe19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601bd expref: 25 pid: 21235 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.681590:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065182.681609:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881262904576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.681614:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7260 00000100:00100000:1.0:1746065182.685143:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881262904192:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9207us (10520us total) trans 21474840818 rc 0/0 00000100:00100000:1.0:1746065182.685152:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2440 00002000:00100000:1.0:1746065182.685161:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1789952->2097151) req@ffff8800a5882300 x1830881262904192/t21474840818(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/448 e 0 to 0 dl 1746065193 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.685169:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882300 with x1830881262904192 ext(1789952->2097151) 00010000:00010000:1.0:1746065182.685177:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c67a00/0x14b4f8542d4fbdcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60185 expref: 17 pid: 21998 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.685188:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c67a00/0x14b4f8542d4fbdcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60185 expref: 17 pid: 21998 timeout: 881 lvb_type: 0 00002000:00010000:1.0:1746065182.685195:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5882300 00000100:00100000:0.0:1746065182.685381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.698650:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.698690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.698728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.698841:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2441 00000100:00100000:1.0:1746065182.698847:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881262905216:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.701922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.710173:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881262905216:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11317us (11523us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065182.710184:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2441 00002000:00100000:1.0:1746065182.710196:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88012f10df80 x1830881262905216/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/440 e 0 to 0 dl 1746065193 ref 1 fl Complete:H/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065182.710207:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f10df80 with x1830881262905216 ext(4194304->5013503) 00010000:00010000:1.0:1746065182.710215:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fbe5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601e7 expref: 15 pid: 21998 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746065182.710229:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fbe5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601e7 expref: 15 pid: 21998 timeout: 882 lvb_type: 0 00002000:00010000:1.0:1746065182.710236:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f10df80 00000100:00100000:0.0:1746065182.717481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.717517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.717594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.717640:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14252 00000100:00100000:0.0:1746065182.717646:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262905984:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065182.717657:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14253 00010000:00010000:0.0:1746065182.717657:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065182.717665:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262906112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065182.717673:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.717674:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4800/0x14b4f8542d4fbe97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e601fc expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.717682:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9272c00/0x14b4f8542d4fbea5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60203 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065182.717695:0:2463:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d71b, atime: 0x6812d71b, ctime: 0x6812d71b, blocks: 0x81f 00002000:00010000:0.0:1746065182.717695:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d71b, atime: 0x6812d71c, ctime: 0x6812d71b, blocks: 0x821 00010000:00010000:1.0:1746065182.717709:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.717709:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.717710:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.717710:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.717717:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4800/0x14b4f8542d4fbe97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601fc expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.717722:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9272c00/0x14b4f8542d4fbea5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60203 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.717730:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4800/0x14b4f8542d4fbe97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601fc expref: 12 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.717734:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9272c00/0x14b4f8542d4fbea5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60203 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.717738:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d4800, rc 0) 00010000:00010000:1.0:1746065182.717745:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9272c00, rc 0) 00000100:00100000:0.0:1746065182.717772:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881262905984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 127us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.717773:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881262906112:12345-192.168.202.46@tcp:101:cat.0 Request processed in 110us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.717778:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14252 00000100:00100000:1.0:1746065182.717782:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14253 00000100:00100000:0.0:1746065182.720525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.720558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.720579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.720608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.720631:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262906368 00000100:00100000:1.0:1746065182.720638:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262906368 00000100:00100000:1.0:1746065182.720674:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262906496 00000100:00100000:1.0:1746065182.720676:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262906496 00000100:00100000:1.0:1746065182.720686:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262906624 00000100:00100000:1.0:1746065182.720688:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262906624 00000100:00100000:0.0:1746065182.720694:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14254 00000100:00100000:0.0:1746065182.720702:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881262906368:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065182.720708:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14255 00000100:00100000:1.0:1746065182.720713:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881262906496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.720717:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.720720:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.720730:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbeac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60211 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.720730:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8d5e00/0x14b4f8542d4fbeb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6020a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.720747:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746065182.720748:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d71f, atime: 0x6812d71a, ctime: 0x6812d71f, blocks: 0x821 00010000:00010000:1.0:1746065182.720753:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbeac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60211 expref: 19 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.720755:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.720757:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.720762:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbeac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60211 expref: 19 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.720763:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8d5e00/0x14b4f8542d4fbeb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6020a expref: 19 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.720774:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3d9c00, rc 0) 00010000:00010000:0.0:1746065182.720775:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8d5e00/0x14b4f8542d4fbeb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6020a expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.720783:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d5e00, rc 0) 00000100:00100000:1.0:1746065182.720802:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+18:1958:x1830881262906496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 89us (222us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065182.720833:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881262906368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.720834:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14255 00000100:00100000:0.0:1746065182.720839:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14254 00000100:00100000:1.0:1746065182.720846:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14256 00000100:00100000:1.0:1746065182.720850:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881262906624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065182.720858:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.720865:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9600/0x14b4f8542d4fbeba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60218 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.720873:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.720874:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.720877:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9600/0x14b4f8542d4fbeba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60218 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.720885:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9600/0x14b4f8542d4fbeba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60218 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.720891:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3d9600, rc 0) 00000100:00100000:1.0:1746065182.720904:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881262906624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 54us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.720908:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14256 00000100:00100000:0.0:1746065182.723723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.723757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.723779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.723791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.723839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.723844:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262906752 00000100:00100000:1.0:1746065182.723852:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262906752 00000100:00100000:0.0:1746065182.723860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.723882:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262907136 00000100:00100000:1.0:1746065182.723884:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262907136 00000100:00100000:0.0:1746065182.723888:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262907264 00000100:00100000:0.0:1746065182.723890:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262907264 00000100:00100000:1.0:1746065182.723901:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14257 00000100:00100000:1.0:1746065182.723907:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881262906880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065182.723921:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.723935:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9400/0x14b4f8542d4fbec1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60226 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.723952:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.723954:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.723960:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9400/0x14b4f8542d4fbec1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60226 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.723973:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9400/0x14b4f8542d4fbec1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60226 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.723983:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3d9400, rc 0) 00000100:00100000:1.0:1746065182.724015:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262906880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 109us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.726054:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14258 00000100:00100000:0.0:1746065182.726066:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:31569:x1830881262906752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.726078:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.726090:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4000/0x14b4f8542d4fbec8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6021f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065182.726108:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d71f, atime: 0x6812d71f, ctime: 0x6812d71f, blocks: 0x1661 00010000:00010000:0.0:1746065182.726122:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.726124:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.726130:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4000/0x14b4f8542d4fbec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6021f expref: 17 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.726141:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4000/0x14b4f8542d4fbec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6021f expref: 17 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.726148:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d4000, rc 0) 00000100:00100000:0.0:1746065182.726176:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:31569:x1830881262906752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 113us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.726181:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14258 00000100:00100000:0.0:1746065182.726197:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14259 00000100:00100000:0.0:1746065182.726202:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262907008:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.726208:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.726216:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8d5c00/0x14b4f8542d4fbecf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6022d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.726226:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.726227:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.726231:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8d5c00/0x14b4f8542d4fbecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6022d expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.726240:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8d5c00/0x14b4f8542d4fbecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6022d expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.726246:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d5c00, rc 0) 00000100:00100000:0.0:1746065182.726259:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881262907008:12345-192.168.202.46@tcp:101:cat.0 Request processed in 58us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.726264:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14259 00000100:00100000:0.0:1746065182.726277:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14260 00000100:00100000:0.0:1746065182.726281:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262907136:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.726296:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.726302:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4400/0x14b4f8542d4fbed6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60234 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.726310:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.726311:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.726315:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4400/0x14b4f8542d4fbed6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60234 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.726322:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4400/0x14b4f8542d4fbed6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60234 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.726328:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d4400, rc 0) 00000100:00100000:0.0:1746065182.726349:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881262907136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 60us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.726353:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14260 00000100:00100000:0.0:1746065182.726363:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14261 00000100:00100000:0.0:1746065182.726368:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262907392:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.726374:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.726378:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4200/0x14b4f8542d4fbedd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60242 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.726388:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.726389:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.726393:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4200/0x14b4f8542d4fbedd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60242 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.726401:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4200/0x14b4f8542d4fbedd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60242 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.726406:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d4200, rc 0) 00000100:00100000:0.0:1746065182.726419:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881262907392:12345-192.168.202.46@tcp:101:cat.0 Request processed in 50us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.726424:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14261 00000100:00100000:1.0:1746065182.728158:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14257 00000100:00100000:0.0:1746065182.728736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.735372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.735399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.735566:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.735602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.735855:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.736382:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262908288 00000100:00100000:1.0:1746065182.736386:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262908288 00010000:00010000:1.0:1746065182.736400:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801330e1000/0x14b4f8542d4fbcde lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600eb expref: 254 pid: 20754 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746065182.736473:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7268 00000100:00100000:0.0:1746065182.736479:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262908416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.736486:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.736490:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9c00/0x14b4f8542d4fbcd7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600e4 expref: 14 pid: 14645 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065182.736498:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9c00/0x14b4f8542d4fbcd7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600e4 expref: 13 pid: 14645 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065182.736508:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065182.736510:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f08c600/0x14b4f8542d4fbeeb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.736515:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.736530:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881262908416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.736535:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7268 00000100:00100000:0.0:1746065182.736562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.736899:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7270 00000100:00100000:0.0:1746065182.736905:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881262908544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.737123:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.737128:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4d200/0x14b4f8542d4fbcd0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600dd expref: 12 pid: 14644 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065182.737136:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4d200/0x14b4f8542d4fbcd0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600dd expref: 12 pid: 14644 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065182.737146:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4d200/0x14b4f8542d4fbcd0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e600dd expref: 12 pid: 14644 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065182.737359:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065182.737362:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f08c600/0x14b4f8542d4fbeeb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.737369:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f08c600/0x14b4f8542d4fbeeb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.737374:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f08c600/0x14b4f8542d4fbeeb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065182.737397:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.737419:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881262908544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 513us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.737424:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7270 00000100:00100000:0.0:1746065182.737630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.747075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.757351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.757633:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262909184 00000100:00100000:0.0:1746065182.757640:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262909184 00000100:00100000:0.0:1746065182.757670:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9880 00000100:00100000:0.0:1746065182.757676:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31577:x1830881262909184:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065182.757691:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.758444:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2200/0x14b4f8542d4fbef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60250 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.758531:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.758542:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.758550:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.758561:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.758565:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.758569:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000001:00080000:0.0:1746065182.769096:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944081 is committed 00000004:00080000:0.0:1746065182.769102:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2350 committed 00000004:00080000:0.0:1746065182.769108:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2318 committed 00000004:00080000:0.0:1746065182.769113:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2317 committed 00000004:00080000:0.0:1746065182.769115:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2316 committed 00000004:00080000:0.0:1746065182.769116:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2315 committed 00000004:00080000:0.0:1746065182.769117:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2349 committed 00000004:00080000:0.0:1746065182.769119:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2314 committed 00000004:00080000:0.0:1746065182.769120:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2348 committed 00000004:00080000:0.0:1746065182.769122:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2313 committed 00000004:00080000:0.0:1746065182.769123:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2347 committed 00000004:00080000:0.0:1746065182.769125:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2346 committed 00000004:00080000:0.0:1746065182.769126:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2345 committed 00000004:00080000:0.0:1746065182.769127:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2312 committed 00000004:00080000:0.0:1746065182.769129:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2311 committed 00000004:00080000:0.0:1746065182.769130:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2344 committed 00000004:00080000:0.0:1746065182.769132:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2343 committed 00000004:00080000:0.0:1746065182.769133:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2310 committed 00000001:00080000:0.0:1746065182.769141:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944078 is committed 00000001:00080000:0.0:1746065182.769145:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944077 is committed 00000100:00100000:1.0:1746065182.769399:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260301696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.769440:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.769470:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260302208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.769485:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.769501:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065182.769506:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260302080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.769520:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.769530:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260302592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.769541:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.769561:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260301696 00000100:00100000:1.0:1746065182.769567:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260301696 00000100:00100000:1.0:1746065182.769604:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260302208 00000100:00100000:1.0:1746065182.769607:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260302208 00000100:00100000:1.0:1746065182.769616:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260302080 00000100:00100000:1.0:1746065182.769618:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260302080 00000100:00100000:1.0:1746065182.769627:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260302592 00000100:00100000:1.0:1746065182.769628:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260302592 00000100:00100000:1.0:1746065182.769639:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14263 00000100:00100000:1.0:1746065182.769644:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3296:x1830881260301696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065182.769797:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065182.769800:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065182.769802:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065182.769836:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065182.769838:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1957 -> 1957 00000100:00100000:1.0:1746065182.769861:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260301696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (420us total) trans 21474840820 rc 0/0 00000100:00100000:1.0:1746065182.769868:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14263 00000100:00100000:1.0:1746065182.769879:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14264 00000100:00100000:1.0:1746065182.769883:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3296:x1830881260302208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.769964:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260302208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (477us total) trans 21474840821 rc 0/0 00000100:00100000:1.0:1746065182.769969:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14264 00000100:00100000:1.0:1746065182.769977:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14265 00000100:00100000:1.0:1746065182.769982:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3296:x1830881260302080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065182.770044:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065182.770046:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.770048:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.770049:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.770051:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065182.770069:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260302080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (547us total) trans 21474840822 rc 0/0 00000100:00100000:1.0:1746065182.770073:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14265 00000100:00100000:1.0:1746065182.770082:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14266 00000100:00100000:1.0:1746065182.770087:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3296:x1830881260302592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.770159:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260302592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (616us total) trans 21474840823 rc 0/0 00000100:00100000:1.0:1746065182.770164:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14266 00010000:00010000:1.0:1746065182.770192:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.770205:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fbe4a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d9 expref: 7 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.770212:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.770233:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fbe4a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d9 expref: 7 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.770243:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fbe4a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d9 expref: 7 pid: 14645 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065182.770254:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260302720:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065182.770290:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d20c0 going to sleep for 11 seconds 00000004:00080000:1.0:1746065182.770348:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d85500/2, rc 0, transno 21474840822 00000100:00100000:1.0:1746065182.770355:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260302080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065182.770365:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b6d80/2, rc 0, transno 21474840823 00000100:00100000:1.0:1746065182.770367:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260302592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065182.770373:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d86a00/2, rc 0, transno 21474840820 00000100:00100000:1.0:1746065182.770375:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260301696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065182.770380:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b4000/2, rc 0, transno 21474840821 00000100:00100000:1.0:1746065182.770383:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260302208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.770409:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065182.770414:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260302848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.770430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.770446:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260302848 00000100:00100000:1.0:1746065182.770449:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260302848 00000100:00100000:1.0:1746065182.770463:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14267 00000100:00100000:1.0:1746065182.770467:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3295:x1830881260302848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.770548:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260302848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (116us total) trans 21474840824 rc 0/0 00000100:00100000:1.0:1746065182.770553:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14267 00000004:00080000:1.0:1746065182.770573:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130445f80/2, rc 0, transno 21474840824 00000100:00100000:1.0:1746065182.770576:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260302848:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746065182.771855:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065182.771859:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065182.772453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.772492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.772509:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262909312 00000100:00100000:0.0:1746065182.772512:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262909312 00010000:00010000:0.0:1746065182.772530:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fbe4a lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d9 expref: 8 pid: 14645 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746065182.772547:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7271 00000100:00100000:0.0:1746065182.772552:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262909312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065182.772559:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065182.772563:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fbe4a lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d9 expref: 8 pid: 14645 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065182.772572:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fbe4a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d9 expref: 8 pid: 14645 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065182.772587:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065182.772591:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.772597:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.772602:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.772613:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065182.772634:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262909312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.772640:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7271 00000100:00100000:1.0:1746065182.773292:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260303232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.773321:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.773410:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260303744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.773428:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.774031:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065182.774038:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260303360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.774058:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.774924:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260303872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.774947:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065182.776192:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fbe4a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601d9 expref: 8 pid: 14645 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065182.776206:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260302720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.776220:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776228:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776233:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065182.776245:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065182.776304:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776310:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776314:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776319:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3d9c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065182.776322:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776327:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776340:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065182.776342:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065182.776346:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776350:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3d9c00/0x14b4f8542d4fbf0e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776360:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776365:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776369:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776373:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938b3800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065182.776375:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776379:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776384:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065182.776386:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065182.776388:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776392:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3800/0x14b4f8542d4fbf00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776400:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776405:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776409:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776413:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938b3600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065182.776415:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776419:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776424:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669500) 00010000:00010000:1.0:1746065182.776426:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065182.776428:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776433:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3600/0x14b4f8542d4fbf07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.776472:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2200/0x14b4f8542d4fbef9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60250 expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.776479:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b2200/0x14b4f8542d4fbef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60250 expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.776485:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b2200, rc 0) 00000100:00100000:1.0:1746065182.776524:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31577:x1830881262909184:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 18848us (19178us total) trans 8589944083 rc 301/301 00000100:00100000:1.0:1746065182.776533:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9880 00000004:00080000:1.0:1746065182.776561:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdf100/2, rc 0, transno 17179873561 00000100:00100000:1.0:1746065182.776565:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260303360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.776571:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05f80/2, rc 0, transno 17179873562 00000100:00100000:1.0:1746065182.776573:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260303872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.776578:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdca80/2, rc 0, transno 17179873559 00000100:00100000:1.0:1746065182.776580:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260303232:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.776585:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd07800/2, rc 0, transno 17179873560 00000100:00100000:1.0:1746065182.776586:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260303744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065182.776734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.778999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.780541:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262909696 00000100:00100000:1.0:1746065182.780549:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262909696 00000100:00100000:1.0:1746065182.780602:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9882 00000100:00100000:1.0:1746065182.780610:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31574:x1830881262909696:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065182.780624:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.780639:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4e600/0x14b4f8542d4fbf23 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6025e expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.780700:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29e400/0x14b4f8542d4fbf2a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.780713:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29e400/0x14b4f8542d4fbf2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.780722:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29e400/0x14b4f8542d4fbf2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065182.780743:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:1.0:1746065182.780748:0:20754:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065182.780760:0:20754:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29e400/0x14b4f8542d4fbf2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.780778:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b4e600/0x14b4f8542d4fbf23 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6025e expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.780791:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29e400/0x14b4f8542d4fbf2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6025e expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.780798:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065182.780801:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065182.780803:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29e400, rc 0) 00000100:00100000:1.0:1746065182.780940:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31574:x1830881262909696:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 330us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.780946:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9882 00000100:00100000:0.0:1746065182.782438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.782535:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262909824 00000100:00100000:1.0:1746065182.782540:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262909824 00000100:00100000:1.0:1746065182.782571:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14280 00000100:00100000:1.0:1746065182.782578:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881262909824:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065182.782590:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.782603:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fbf31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60265 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.782621:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.782623:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.782631:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fbf31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60265 expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.782643:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fbf31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60265 expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.782652:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29e800, rc 0) 00000100:00100000:1.0:1746065182.782686:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881262909824:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 108us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.782691:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14280 00000100:00100000:0.0:1746065182.784367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.784395:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.784418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.784431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.785300:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262910336 00000100:00100000:1.0:1746065182.785305:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262910336 00000100:00100000:1.0:1746065182.785572:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262910208 00000100:00100000:1.0:1746065182.785575:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262910208 00000100:00100000:1.0:1746065182.785593:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14282 00000100:00100000:1.0:1746065182.785598:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262910336:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065182.785605:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.785616:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbf3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60281 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.785631:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.785633:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.785639:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbf3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60281 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.785650:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbf3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60281 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.785657:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b4f800, rc 0) 00000100:00100000:1.0:1746065182.785691:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262910336:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 93us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.785696:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14282 00000100:00100000:1.0:1746065182.785711:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14283 00000100:00100000:1.0:1746065182.785715:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881262909952:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065182.785721:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.785727:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c29fa00/0x14b4f8542d4fbf46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6026c expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.785736:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.785737:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.785741:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29fa00/0x14b4f8542d4fbf46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6026c expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.785749:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c29fa00/0x14b4f8542d4fbf46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6026c expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.785755:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29fa00, rc 0) 00000100:00100000:1.0:1746065182.785774:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262909952:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 53us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.785780:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14283 00000100:00100000:0.0:1746065182.785954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.785999:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.786027:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262910464 00000100:00100000:0.0:1746065182.786030:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262910464 00000100:00100000:0.0:1746065182.786047:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14285 00000100:00100000:0.0:1746065182.786052:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262910464:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065182.786057:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.786063:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60288 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.786149:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.786150:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.786156:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.786166:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.786173:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d75d200, rc 0) 00000100:00100000:0.0:1746065182.786191:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262910464:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 139us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065182.786196:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14285 00000100:00100000:0.0:1746065182.811062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.844319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.844846:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262911232 00000100:00100000:1.0:1746065182.844855:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262911232 00000100:00100000:1.0:1746065182.844907:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9883 00000100:00100000:1.0:1746065182.844915:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:31581:x1830881262911232:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065182.844936:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.844955:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094977400/0x14b4f8542d4fbf5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6028f expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.845043:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845054:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845062:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845072:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845077:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845081:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845169:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845181:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845187:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065182.845195:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065182.845256:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845262:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845267:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845274:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094977000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065182.845278:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845283:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845292:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065182.845294:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065182.845297:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845302:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094977000/0x14b4f8542d4fbf70 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845801:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845831:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845836:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845840:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094976a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065182.845842:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845846:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845853:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065182.845855:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065182.845858:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845862:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094976a00/0x14b4f8542d4fbf62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845870:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845875:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845879:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845883:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094976c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065182.845885:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845889:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845893:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012cf55b00) 00010000:00010000:1.0:1746065182.845895:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065182.845897:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845901:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094976c00/0x14b4f8542d4fbf69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.845931:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094977400/0x14b4f8542d4fbf5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6028f expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.845937:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094977400/0x14b4f8542d4fbf5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6028f expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.845944:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094977400, rc 0) 00000100:00100000:1.0:1746065182.846128:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:31581:x1830881262911232:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1213us (1817us total) trans 8589944085 rc 301/301 00000100:00100000:1.0:1746065182.846135:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9883 00000100:00100000:0.0:1746065182.878507:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.878966:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262911360 00000100:00100000:1.0:1746065182.878974:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262911360 00000100:00100000:1.0:1746065182.879026:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9884 00000100:00100000:1.0:1746065182.879034:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:31581:x1830881262911360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065182.879054:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.879077:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094976400/0x14b4f8542d4fbf7e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60296 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.879125:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094976400/0x14b4f8542d4fbf7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60296 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.879137:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976400/0x14b4f8542d4fbf7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60296 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.879152:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065182.879154:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065182.879157:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094976400, rc 0) 00000100:00100000:1.0:1746065182.879197:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:31581:x1830881262911360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 164us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.879203:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9884 00000100:00100000:0.0:1746065182.884313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.884482:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262911616 00000100:00100000:1.0:1746065182.884489:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262911616 00000100:00100000:1.0:1746065182.885486:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9885 00000100:00100000:1.0:1746065182.885495:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:31581:x1830881262911616:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065182.885512:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.885515:0:20754:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065182.885537:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094976400/0x14b4f8542d4fbf7e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60296 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.885558:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065182.885562:0:20754:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065182.885571:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094976600/0x14b4f8542d4fbf85 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6029d expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.885609:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.885619:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fbef2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60249 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.885626:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4fbf15 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60257 expref: 7 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.885631:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29e400/0x14b4f8542d4fbf2a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6025e expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.885636:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 6/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.885661:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29e400/0x14b4f8542d4fbf2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6025e expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.885674:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29e400/0x14b4f8542d4fbf2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6025e expref: 7 pid: 20754 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065182.885684:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260304128:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.886541:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4fbf15 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60257 expref: 7 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.886548:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed70a00/0x14b4f8542d4fbf15 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60257 expref: 7 pid: 14645 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065182.886555:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260304256:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.886739:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fbef2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60249 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.886746:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fbef2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60249 expref: 249 pid: 14644 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065182.886754:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260304384:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065182.886786:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.890961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.891407:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130444e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260304128:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065182.891415:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260304256:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.891423:0:20754:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from blocking AST (req@ffff880130446300 x1830881260304384) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fbef2 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60249 expref: 251 pid: 14644 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065182.891436:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fbef2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60249 expref: 251 pid: 14644 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065182.891456:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260304384:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.891472:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065182.891475:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.891480:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065182.891486:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.892057:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.892063:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20754 initiator: MDT0 00000040:00080000:0.0:1746065182.892578:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3038, 88 off256768 00000004:00080000:0.0:1746065182.892584:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183768217ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892624:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3069, 88 off259672 00000004:00080000:0.0:1746065182.892628:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782183812481ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065182.892638:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3070, 88 off259760 00000004:00080000:0.0:1746065182.892641:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782183825779ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065182.892648:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3039, 88 off256856 00000004:00080000:0.0:1746065182.892651:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183835458ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892656:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3040, 88 off256944 00000004:00080000:0.0:1746065182.892658:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183842852ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892664:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3071, 88 off259848 00000004:00080000:0.0:1746065182.892666:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782183850876ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065182.892672:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3072, 88 off259936 00000004:00080000:0.0:1746065182.892674:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782183858849ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065182.892680:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3073, 88 off260024 00000004:00080000:0.0:1746065182.892682:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782183866418ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065182.892687:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3041, 88 off257032 00000004:00080000:0.0:1746065182.892690:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183874332ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892695:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3074, 88 off260112 00000004:00080000:0.0:1746065182.892699:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782183883569ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065182.892704:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3042, 88 off257120 00000004:00080000:0.0:1746065182.892706:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183890912ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892712:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3075, 88 off260200 00000004:00080000:0.0:1746065182.892714:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782183898578ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065182.892720:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3043, 88 off257208 00000004:00080000:0.0:1746065182.892722:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183906899ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892727:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3044, 88 off257296 00000004:00080000:0.0:1746065182.892729:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183914117ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892735:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3045, 88 off257384 00000004:00080000:0.0:1746065182.892737:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183921799ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892742:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3046, 88 off257472 00000004:00080000:0.0:1746065182.892744:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782183929049ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065182.892750:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3076, 88 off260288 00000004:00080000:0.0:1746065182.892752:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782183936726ns, next at 737095943431ns, rc = 0 00000001:00080000:0.0:1746065182.920775:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944086 is committed 00000004:00080000:0.0:1746065182.920784:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2358 committed 00000004:00080000:0.0:1746065182.920938:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2327 committed 00000004:00080000:0.0:1746065182.920944:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2326 committed 00000004:00080000:0.0:1746065182.920946:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2325 committed 00000004:00080000:0.0:1746065182.920947:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2324 committed 00000004:00080000:0.0:1746065182.920949:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2357 committed 00000004:00080000:0.0:1746065182.920950:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2323 committed 00000004:00080000:0.0:1746065182.920951:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2356 committed 00000004:00080000:0.0:1746065182.920953:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2322 committed 00000004:00080000:0.0:1746065182.920954:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2355 committed 00000004:00080000:0.0:1746065182.920956:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2354 committed 00000004:00080000:0.0:1746065182.920957:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2353 committed 00000004:00080000:0.0:1746065182.920958:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2321 committed 00000004:00080000:0.0:1746065182.920960:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2320 committed 00000004:00080000:0.0:1746065182.920961:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2352 committed 00000004:00080000:0.0:1746065182.920963:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2351 committed 00000004:00080000:0.0:1746065182.920965:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2319 committed 00000001:00080000:0.0:1746065182.920974:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944083 is committed 00000001:00080000:0.0:1746065182.920978:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944084 is committed 00010000:00010000:0.0:1746065182.921017:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6029d expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.921027:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065182.921029:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065182.921032:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065182.921039:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6029d expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.921044:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065182.921074:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6029d expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.921084:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6029d expref: 8 pid: 20754 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746065182.921095:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260304512:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.921163:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.922324:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14293 00000100:00100000:0.0:1746065182.922329:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3298:x1830881260306176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065182.922409:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881260306176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (837us total) trans 21474840832 rc 0/0 00000100:00100000:0.0:1746065182.922414:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14293 00000100:00100000:1.0:1746065182.922696:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260304896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.922719:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.922733:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260305408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.922745:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.922753:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260305920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.922764:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.922772:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260306432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.922782:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.922791:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746065182.922795:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260305024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.922832:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.922844:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260305536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.922857:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.922865:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260306048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.922876:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.922884:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260306560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065182.922895:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.922920:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260304896 00000100:00100000:1.0:1746065182.922923:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260304896 00000100:00100000:1.0:1746065182.922950:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260305408 00000100:00100000:1.0:1746065182.922952:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260305408 00000100:00100000:1.0:1746065182.922961:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260305920 00000100:00100000:1.0:1746065182.922963:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260305920 00000100:00100000:1.0:1746065182.922970:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14294 00000100:00100000:1.0:1746065182.922974:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3295:x1830881260304896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065182.923051:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065182.923054:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.923056:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.923057:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.923059:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065182.923079:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830881260304896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (360us total) trans 17179873567 rc 0/0 00000100:00100000:1.0:1746065182.923084:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14294 00000100:00100000:1.0:1746065182.923092:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14296 00000100:00100000:1.0:1746065182.923096:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3295:x1830881260305920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065182.923149:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:1.0:1746065182.923151:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.923153:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.923155:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.923157:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5729 -> 5729 00000100:00100000:1.0:1746065182.923170:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881260305920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (405us total) trans 21474840833 rc 0/0 00000100:00100000:1.0:1746065182.923174:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14296 00000100:00100000:1.0:1746065182.923181:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14298 00000100:00100000:1.0:1746065182.923185:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881260305024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065182.923230:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065182.923232:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065182.923234:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065182.923235:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065182.923237:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065182.923253:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830881260305024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (421us total) trans 17179873569 rc 0/0 00000100:00100000:1.0:1746065182.923334:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14298 00000100:00100000:1.0:1746065182.923346:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14299 00000100:00100000:1.0:1746065182.923350:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881260305536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.923423:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830881260305536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (564us total) trans 17179873570 rc 0/0 00000100:00100000:1.0:1746065182.923428:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14299 00000100:00100000:1.0:1746065182.923436:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14300 00000100:00100000:1.0:1746065182.923440:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3295:x1830881260306048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065182.923496:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065182.923498:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.923500:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.923501:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.923503:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065182.923519:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881260306048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (642us total) trans 21474840835 rc 0/0 00000100:00100000:1.0:1746065182.923524:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14300 00000004:00080000:1.0:1746065182.923543:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0fb80/2, rc 0, transno 17179873569 00000100:00100000:1.0:1746065182.923546:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260305024:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.923552:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0f800/2, rc 0, transno 17179873570 00000100:00100000:1.0:1746065182.923554:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260305536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.923559:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c2680/2, rc 0, transno 21474840835 00000100:00100000:1.0:1746065182.923562:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260306048:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065182.923567:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0ed80/2, rc 0, transno 17179873567 00000100:00100000:1.0:1746065182.923569:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260304896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.923575:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0c380/2, rc 0, transno 17179873568 00000100:00100000:1.0:1746065182.923577:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260305408:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.923581:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134d84e00/2, rc 0, transno 21474840833 00000100:00100000:1.0:1746065182.923584:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260305920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065182.923589:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380f480/2, rc 0, transno 21474840834 00000100:00100000:1.0:1746065182.923591:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260306432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065182.923597:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380ca80/2, rc 0, transno 21474840836 00000100:00100000:1.0:1746065182.923599:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260306560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065182.924183:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260306688 00000100:00100000:0.0:1746065182.924187:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260306688 00000100:00100000:0.0:1746065182.924202:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14302 00000100:00100000:0.0:1746065182.924206:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881260306688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065182.924285:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3298:x1830881260306688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (114us total) trans 21474840837 rc 0/0 00000100:00100000:0.0:1746065182.924289:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14302 00000100:00100000:1.0:1746065182.925138:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260304512:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065182.925172:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094976600/0x14b4f8542d4fbf85 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6029d expref: 8 pid: 20754 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065182.925185:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6029d expref: 7 pid: 20754 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065182.925192:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094976200/0x14b4f8542d4fbf8c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6029d expref: 7 pid: 20754 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065182.925212:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094976200, rc 0) 00000100:00100000:1.0:1746065182.925250:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:31581:x1830881262911616:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 39756us (40945us total) trans 8589944086 rc 0/0 00000100:00100000:1.0:1746065182.925256:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9885 00000100:00100000:0.0:1746065182.927712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.928015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.928086:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262912256 00000100:00100000:1.0:1746065182.928092:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262912256 00000100:00100000:1.0:1746065182.928124:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9887 00000100:00100000:1.0:1746065182.928130:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:31581:x1830881262912256:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065182.928149:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.928163:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e602ab expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.928203:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065182.928211:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.928223:0:20754:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065182.928554:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.928565:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065182.928568:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065182.928573:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065182.928582:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c732c00, rc 0) 00000100:00100000:1.0:1746065182.928613:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:31581:x1830881262912256:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 484us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.928618:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9887 00000100:00100000:0.0:1746065182.941285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.949469:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.949503:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262912768 00000100:00100000:0.0:1746065182.949511:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262912768 00000100:00100000:0.0:1746065182.949542:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9889 00000100:00100000:0.0:1746065182.949549:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31584:x1830881262912768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.949917:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.949931:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c861600/0x14b4f8542d4fbfcb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e602b9 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.949999:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.950008:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065182.950018:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000001:00080000:1.0:1746065182.962332:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944087 is committed 00000004:00080000:1.0:1746065182.962342:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2366 committed 00000004:00080000:1.0:1746065182.962350:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2336 committed 00000004:00080000:1.0:1746065182.962354:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2335 committed 00000004:00080000:1.0:1746065182.962356:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2334 committed 00000004:00080000:1.0:1746065182.962358:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2333 committed 00000004:00080000:1.0:1746065182.962360:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2365 committed 00000004:00080000:1.0:1746065182.962361:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2332 committed 00000004:00080000:1.0:1746065182.962362:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2364 committed 00000004:00080000:1.0:1746065182.962364:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2331 committed 00000004:00080000:1.0:1746065182.962365:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2363 committed 00000004:00080000:1.0:1746065182.962366:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2362 committed 00000004:00080000:1.0:1746065182.962368:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2361 committed 00000004:00080000:1.0:1746065182.962370:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2330 committed 00000004:00080000:1.0:1746065182.962371:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2329 committed 00000004:00080000:1.0:1746065182.962373:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2360 committed 00000004:00080000:1.0:1746065182.962375:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2359 committed 00000004:00080000:1.0:1746065182.962376:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2328 committed 00000100:00100000:1.0:1746065182.962494:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260307200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.962541:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.962582:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260307712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.962598:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.962614:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746065182.962619:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260306816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.962631:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.962640:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260307328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.962650:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.962663:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260306944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.962682:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.962692:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260307456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.962703:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.962712:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065182.962716:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260307072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.962726:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.962735:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260307584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.962746:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065182.962766:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260307200 00000100:00100000:1.0:1746065182.962772:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260307200 00000100:00100000:1.0:1746065182.962798:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260307712 00000100:00100000:1.0:1746065182.962800:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260307712 00000100:00100000:1.0:1746065182.962842:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260306816 00000100:00100000:1.0:1746065182.962844:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260306816 00000100:00100000:1.0:1746065182.962852:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260307328 00000100:00100000:1.0:1746065182.962854:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260307328 00000100:00100000:1.0:1746065182.962862:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260306944 00000100:00100000:1.0:1746065182.962863:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260306944 00000100:00100000:1.0:1746065182.962868:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260307456 00000100:00100000:1.0:1746065182.962870:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260307456 00000100:00100000:1.0:1746065182.962875:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260307072 00000100:00100000:1.0:1746065182.962877:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260307072 00000100:00100000:1.0:1746065182.962883:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260307584 00000100:00100000:1.0:1746065182.962884:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260307584 00000100:00100000:1.0:1746065182.962893:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14303 00000100:00100000:1.0:1746065182.962898:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881260307200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065182.963031:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065182.963035:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065182.963037:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065182.963039:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065182.963041:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065182.963067:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260307200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (525us total) trans 17179873571 rc 0/0 00000100:00100000:1.0:1746065182.963073:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14303 00000100:00100000:1.0:1746065182.963090:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14304 00000100:00100000:1.0:1746065182.963095:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881260307712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.963168:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260307712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (568us total) trans 17179873572 rc 0/0 00000100:00100000:1.0:1746065182.963173:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14304 00000100:00100000:1.0:1746065182.963182:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14305 00000100:00100000:1.0:1746065182.963186:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881260306816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065182.963251:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065182.963253:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065182.963256:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065180 -> 1746065180 00002000:00010000:1.0:1746065182.963257:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065182.963259:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065182.963275:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260306816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (643us total) trans 17179873573 rc 0/0 00000100:00100000:1.0:1746065182.963280:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14305 00000100:00100000:1.0:1746065182.963288:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14306 00000100:00100000:1.0:1746065182.963293:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881260307328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065182.963346:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065182.963348:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.963349:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.963351:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065182.963352:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065182.963366:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260307328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (715us total) trans 17179873574 rc 0/0 00000100:00100000:1.0:1746065182.963370:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14306 00000100:00100000:1.0:1746065182.963377:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14307 00000100:00100000:1.0:1746065182.963381:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881260306944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065182.963439:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065182.963442:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065182.963444:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065182.963445:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065182.963447:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746065182.963465:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260306944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (782us total) trans 17179873575 rc 0/0 00000100:00100000:1.0:1746065182.963469:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14307 00000100:00100000:1.0:1746065182.963477:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14308 00000100:00100000:1.0:1746065182.963481:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881260307456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.963544:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260307456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (840us total) trans 17179873576 rc 0/0 00000100:00100000:1.0:1746065182.963549:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14308 00000100:00100000:1.0:1746065182.963557:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14309 00000100:00100000:1.0:1746065182.963561:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881260307072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065182.963618:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065182.963621:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.963622:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.963624:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065183 -> 1746065183 00002000:00010000:1.0:1746065182.963625:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065182.963641:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260307072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (914us total) trans 17179873577 rc 0/0 00000100:00100000:1.0:1746065182.963645:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14309 00000100:00100000:1.0:1746065182.963654:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14310 00000100:00100000:1.0:1746065182.963658:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881260307584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.963723:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260307584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (976us total) trans 17179873578 rc 0/0 00000100:00100000:1.0:1746065182.963727:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14310 00000004:00080000:1.0:1746065182.963773:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7fdf80/2, rc 0, transno 17179873577 00000100:00100000:1.0:1746065182.963777:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260307072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.963783:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fe300/2, rc 0, transno 17179873578 00000100:00100000:1.0:1746065182.963785:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260307584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.963790:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7fe300/2, rc 0, transno 17179873575 00000100:00100000:1.0:1746065182.963793:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260306944:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.963798:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fdf80/2, rc 0, transno 17179873576 00000100:00100000:1.0:1746065182.963800:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260307456:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.963846:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7fca80/2, rc 0, transno 17179873573 00000100:00100000:1.0:1746065182.963848:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260306816:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.963853:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fe680/2, rc 0, transno 17179873574 00000100:00100000:1.0:1746065182.963855:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260307328:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.963860:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d7fea00/2, rc 0, transno 17179873571 00000100:00100000:1.0:1746065182.963862:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260307200:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065182.963867:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fea00/2, rc 0, transno 17179873572 00000100:00100000:1.0:1746065182.963869:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260307712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065182.972276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.974078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.974143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.978002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.978718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.978746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.978762:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262913664 00000100:00100000:1.0:1746065182.978766:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262913664 00000100:00100000:1.0:1746065182.978870:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14321 00000100:00100000:1.0:1746065182.978877:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881262913664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065182.978889:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065182.978903:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a565be00/0x14b4f8542d4fc00a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e602d5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.978919:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.978927:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a565be00/0x14b4f8542d4fc00a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602d5 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065182.978929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065182.978941:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a565be00/0x14b4f8542d4fc00a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602d5 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065182.978948:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a565be00, rc 0) 00000100:00100000:1.0:1746065182.979615:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881262913664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 737us (896us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065182.979621:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14321 00000100:00100000:1.0:1746065182.979724:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 738 00000100:00100000:1.0:1746065182.979730:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881262913792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.979738:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.979752:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a59b9200/0x14b4f8542d4fbfd9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602c0 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.979763:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065182.979766:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065182.979783:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1960:x1830881262913792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.979788:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 738 00000100:00100000:0.0:1746065182.981446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.981484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.981537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.984652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.984689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.984875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.985138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.985312:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7280 00000100:00100000:1.0:1746065182.985318:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881262914688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065182.985326:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065182.985553:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4800/0x14b4f8542d4fbe97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601fc expref: 13 pid: 8851 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746065182.985565:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4800/0x14b4f8542d4fbe97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601fc expref: 13 pid: 8851 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746065182.985577:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8d4800/0x14b4f8542d4fbe97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601fc expref: 13 pid: 8851 timeout: 882 lvb_type: 1 00010000:00010000:1.0:1746065182.985584:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.985586:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065182.985591:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331f4000/0x14b4f8542d4fc011 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602e3 expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.985598:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331f4000/0x14b4f8542d4fc011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602e3 expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065182.985621:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801331f4000/0x14b4f8542d4fc011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602e3 expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065182.985630:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260310016:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065182.985669:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.986961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.986991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.987012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.987050:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262915200 00000100:00100000:0.0:1746065182.987053:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262915200 00000100:00100000:0.0:1746065182.987073:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14323 00000100:00100000:0.0:1746065182.987079:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881262915072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065182.987088:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.987097:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0x14b4f8542d4fc026 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e602ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065182.987126:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260310144:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065182.987159:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.988698:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262915456 00000100:00100000:0.0:1746065182.988705:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262915456 00002000:00100000:0.0:1746065182.988732:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1957888->1961983) req@ffff880095353b80 x1830881262915456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.988741:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353b80 with x1830881262915456 ext(1957888->1961983) 00002000:00010000:0.0:1746065182.988744:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095353b80 00000100:00100000:0.0:1746065182.989927:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8005 00000100:00100000:0.0:1746065182.989936:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262915456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065182.990863:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262915456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 924us (3846us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065182.990871:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8005 00002000:00100000:0.0:1746065182.990878:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1957888->1961983) req@ffff880095353b80 x1830881262915456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:98/0 lens 488/4536 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.990886:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353b80 with x1830881262915456 ext(1957888->1961983) 00002000:00010000:0.0:1746065182.990890:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095353b80 00000100:00100000:1.0:1746065182.990941:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065182.991010:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260310016:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065182.991024:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065182.991047:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881262914688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5729us (6172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065182.991054:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7280 00000100:00100000:0.0:1746065182.991927:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262915712 00000100:00100000:0.0:1746065182.991934:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262915712 00002000:00100000:0.0:1746065182.991954:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1802240->1806335) req@ffff880094ff6300 x1830881262915712/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/0 e 0 to 0 dl 1746065193 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.991961:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6300 with x1830881262915712 ext(1802240->1806335) 00002000:00010000:0.0:1746065182.991964:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff6300 00000100:00100000:0.0:1746065182.991977:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8006 00000100:00100000:0.0:1746065182.991982:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262915712:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065182.992154:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262915712:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 171us (1213us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065182.992160:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8006 00002000:00100000:0.0:1746065182.992165:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1802240->1806335) req@ffff880094ff6300 x1830881262915712/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:98/0 lens 488/4536 e 0 to 0 dl 1746065193 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065182.992172:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff6300 with x1830881262915712 ext(1802240->1806335) 00002000:00010000:0.0:1746065182.992175:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff6300 00002000:00010000:0.0:1746065182.992201:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime: 1746065179 -> 1746065183 00002000:00010000:0.0:1746065182.992203:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065180 -> 1746065183 00002000:00010000:0.0:1746065182.992205:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime: 1746065179 -> 1746065183 00000100:00100000:0.0:1746065182.992211:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260310144:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065182.992225:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0x14b4f8542d4fc026 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ea expref: 13 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.992234:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4400/0x14b4f8542d4fc026 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ea expref: 13 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.992242:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a4400, rc 0) 00000100:00100000:0.0:1746065182.992272:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881262915072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5193us (5314us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065182.992277:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14323 00000100:00100000:0.0:1746065182.995071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065182.995094:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262915840 00000100:00100000:0.0:1746065182.995101:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262915840 00000100:00100000:0.0:1746065182.995142:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14325 00000100:00100000:0.0:1746065182.995149:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31577:x1830881262915840:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065182.995164:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065182.995176:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e602f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.995199:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4000/0x14b4f8542d4fbec8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6021f expref: 15 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.995206:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbf3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60281 expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.995212:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4200/0x14b4f8542d4fbedd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60242 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.995218:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.995219:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065182.995222:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->2719743] (req 2097152->2719743) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.995244:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4200/0x14b4f8542d4fbedd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60242 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.995254:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4200/0x14b4f8542d4fbedd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60242 expref: 22 pid: 8427 timeout: 882 lvb_type: 1 00000100:00100000:0.0:1746065182.995264:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260310400:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.995811:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbf3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60281 expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065182.995839:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbf3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60281 expref: 7 pid: 25185 timeout: 882 lvb_type: 1 00000100:00100000:0.0:1746065182.995850:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260310528:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065182.995888:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4000/0x14b4f8542d4fbec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6021f expref: 15 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065182.995894:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4000/0x14b4f8542d4fbec8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6021f expref: 15 pid: 8427 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746065182.995900:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095353480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260310656:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065182.995913:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065182.998197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.000467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.000520:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.000659:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262916096 00000100:00100000:1.0:1746065183.000664:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262916096 00010000:00010000:1.0:1746065183.000687:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8d4200/0x14b4f8542d4fbedd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60242 expref: 23 pid: 8427 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746065183.001193:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262916224 00000100:00100000:1.0:1746065183.001197:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262916224 00010000:00010000:1.0:1746065183.001214:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129b4f800/0x14b4f8542d4fbf3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60281 expref: 8 pid: 25185 timeout: 882 lvb_type: 1 00000100:00080000:0.0:1746065183.001722:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065183.003464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.003481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.003519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.003531:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262916608 00000100:00100000:0.0:1746065183.003533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.003535:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262916608 00010000:00010000:1.0:1746065183.003548:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f08de00/0x14b4f8542d4fbf38 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60273 expref: 8 pid: 2462 timeout: 882 lvb_type: 1 00000100:00100000:0.0:1746065183.003556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.003564:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7285 00000100:00100000:1.0:1746065183.003569:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262916608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065183.003570:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262916864 00000100:00100000:0.0:1746065183.003572:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262916864 00010000:00010000:1.0:1746065183.003575:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065183.003589:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f08de00/0x14b4f8542d4fbf38 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60273 expref: 8 pid: 2462 timeout: 882 lvb_type: 1 00002000:00100000:0.0:1746065183.003594:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012bd3f100 x1830881262916864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065183.003597:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f08de00/0x14b4f8542d4fbf38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60273 expref: 8 pid: 2462 timeout: 882 lvb_type: 1 00002000:00100000:0.0:1746065183.003616:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f100 with x1830881262916864 ext(0->1048575) 00002000:00010000:0.0:1746065183.003620:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3f100 00000100:00100000:0.0:1746065183.003632:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917120 00000100:00100000:0.0:1746065183.003634:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917120 00002000:00100000:0.0:1746065183.003650:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1802239) req@ffff88012bd3d180 x1830881262917120/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065183.003657:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d180 with x1830881262917120 ext(1048576->1802239) 00002000:00010000:0.0:1746065183.003659:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3d180 00000100:00100000:0.0:1746065183.003666:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262917376 00000100:00100000:0.0:1746065183.003668:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262917376 00002000:00100000:0.0:1746065183.003675:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012bd3ce00 x1830881262917376/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065183.003681:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ce00 with x1830881262917376 ext(1048576->2097151) 00010000:00010000:0.0:1746065183.003686:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a9272c00/0x14b4f8542d4fbea5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60203 expref: 15 pid: 2463 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746065183.003693:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a9272c00/0x14b4f8542d4fbea5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60203 expref: 15 pid: 2463 timeout: 882 lvb_type: 1 00002000:00010000:0.0:1746065183.003698:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bd3ce00 00000100:00100000:0.0:1746065183.003911:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2442 00000100:00100000:0.0:1746065183.003917:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881262917376:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:1.0:1746065183.004423:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065183.004441:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262916608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 871us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.004446:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7285 00000100:00080000:0.0:1746065183.005265:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065183.007176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.018801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.025242:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.025535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.029539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.029586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.032037:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262918528 00000100:00100000:0.0:1746065183.032041:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262918528 00000100:00100000:0.0:1746065183.032089:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4203 00000100:00100000:0.0:1746065183.032095:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31577:x1830881262918528:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065183.032252:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31577:x1830881262918528:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 157us (2665us total) trans 8589944090 rc 0/0 00000100:00100000:0.0:1746065183.032258:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4203 00000100:00080000:1.0:1746065183.032344:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746065183.036422:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065183.036861:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262918656 00000100:00100000:0.0:1746065183.036864:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262918656 00010000:00010000:0.0:1746065183.036882:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331f4000/0x14b4f8542d4fc011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602e3 expref: 14 pid: 25185 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746065183.037083:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7287 00000100:00100000:0.0:1746065183.037088:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881262918656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065183.037097:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065183.037113:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331f4000/0x14b4f8542d4fc011 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602e3 expref: 14 pid: 25185 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065183.037625:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331f4000/0x14b4f8542d4fc011 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602e3 expref: 14 pid: 25185 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065183.037643:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331f4000/0x14b4f8542d4fc011 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602e3 expref: 14 pid: 25185 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065183.037665:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065183.037667:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065183.037672:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a59b9800/0x14b4f8542d4fc042 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60306 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065183.037679:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a59b9800/0x14b4f8542d4fc042 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60306 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065183.037705:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a59b9800/0x14b4f8542d4fc042 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60306 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065183.037715:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260311552:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065183.038005:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.039546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.051928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.051977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.054369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.083361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.083861:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.084219:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14330 00000100:00100000:1.0:1746065183.084227:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31584:x1830881262920064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.084234:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.084244:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6031b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.084259:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fc03b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ff expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.084265:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065183.084266:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065183.084269:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.084284:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fc03b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ff expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.084291:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fc03b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ff expref: 13 pid: 8851 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065183.084298:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260311808:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.084656:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.087312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.087340:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260311808:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.087365:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.087383:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b960a00, rc 0) 00000100:00100000:1.0:1746065183.087418:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31584:x1830881262920064:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3192us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.087425:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14330 00000100:00100000:0.0:1746065183.087972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.094113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.096367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.097131:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262920576 00000100:00100000:1.0:1746065183.097138:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262920576 00010000:00010000:1.0:1746065183.097166:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fc03b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ff expref: 16 pid: 8851 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065183.097189:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7289 00000100:00100000:1.0:1746065183.097195:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881262920576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065183.097206:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065183.097221:0:7079:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065179 -> 1746065183 00002000:00010000:1.0:1746065183.097223:0:7079:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065179 -> 1746065184 00002000:00010000:1.0:1746065183.097225:0:7079:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065179 -> 1746065183 00010000:00010000:1.0:1746065183.097230:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fc03b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ff expref: 16 pid: 8851 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.097239:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fc03b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ff expref: 16 pid: 8851 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.097258:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fc03b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ff expref: 16 pid: 8851 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.097278:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.097281:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.097287:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.097294:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.097320:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065183.097330:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260312064:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065183.097398:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.103672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.104182:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260312064:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065183.104199:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065183.104243:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881262920576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7047us (7880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.104251:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7289 00000100:00100000:0.0:1746065183.107155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.123114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.123163:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.123227:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262921344 00000100:00100000:1.0:1746065183.123232:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262921344 00000100:00100000:1.0:1746065183.123992:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14332 00000100:00100000:1.0:1746065183.123999:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31584:x1830881262921344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.124006:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.124013:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f716000/0x14b4f8542d4fc065 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60329 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.124024:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.124025:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.124031:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f716000/0x14b4f8542d4fc065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60329 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.124042:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f716000/0x14b4f8542d4fc065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60329 expref: 23 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.124050:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f716000, rc 0) 00000100:00100000:1.0:1746065183.124233:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31584:x1830881262921344:12345-192.168.202.46@tcp:101:cat.0 Request processed in 234us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.124239:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14332 00000100:00100000:0.0:1746065183.129514:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.130774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.130794:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262921728 00000100:00100000:1.0:1746065183.130798:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262921728 00002000:00100000:1.0:1746065183.130837:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2719743) req@ffff880094d95500 x1830881262921728/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.130844:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95500 with x1830881262921728 ext(2097152->2719743) 00010000:00010000:1.0:1746065183.130851:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 24 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.130866:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 24 pid: 8429 timeout: 882 lvb_type: 0 00002000:00010000:1.0:1746065183.130872:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d95500 00000100:00100000:1.0:1746065183.130884:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2446 00000100:00100000:1.0:1746065183.130889:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881262921728:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065183.143064:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262921728:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12165us (12281us total) trans 21474840848 rc 0/0 00000100:00100000:1.0:1746065183.143079:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2446 00002000:00100000:1.0:1746065183.143089:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2719743) req@ffff880094d95500 x1830881262921728/t21474840848(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/448 e 0 to 0 dl 1746065194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.143097:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95500 with x1830881262921728 ext(2097152->2719743) 00010000:00010000:1.0:1746065183.143107:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 25 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.143121:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 25 pid: 8429 timeout: 882 lvb_type: 0 00002000:00010000:1.0:1746065183.143127:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d95500 00000100:00100000:0.0:1746065183.144779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.144884:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262921856 00000100:00100000:1.0:1746065183.144891:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262921856 00010000:00010000:1.0:1746065183.144916:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 25 pid: 8429 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065183.144952:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7290 00000100:00100000:1.0:1746065183.144959:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881262921856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065183.144970:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065183.144986:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 25 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.144996:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 25 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.145020:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5600/0x14b4f8542d4fc034 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2719743) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602f8 expref: 25 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.145052:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.145053:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.145059:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4fc05e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60322 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.145066:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4fc05e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60322 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.145093:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4fc05e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60322 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065183.145103:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260312320:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065183.145168:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065183.146378:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.151322:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260312320:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065183.151341:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065183.151386:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881262921856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6426us (6610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.151394:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7290 00000100:00100000:0.0:1746065183.155777:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.155850:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.155894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.155977:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262922240 00000100:00100000:1.0:1746065183.155984:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262922240 00002000:00100000:1.0:1746065183.156023:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094d94e00 x1830881262922240/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.156038:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94e00 with x1830881262922240 ext(2097152->3145727) 00002000:00010000:1.0:1746065183.156042:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94e00 00000100:00100000:1.0:1746065183.156055:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262922496 00000100:00100000:1.0:1746065183.156057:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262922496 00002000:00100000:1.0:1746065183.156066:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094d96d80 x1830881262922496/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.156072:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96d80 with x1830881262922496 ext(3145728->4194303) 00002000:00010000:1.0:1746065183.156074:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d96d80 00000100:00100000:1.0:1746065183.156080:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262922752 00000100:00100000:1.0:1746065183.156081:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262922752 00002000:00100000:1.0:1746065183.156089:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094d95880 x1830881262922752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.156094:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95880 with x1830881262922752 ext(2097152->3145727) 00002000:00010000:1.0:1746065183.156096:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95880 00000100:00100000:1.0:1746065183.156104:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8017 00000100:00100000:1.0:1746065183.156110:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881262922240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.164432:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262923264 00000100:00100000:0.0:1746065183.164435:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262923264 00002000:00100000:0.0:1746065183.164449:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009f46bb80 x1830881262923264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065183.164456:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46bb80 with x1830881262923264 ext(2097152->3145727) 00002000:00010000:0.0:1746065183.164458:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46bb80 00000100:00100000:0.0:1746065183.165506:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8020 00000100:00100000:0.0:1746065183.165514:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881262923008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065183.172740:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8023 00000100:00100000:0.0:1746065183.172745:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262924032 00000100:00100000:1.0:1746065183.172749:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881262923776:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.172749:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262924032 00002000:00100000:0.0:1746065183.172763:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009c3fb100 x1830881262924032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065183.172769:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830881262924032 ext(3145728->4194303) 00002000:00010000:0.0:1746065183.172771:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb100 00000100:00100000:0.0:1746065183.172784:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8024 00000100:00100000:0.0:1746065183.172789:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881262924032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.178387:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.179361:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881262922240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23250us (23591us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065183.179369:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8017 00002000:00100000:1.0:1746065183.179376:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094d94e00 x1830881262922240/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.179389:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94e00 with x1830881262922240 ext(2097152->3145727) 00002000:00010000:1.0:1746065183.179392:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94e00 00000100:00100000:1.0:1746065183.190081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.219723:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262923776:12345-192.168.202.46@tcp:3:cat.0 Request processed in 46970us (52471us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065183.219731:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8023 00002000:00100000:1.0:1746065183.219738:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009c3f9c00 x1830881262923776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.219746:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9c00 with x1830881262923776 ext(2097152->3145727) 00002000:00010000:1.0:1746065183.219750:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9c00 00000100:00100000:0.0:1746065183.224682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.224939:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262924672 00000100:00100000:1.0:1746065183.224946:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262924672 00000100:00100000:1.0:1746065183.224986:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14334 00000100:00100000:1.0:1746065183.224992:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881262924672:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.225005:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.225020:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60345 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.225040:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.225042:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.225048:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 16 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.225064:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 16 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.225076:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5b400, rc 0) 00000100:00100000:1.0:1746065183.225107:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881262924672:12345-192.168.202.46@tcp:101:cat.0 Request processed in 115us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.225112:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14334 00000100:00100000:0.0:1746065183.229988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.230036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.242954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.244851:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.245074:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262925312 00000100:00100000:1.0:1746065183.245081:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262925312 00010000:00010000:1.0:1746065183.245109:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a59b9800/0x14b4f8542d4fc042 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60306 expref: 27 pid: 8851 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065183.245143:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7291 00000100:00100000:1.0:1746065183.245149:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881262925312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065183.245164:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065183.245187:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a59b9800/0x14b4f8542d4fc042 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60306 expref: 27 pid: 8851 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.245198:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a59b9800/0x14b4f8542d4fc042 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60306 expref: 27 pid: 8851 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.245219:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a59b9800/0x14b4f8542d4fc042 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60306 expref: 27 pid: 8851 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.245260:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065183.245310:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881262925312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 158us (2362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.245316:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7291 00000100:00100000:0.0:1746065183.246536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.246562:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262925568 00000100:00100000:0.0:1746065183.246565:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262925568 00002000:00100000:0.0:1746065183.246589:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880095355180 x1830881262925568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065183.246596:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355180 with x1830881262925568 ext(4194304->5013503) 00002000:00010000:0.0:1746065183.246599:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355180 00000100:00100000:0.0:1746065183.246611:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8026 00000100:00100000:0.0:1746065183.246615:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881262925568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.256012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.264008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.264057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.266606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.267269:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262926720 00000100:00100000:1.0:1746065183.267274:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262926720 00000100:00100000:1.0:1746065183.267309:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4206 00000100:00100000:1.0:1746065183.267314:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:31592:x1830881262926720:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065183.267497:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:31592:x1830881262926720:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 183us (897us total) trans 8589944095 rc 0/0 00000100:00100000:1.0:1746065183.267502:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4206 00000100:00100000:0.0:1746065183.271529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.277471:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881262926848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5317us (5947us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065183.277481:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14337 00000100:00100000:0.0:1746065183.285623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.286321:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262927104 00000100:00100000:1.0:1746065183.286329:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262927104 00000100:00100000:1.0:1746065183.286378:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4207 00000100:00100000:1.0:1746065183.286385:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:31584:x1830881262927104:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065183.286570:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31584:x1830881262927104:12345-192.168.202.46@tcp:35:cat.0 Request processed in 184us (953us total) trans 8589944096 rc 0/0 00000100:00100000:1.0:1746065183.286576:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4207 00000100:00100000:0.0:1746065183.348461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.348525:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262927232 00000100:00100000:3.0:1746065183.348532:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262927232 00000100:00100000:3.0:1746065183.348579:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14338 00000100:00100000:3.0:1746065183.348585:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31593:x1830881262927232:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065183.348599:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.348612:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60361 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.348635:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.348642:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 15 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.348648:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.348649:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.348652:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1073152->1863679] (req 1073152->1863679) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.348674:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 15 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.348682:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 15 pid: 8427 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746065183.348691:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313088:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065183.348769:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.348777:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 27 pid: 8427 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746065183.348784:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313216:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065183.348811:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c50d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065183.350077:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065183.350085:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313216:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065183.350102:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1073152->1863679] (req 1073152->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.350113:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e23200, rc 0) 00000100:00100000:0.0:1746065183.352675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.352718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.352737:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262927360 00000100:00100000:0.0:1746065183.352744:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262927360 00010000:00010000:0.0:1746065183.352772:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 16 pid: 8427 timeout: 882 lvb_type: 1 00000100:00100000:0.0:1746065183.352797:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7293 00000100:00100000:0.0:1746065183.352831:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881262927360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065183.352842:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065183.352861:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 16 pid: 8427 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746065183.352871:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 16 pid: 8427 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746065183.352888:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc0b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60345 expref: 16 pid: 8427 timeout: 882 lvb_type: 1 00010000:00010000:0.0:1746065183.352903:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065183.352933:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881262927360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 119us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065183.352939:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7293 00000100:00100000:0.0:1746065183.352954:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262927488 00000100:00100000:0.0:1746065183.352956:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262927488 00010000:00010000:0.0:1746065183.352964:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 28 pid: 8427 timeout: 882 lvb_type: 0 00000100:00100000:0.0:1746065183.352975:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7294 00000100:00100000:0.0:1746065183.352979:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881262927488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065183.352983:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065183.352990:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 28 pid: 8427 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065183.352997:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 28 pid: 8427 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065183.353006:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b960a00/0x14b4f8542d4fc057 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6031b expref: 28 pid: 8427 timeout: 882 lvb_type: 0 00010000:00010000:0.0:1746065183.353014:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065183.353016:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065183.353021:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065183.353028:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065183.353054:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065183.353065:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260313344:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065183.353108:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065183.354018:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31593:x1830881262927232:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5430us (5561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065183.354025:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14338 00000100:00100000:0.0:1746065183.355844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.355910:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262927744 00000100:00100000:3.0:1746065183.355916:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262927744 00002000:00100000:3.0:1746065183.355948:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1073152->1077247) req@ffff880095354000 x1830881262927744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.355956:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354000 with x1830881262927744 ext(1073152->1077247) 00002000:00010000:3.0:1746065183.355960:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354000 00000100:00100000:3.0:1746065183.355976:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8029 00000100:00100000:3.0:1746065183.355983:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881262927744:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065183.356687:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881262927744:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 703us (842us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065183.356693:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8029 00002000:00100000:3.0:1746065183.356698:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1073152->1077247) req@ffff880095354000 x1830881262927744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/4536 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.356706:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354000 with x1830881262927744 ext(1073152->1077247) 00002000:00010000:3.0:1746065183.356709:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354000 00000100:00100000:0.0:1746065183.366397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.366458:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262928000 00000100:00100000:3.0:1746065183.366467:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262928000 00002000:00100000:3.0:1746065183.366502:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1859584->1863679) req@ffff880095354700 x1830881262928000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.366511:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354700 with x1830881262928000 ext(1859584->1863679) 00002000:00010000:3.0:1746065183.366516:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354700 00000100:00100000:3.0:1746065183.366550:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8030 00000100:00100000:3.0:1746065183.366557:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262928000:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065183.366712:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262928000:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 154us (320us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065183.366718:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8030 00002000:00100000:3.0:1746065183.366723:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1859584->1863679) req@ffff880095354700 x1830881262928000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/4536 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.366730:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354700 with x1830881262928000 ext(1859584->1863679) 00002000:00010000:3.0:1746065183.366732:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354700 00000100:00100000:0.0:1746065183.368731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.368787:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262928256 00000100:00100000:3.0:1746065183.368793:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262928256 00000100:00100000:3.0:1746065183.368871:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4208 00000100:00100000:3.0:1746065183.368878:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090023c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31593:x1830881262928256:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065183.369916:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090023c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31593:x1830881262928256:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1036us (1187us total) trans 8589944097 rc 0/0 00000100:00100000:3.0:1746065183.369923:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4208 00000100:00100000:0.0:1746065183.384680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.389090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.389151:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262928640 00000100:00100000:3.0:1746065183.389158:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262928640 00000100:00100000:3.0:1746065183.389207:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14339 00000100:00100000:3.0:1746065183.389214:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881262928640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065183.389229:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.389243:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e23400/0x14b4f8542d4fc0ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6036f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065183.389289:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313472:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065183.389369:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c50d600 going to sleep for 11 seconds 00002000:00010000:3.0:1746065183.392790:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime: 1746065183 -> 1746065184 00002000:00010000:3.0:1746065183.392796:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime: 1746065183 -> 1746065184 00000100:00100000:3.0:1746065183.392847:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313472:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065183.392876:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e23400/0x14b4f8542d4fc0ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6036f expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.392888:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e23400/0x14b4f8542d4fc0ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6036f expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.393245:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e23400, rc 0) 00000100:00100000:3.0:1746065183.393299:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881262928640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4084us (4212us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065183.393306:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14339 00000100:00100000:1.0:1746065183.402709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.421617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.429520:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881262928896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26633us (26817us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746065183.429529:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8031 00002000:00100000:3.0:1746065183.429537:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f9cf800 x1830881262928896/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 504/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.429546:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf800 with x1830881262928896 ext(1048576->2097151) 00002000:00010000:3.0:1746065183.429550:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cf800 00000100:00100000:0.0:1746065183.437431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.437607:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262929280 00000100:00100000:3.0:1746065183.437615:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262929280 00000100:00100000:3.0:1746065183.437666:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14340 00000100:00100000:3.0:1746065183.437674:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262929280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065183.437690:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.437703:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fc129 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6037d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065183.437748:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313600:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065183.438425:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c50d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065183.440281:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313600:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065183.440306:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fc129 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6037d expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.440317:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fc129 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6037d expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.440347:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c67200, rc 0) 00000100:00100000:3.0:1746065183.440384:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881262929280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2710us (2959us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065183.440391:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14340 00000100:00100000:0.0:1746065183.445240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.445423:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262929408 00000100:00100000:3.0:1746065183.445431:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262929408 00000100:00100000:3.0:1746065183.445481:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14341 00000100:00100000:3.0:1746065183.445489:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:31600:x1830881262929408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065183.445504:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.445520:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60384 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.445547:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.445553:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065183.445554:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065183.445557:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.445582:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.445592:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 25 pid: 8429 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746065183.445607:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065183.445690:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c50d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.446247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.446857:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262929536 00000100:00100000:1.0:1746065183.446862:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262929536 00000100:00100000:1.0:1746065183.446895:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14342 00000100:00100000:1.0:1746065183.446902:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31603:x1830881262929536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.446911:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.446921:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6038b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.446939:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6134600/0x14b4f8542d4fc0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6034c expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.446949:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065183.446951:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065183.446954:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.446970:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6134600/0x14b4f8542d4fc0c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1679359) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6034c expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.446978:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6134600/0x14b4f8542d4fc0c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1679359) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6034c expref: 16 pid: 8429 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065183.446986:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260313856:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.447043:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065183.449314:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260313728:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065183.449314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065183.449331:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.449341:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c67600, rc 0) 00000100:00100000:3.0:1746065183.449367:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:31600:x1830881262929408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3881us (4135us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065183.449372:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14341 00000100:00100000:1.0:1746065183.449657:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260313856:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.449672:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 27 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.449681:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c730c00, rc 0) 00000100:00100000:1.0:1746065183.450231:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31603:x1830881262929536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3328us (3983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.450237:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14342 00000100:00100000:3.0:1746065183.450362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.462203:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881262929792:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10956us (11831us total) trans 17179873581 rc 0/0 00000100:00100000:3.0:1746065183.462214:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2448 00002000:00100000:3.0:1746065183.462225:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1466368->1679359) req@ffff88009c3f8000 x1830881262929792/t17179873581(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/448 e 0 to 0 dl 1746065194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.462233:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8000 with x1830881262929792 ext(1466368->1679359) 00010000:00010000:3.0:1746065183.462241:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6134600/0x14b4f8542d4fc0c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6034c expref: 18 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746065183.462251:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6134600/0x14b4f8542d4fc0c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6034c expref: 18 pid: 8429 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746065183.462260:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3f8000 00000100:00100000:0.0:1746065183.467735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.468761:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881262929664:12345-192.168.202.46@tcp:4:cat.0 Request processed in 18127us (19449us total) trans 17179873582 rc 0/0 00000100:00100000:3.0:1746065183.468769:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2447 00002000:00100000:3.0:1746065183.468785:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1073152->1863679) req@ffff88009fb11c00 x1830881262929664/t17179873582(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/448 e 0 to 0 dl 1746065194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.468793:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881262929664 ext(1073152->1863679) 00010000:00010000:3.0:1746065183.468807:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 29 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746065183.468834:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 29 pid: 8429 timeout: 882 lvb_type: 0 00002000:00010000:3.0:1746065183.468840:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb11c00 00000100:00100000:0.0:1746065183.472208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.472256:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262930048 00000100:00100000:1.0:1746065183.472263:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262930048 00010000:00010000:1.0:1746065183.472289:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 29 pid: 8429 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065183.472378:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7296 00000100:00100000:1.0:1746065183.472385:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881262930048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065183.472397:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065183.472416:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 29 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.472425:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 29 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.472443:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e23200/0x14b4f8542d4fc0d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1073152->1863679) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60361 expref: 29 pid: 8429 timeout: 882 lvb_type: 0 00010000:00010000:1.0:1746065183.472771:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.472774:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.472780:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.472788:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.472842:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065183.472853:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260314112:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065183.473514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.473567:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262930304 00000100:00100000:3.0:1746065183.473572:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262930304 00002000:00100000:3.0:1746065183.473597:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fb11500 x1830881262930304/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.473606:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881262930304 ext(1048576->2097151) 00002000:00010000:3.0:1746065183.473609:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11500 00000100:00100000:3.0:1746065183.473623:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8032 00000100:00100000:3.0:1746065183.473628:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881262930304:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065183.473632:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065183.476492:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260314112:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065183.476511:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065183.476537:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881262930048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4152us (4335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.476546:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7296 00000100:00100000:0.0:1746065183.480328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.480422:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262930560 00000100:00100000:3.0:1746065183.480430:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262930560 00002000:00100000:3.0:1746065183.480464:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009fb10e00 x1830881262930560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.480473:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10e00 with x1830881262930560 ext(1048576->2097151) 00002000:00010000:3.0:1746065183.480478:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10e00 00000100:00100000:3.0:1746065183.480498:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8033 00000100:00100000:3.0:1746065183.480503:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881262930560:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.494891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.494947:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262930688 00000100:00100000:0.0:1746065183.494950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.494955:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262930688 00000100:00100000:1.0:1746065183.495031:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14343 00000100:00100000:1.0:1746065183.495038:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31603:x1830881262930688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.495053:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.495066:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c730e00/0x14b4f8542d4fc13e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60392 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.495087:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.495089:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.495094:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c730e00/0x14b4f8542d4fc13e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60392 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.495106:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c730e00/0x14b4f8542d4fc13e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60392 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.495115:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c730e00, rc 0) 00000100:00100000:1.0:1746065183.495166:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:31603:x1830881262930688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 128us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.495172:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14343 00000100:00100000:3.0:1746065183.495534:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262930944 00000100:00100000:3.0:1746065183.495538:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262930944 00000100:00100000:3.0:1746065183.496760:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9897 00000100:00100000:3.0:1746065183.496767:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:31605:x1830881262930944:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065183.496781:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.496794:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566ca00/0x14b4f8542d4fc145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60399 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.497899:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.497910:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.497919:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.497929:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.497934:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.497942:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498029:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498035:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498041:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065183.498047:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065183.498102:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498108:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498113:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498118:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd88000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.498121:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498126:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498134:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065183.498136:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065183.498139:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498147:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88000/0x14b4f8542d4fc15a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498169:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498173:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498178:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498181:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a566d000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.498184:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498188:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498193:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065183.498194:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065183.498196:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498200:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d000/0x14b4f8542d4fc14c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498206:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498210:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498214:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498219:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a566d600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.498221:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498225:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498228:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205500) 00010000:00010000:3.0:1746065183.498230:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065183.498232:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498236:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566d600/0x14b4f8542d4fc153 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.498263:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566ca00/0x14b4f8542d4fc145 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60399 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.498270:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a566ca00/0x14b4f8542d4fc145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60399 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.498276:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a566ca00, rc 0) 00000100:00100000:3.0:1746065183.498318:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:31605:x1830881262930944:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1552us (3368us total) trans 8589944100 rc 301/301 00000100:00100000:3.0:1746065183.498324:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9897 00000100:00100000:0.0:1746065183.500486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.510238:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.520871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.520958:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262931584 00000100:00100000:3.0:1746065183.520967:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262931584 00000100:00100000:3.0:1746065183.521015:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4209 00000100:00100000:3.0:1746065183.521023:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:31600:x1830881262931584:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065183.521213:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:31600:x1830881262931584:12345-192.168.202.46@tcp:35:cat.0 Request processed in 191us (348us total) trans 8589944101 rc 0/0 00000100:00100000:3.0:1746065183.521219:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4209 00000100:00100000:0.0:1746065183.527898:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.528629:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262931712 00000100:00100000:1.0:1746065183.528637:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262931712 00000100:00100000:1.0:1746065183.528690:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14345 00000100:00100000:1.0:1746065183.528696:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:31605:x1830881262931712:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065183.528711:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.528726:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603a7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.528749:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc050 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60314 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.528756:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f716000/0x14b4f8542d4fc065 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60329 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.528762:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.528763:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.528766:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1646592->2002943] (req 1646592->2002943) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 18 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.528792:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f716000/0x14b4f8542d4fc065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60329 expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.528837:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f716000/0x14b4f8542d4fc065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60329 expref: 24 pid: 8427 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065183.528848:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260314240:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.528934:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc050 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60314 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.528946:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc050 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60314 expref: 18 pid: 8429 timeout: 882 lvb_type: 0 00000100:00100000:1.0:1746065183.528954:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260314368:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.528972:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.529035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.529705:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262931968 00000100:00100000:3.0:1746065183.529710:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262931968 00000100:00100000:3.0:1746065183.529746:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4210 00000100:00100000:3.0:1746065183.529751:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:31603:x1830881262931968:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065183.529942:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31603:x1830881262931968:12345-192.168.202.46@tcp:35:cat.0 Request processed in 190us (906us total) trans 8589944102 rc 0/0 00000100:00100000:3.0:1746065183.529948:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4210 00000100:00100000:0.0:1746065183.532230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.532266:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260314240:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.532278:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260314368:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.532305:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1646592->2002943] (req 1646592->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 18 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.532320:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c730800, rc 0) 00000100:00100000:1.0:1746065183.532370:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:31605:x1830881262931712:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3673us (4478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.532377:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14345 00000100:00100000:0.0:1746065183.534769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.538846:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.547037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.550177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.550270:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262932992 00000100:00100000:1.0:1746065183.550278:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262932992 00000100:00100000:1.0:1746065183.550323:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4211 00000100:00100000:1.0:1746065183.550330:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:31605:x1830881262932992:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065183.550499:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:31605:x1830881262932992:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 168us (327us total) trans 8589944103 rc 0/0 00000100:00100000:1.0:1746065183.550504:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4211 00000100:00100000:0.0:1746065183.588995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.589098:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262933248 00000100:00100000:3.0:1746065183.589106:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262933248 00000100:00100000:3.0:1746065183.589148:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9898 00000100:00100000:3.0:1746065183.589154:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31610:x1830881262933248:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065183.589173:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.589186:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88800/0x14b4f8542d4fc176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603ae expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.589274:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589285:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589293:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589304:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589310:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589314:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589400:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589407:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589412:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065183.589419:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065183.589482:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589488:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589493:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589498:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd88e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.589501:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589506:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589514:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065183.589517:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065183.589520:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589525:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88e00/0x14b4f8542d4fc18b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589554:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589559:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589563:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589566:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd88a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.589568:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589571:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589577:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065183.589578:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065183.589580:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589584:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88a00/0x14b4f8542d4fc17d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589589:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589593:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589597:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589600:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd88c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.589602:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589605:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589610:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205e00) 00010000:00010000:3.0:1746065183.589612:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065183.589614:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589618:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88c00/0x14b4f8542d4fc184 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.589646:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88800/0x14b4f8542d4fc176 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ae expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.589652:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd88800/0x14b4f8542d4fc176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ae expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.589659:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd88800, rc 0) 00000100:00100000:3.0:1746065183.591442:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31610:x1830881262933248:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2281us (2447us total) trans 8589944104 rc 301/301 00000100:00100000:3.0:1746065183.591451:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9898 00000100:00100000:0.0:1746065183.680008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.680930:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262933504 00000100:00100000:3.0:1746065183.680937:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262933504 00000100:00100000:3.0:1746065183.680990:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9899 00000100:00100000:3.0:1746065183.680998:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:31613:x1830881262933504:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065183.681018:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.681031:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89000/0x14b4f8542d4fc199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603b5 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.681121:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681132:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681140:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681151:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681156:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681161:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681245:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681252:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681258:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065183.681266:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065183.681332:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681338:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681343:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681347:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd89600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.681350:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681355:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681364:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065183.681367:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065183.681370:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681374:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89600/0x14b4f8542d4fc1ae lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681407:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681412:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681416:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681420:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd89200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.681422:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681426:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681432:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065183.681433:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065183.681435:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681439:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89200/0x14b4f8542d4fc1a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681447:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681450:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681455:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681458:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fd89400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065183.681460:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681464:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681469:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:3.0:1746065183.681471:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065183.681472:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681477:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89400/0x14b4f8542d4fc1a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065183.681506:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89000/0x14b4f8542d4fc199 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603b5 expref: 19 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.681513:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fd89000/0x14b4f8542d4fc199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603b5 expref: 19 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.681521:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fd89000, rc 0) 00000100:00100000:3.0:1746065183.681563:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+18:31613:x1830881262933504:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 565us (1563us total) trans 8589944105 rc 301/301 00000100:00100000:3.0:1746065183.681568:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9899 00000100:00100000:0.0:1746065183.752231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.754587:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262933632 00000100:00100000:1.0:1746065183.754597:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262933632 00000100:00100000:1.0:1746065183.754651:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14346 00000100:00100000:1.0:1746065183.754659:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:31610:x1830881262933632:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065183.754674:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.754690:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603bc expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.754715:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 16 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.754721:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065183.754722:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065183.754725:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1310720->2097151] (req 1310720->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 25 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.754749:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 16 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.754759:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 16 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065183.754769:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260314624:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.754888:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.759304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.759496:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260314624:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.759522:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1310720->2097151] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 25 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.759535:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2f200, rc 0) 00000100:00100000:1.0:1746065183.759570:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31610:x1830881262933632:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4912us (7344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.759577:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14346 00000100:00100000:1.0:1746065183.759701:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262934016 00000100:00100000:1.0:1746065183.759707:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262934016 00000100:00100000:1.0:1746065183.759740:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14347 00000100:00100000:1.0:1746065183.759745:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:31613:x1830881262934016:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065183.759757:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.759772:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603ca expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065183.759772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.759839:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262934144 00000100:00100000:3.0:1746065183.759843:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262934144 00002000:00100000:3.0:1746065183.759869:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1646592->2002943) req@ffff880133266680 x1830881262934144/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.759877:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133266680 with x1830881262934144 ext(1646592->2002943) 00010000:00010000:3.0:1746065183.759882:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 17 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065183.759911:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e46400/0x14b4f8542d4fbe90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601ee expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.759919:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.759925:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9600/0x14b4f8542d4fbeba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60218 expref: 19 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.759931:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.759932:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.759935:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [4087808->4194303] (req 4087808->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ca expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.759958:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9600/0x14b4f8542d4fbeba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60218 expref: 19 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.759969:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3d9600/0x14b4f8542d4fbeba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60218 expref: 19 pid: 2463 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065183.759979:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260314752:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.760048:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 6 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.760055:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 6 pid: 8851 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065183.760066:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260314880:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.760091:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e46400/0x14b4f8542d4fbe90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601ee expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.760098:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e46400/0x14b4f8542d4fbe90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601ee expref: 28 pid: 8429 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065183.760105:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260315008:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.760121:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065183.760225:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 17 pid: 8427 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746065183.760232:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880133266680 00000100:00100000:3.0:1746065183.760254:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2449 00000100:00100000:3.0:1746065183.760261:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881262934144:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065183.767517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.771254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.771297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.772089:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260314752:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.772098:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260314880:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.772104:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260315008:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.772135:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [4087808->4194303] (req 4087808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ca expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.772148:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2e800, rc 0) 00000100:00100000:1.0:1746065183.772181:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:31613:x1830881262934016:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 12436us (12883us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.772188:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14347 00000100:00100000:1.0:1746065183.772235:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262934656 00000100:00100000:1.0:1746065183.772240:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262934656 00000100:00100000:1.0:1746065183.772272:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9901 00000100:00100000:1.0:1746065183.772282:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31619:x1830881262934656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.772297:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.772311:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c730200/0x14b4f8542d4fc1ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603d1 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.772389:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.772399:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.772407:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.772417:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.772422:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.772427:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065183.773148:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1958:x1830881262934144:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 12886us (13375us total) trans 21474840849 rc 0/0 00000100:00100000:3.0:1746065183.773157:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2449 00002000:00100000:3.0:1746065183.773165:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1646592->2002943) req@ffff880133266680 x1830881262934144/t21474840849(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/448 e 0 to 0 dl 1746065194 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.773173:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133266680 with x1830881262934144 ext(1646592->2002943) 00010000:00010000:3.0:1746065183.773179:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 19 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.773190:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 19 pid: 8427 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746065183.773196:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880133266680 00000100:00100000:0.0:1746065183.773279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.773351:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262934400 00000100:00100000:3.0:1746065183.773354:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262934400 00010000:00010000:3.0:1746065183.773366:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 7 pid: 8851 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746065183.773380:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7300 00000100:00100000:3.0:1746065183.773384:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881262934400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065183.773389:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065183.773536:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 7 pid: 8851 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065183.773544:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 7 pid: 8851 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065183.773559:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d75d200/0x14b4f8542d4fbf54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60288 expref: 7 pid: 8851 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065183.773579:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065183.773596:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1959:x1830881262934400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 211us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065183.773601:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7300 00010000:00010000:1.0:1746065183.773663:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773672:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773679:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065183.773688:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065183.773745:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773750:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773755:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773760:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0f9400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065183.773763:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773769:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773776:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065183.773778:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065183.773781:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773785:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0f9400/0x14b4f8542d4fc202 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773829:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773834:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773838:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773842:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090577400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065183.773844:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773849:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773855:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065183.773857:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065183.773860:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773863:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090577400/0x14b4f8542d4fc1f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773871:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773876:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773880:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773883:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090577e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065183.773886:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773890:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773895:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012cf55b00) 00010000:00010000:1.0:1746065183.773897:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065183.773899:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773903:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090577e00/0x14b4f8542d4fc1fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.773936:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c730200/0x14b4f8542d4fc1ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603d1 expref: 259 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.773942:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c730200/0x14b4f8542d4fc1ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603d1 expref: 259 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.773948:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c730200, rc 0) 00000100:00100000:1.0:1746065183.773968:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31619:x1830881262934656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1690us (2721us total) trans 8589944107 rc 301/301 00000100:00100000:1.0:1746065183.773974:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9901 00000100:00100000:0.0:1746065183.780390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.780693:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262934784 00000100:00100000:1.0:1746065183.780701:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262934784 00000100:00100000:1.0:1746065183.781158:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14348 00000100:00100000:1.0:1746065183.781166:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881262934784:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.781180:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.781194:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c730200/0x14b4f8542d4fc210 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603d8 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065183.781246:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260315136:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065183.781693:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.781853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.782064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.782112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.785178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.785213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.785564:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262935296 00000100:00100000:3.0:1746065183.785570:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262935296 00000100:00100000:3.0:1746065183.785596:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262935424 00000100:00100000:3.0:1746065183.785598:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262935424 00000100:00100000:3.0:1746065183.785612:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14350 00000100:00100000:3.0:1746065183.785617:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262935296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065183.785627:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.785637:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094970e00/0x14b4f8542d4fc21e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603e6 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065183.785669:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260315648:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065183.785726:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c50d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065183.785741:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14351 00000100:00100000:3.0:1746065183.785746:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262935424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065183.785753:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.785760:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094971400/0x14b4f8542d4fc225 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603ed expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065183.785785:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260315776:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065183.785812:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065183.787581:0:25185:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88009f9cce00 x1830881260315136) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 21 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065183.787611:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c730800/0x14b4f8542d4fc16f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1646592->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a7 expref: 21 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065183.787627:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260315136:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065183.787651:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c730200/0x14b4f8542d4fc210 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603d8 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.787660:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c730200/0x14b4f8542d4fc210 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603d8 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.787666:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c730200, rc 0) 00000100:00100000:1.0:1746065183.787691:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881262934784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6527us (7308us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065183.787697:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14348 00000100:00100000:0.0:1746065183.787890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.788190:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260315264:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065183.788200:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065183.788215:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881262935040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5938us (6363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065183.788222:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7301 00000100:00100000:0.0:1746065183.788407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.788481:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260315776:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065183.788495:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094971400/0x14b4f8542d4fc225 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ed expref: 29 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.788502:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094971400/0x14b4f8542d4fc225 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ed expref: 29 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.788512:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094971400, rc 0) 00000100:00100000:3.0:1746065183.788527:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881262935424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2781us (3313us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065183.788532:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14351 00002000:00010000:3.0:1746065183.788553:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065183 -> 1746065184 00000100:00100000:3.0:1746065183.788560:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260315648:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065183.788573:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094970e00/0x14b4f8542d4fc21e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603e6 expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.788585:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094970e00/0x14b4f8542d4fc21e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603e6 expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.788591:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094970e00, rc 0) 00000100:00100000:3.0:1746065183.788618:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881262935296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3001us (3441us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065183.788623:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14350 00000100:00100000:3.0:1746065183.789227:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262935936 00000100:00100000:3.0:1746065183.789230:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262935936 00002000:00100000:3.0:1746065183.789250:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1310720->1314815) req@ffff880133265880 x1830881262935936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.789257:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133265880 with x1830881262935936 ext(1310720->1314815) 00002000:00010000:3.0:1746065183.789260:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133265880 00000100:00100000:3.0:1746065183.789277:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8038 00000100:00100000:3.0:1746065183.789281:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881262935936:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065183.789360:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881262935936:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 78us (952us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065183.789366:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8038 00002000:00100000:3.0:1746065183.789370:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1310720->1314815) req@ffff880133265880 x1830881262935936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/4536 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.789376:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133265880 with x1830881262935936 ext(1310720->1314815) 00002000:00010000:3.0:1746065183.789379:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133265880 00000100:00100000:0.0:1746065183.797495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.797539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.797562:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262936064 00000100:00100000:3.0:1746065183.797570:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262936064 00000100:00100000:3.0:1746065183.797602:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262936192 00000100:00100000:3.0:1746065183.797604:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262936192 00000100:00100000:3.0:1746065183.797632:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14352 00000100:00100000:3.0:1746065183.797639:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:31613:x1830881262936064:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065183.797652:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.797667:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094970c00/0x14b4f8542d4fc22c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603f4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.797693:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4fc05e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60322 expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.797699:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26200/0x14b4f8542d4fc06c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60330 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.797704:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.797706:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.797708:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094970c00/0x14b4f8542d4fc22c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4788223] (req 4194304->4788223) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603f4 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.797732:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26200/0x14b4f8542d4fc06c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60330 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.797747:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26200/0x14b4f8542d4fc06c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60330 expref: 25 pid: 8429 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065183.797758:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260315904:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065183.797860:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4fc05e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60322 expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.797869:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e26000/0x14b4f8542d4fc05e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60322 expref: 19 pid: 8429 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065183.797876:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260316032:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065183.797894:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065183.798049:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14353 00000100:00100000:1.0:1746065183.798056:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31610:x1830881262936192:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065183.798063:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.798068:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e603fb expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.798080:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.798081:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.798084:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.798092:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.798099:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3d9600, rc 0) 00000100:00100000:1.0:1746065183.798139:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31610:x1830881262936192:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 83us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.798144:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14353 00000100:00100000:3.0:1746065183.799650:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262936448 00000100:00100000:3.0:1746065183.799655:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262936448 00000100:00100000:3.0:1746065183.799710:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4212 00000100:00100000:3.0:1746065183.799716:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:31574:x1830881262936448:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065183.799903:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31574:x1830881262936448:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 186us (1213us total) trans 8589944108 rc 0/0 00000100:00100000:3.0:1746065183.799909:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4212 00000100:00100000:0.0:1746065183.800145:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:1.0:1746065183.800766:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065183.800906:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262936704 00000100:00100000:3.0:1746065183.800910:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262936704 00002000:00100000:3.0:1746065183.800934:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1310719) req@ffff880093ba2a00 x1830881262936704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.800942:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2a00 with x1830881262936704 ext(1048576->1310719) 00002000:00010000:3.0:1746065183.800946:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba2a00 00000100:00100000:3.0:1746065183.800965:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8039 00000100:00100000:3.0:1746065183.800971:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881262936704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.801621:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.802152:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262936960 00000100:00100000:1.0:1746065183.802158:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262936960 00002000:00100000:1.0:1746065183.802183:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880093ba1180 x1830881262936960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.802190:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1180 with x1830881262936960 ext(1048576->2097151) 00002000:00010000:1.0:1746065183.802194:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba1180 00000100:00100000:1.0:1746065183.802219:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8040 00000100:00100000:1.0:1746065183.802224:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881262936960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.806425:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.806461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.806532:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262937344 00000100:00100000:3.0:1746065183.806540:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262937344 00000100:00100000:3.0:1746065183.806581:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4213 00000100:00100000:3.0:1746065183.806587:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31574:x1830881262937344:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065183.807636:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31574:x1830881262937344:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 1048us (1219us total) trans 8589944109 rc 0/0 00000100:00100000:3.0:1746065183.807643:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4213 00000100:00100000:3.0:1746065183.807803:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881262936704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6824us (7650us total) trans 0 rc 262144/262144 00000100:00100000:3.0:1746065183.807811:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8039 00002000:00100000:3.0:1746065183.807833:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1310719) req@ffff880093ba2a00 x1830881262936704/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 262144/262144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.807841:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2a00 with x1830881262936704 ext(1048576->1310719) 00002000:00010000:3.0:1746065183.807845:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba2a00 00000100:00100000:0.0:1746065183.810235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.811352:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881262936960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9125us (9729us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065183.811360:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8040 00002000:00100000:1.0:1746065183.811609:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880093ba1180 x1830881262936960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.811618:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1180 with x1830881262936960 ext(1048576->2097151) 00002000:00010000:1.0:1746065183.811622:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba1180 00000100:00100000:0.0:1746065183.816428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.816457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.816525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.816637:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14355 00000100:00100000:1.0:1746065183.816646:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881262937728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.816653:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.816666:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4fc241 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60409 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065183.816689:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260316544:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065183.816697:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260316160:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065183.816705:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260316288:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065183.816711:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065183.816721:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065183.816727:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262937984 00000100:00100000:1.0:1746065183.816730:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262937984 00000100:00100000:3.0:1746065183.816739:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881262937472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6238us (6510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065183.816746:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7304 00002000:00100000:1.0:1746065183.816751:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2338816->2342911) req@ffff880093ba0700 x1830881262937984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.816760:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0700 with x1830881262937984 ext(2338816->2342911) 00002000:00010000:1.0:1746065183.816763:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba0700 00000100:00100000:1.0:1746065183.816788:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8041 00000100:00100000:1.0:1746065183.816794:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881262937984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065183.816955:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881262937984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 160us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065183.816960:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8041 00002000:00100000:1.0:1746065183.816965:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2338816->2342911) req@ffff880093ba0700 x1830881262937984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/4536 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.816976:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0700 with x1830881262937984 ext(2338816->2342911) 00002000:00010000:1.0:1746065183.816979:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba0700 00000100:00100000:0.0:1746065183.819620:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.819853:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262938112 00000100:00100000:1.0:1746065183.819859:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262938112 00000100:00100000:1.0:1746065183.819890:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14356 00000100:00100000:1.0:1746065183.819896:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:31617:x1830881262938112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.819909:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.819921:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60410 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.819939:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.819945:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065183.819946:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065183.819950:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60410 expref: 19 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.819982:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 24 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.819993:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 24 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065183.820002:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260316672:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065183.820045:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.820608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.820898:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260316544:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065183.820918:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4fc241 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60409 expref: 29 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.820926:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336aa00/0x14b4f8542d4fc241 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60409 expref: 29 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065183.820936:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336aa00, rc 0) 00000100:00100000:1.0:1746065183.820957:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881262937728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4313us (4499us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065183.820962:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14355 00000100:00100000:0.0:1746065183.823672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.823734:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262938624 00000100:00100000:1.0:1746065183.823742:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262938624 00002000:00100000:1.0:1746065183.823776:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4784128->4788223) req@ffff880093ba2680 x1830881262938624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.823785:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2680 with x1830881262938624 ext(4784128->4788223) 00002000:00010000:1.0:1746065183.823789:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba2680 00000100:00100000:1.0:1746065183.823893:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8042 00000100:00100000:1.0:1746065183.823905:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262938624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065183.824043:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262938624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 139us (375us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065183.824049:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8042 00002000:00100000:1.0:1746065183.824055:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4784128->4788223) req@ffff880093ba2680 x1830881262938624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/4536 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.824061:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2680 with x1830881262938624 ext(4784128->4788223) 00002000:00010000:1.0:1746065183.824064:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba2680 00000100:00100000:1.0:1746065183.826304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.826632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.826862:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262938752 00000100:00100000:3.0:1746065183.826869:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262938752 00002000:00100000:3.0:1746065183.826897:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1310720->2097151) req@ffff88009f9cce00 x1830881262938752/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.826905:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cce00 with x1830881262938752 ext(1310720->2097151) 00010000:00010000:3.0:1746065183.826911:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 25 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.826925:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 25 pid: 8427 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746065183.826932:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cce00 00000100:00100000:3.0:1746065183.826959:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2450 00000100:00100000:3.0:1746065183.826965:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881262938752:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065183.827144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.837444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.854602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.855029:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262939392 00000100:00100000:3.0:1746065183.855036:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262939392 00010000:00010000:3.0:1746065183.855064:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 28 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065183.855086:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7305 00000100:00100000:3.0:1746065183.855092:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881262939392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065183.855103:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065183.855118:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 28 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.855127:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 28 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.855143:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e2f200/0x14b4f8542d4fc1bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603bc expref: 28 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.855157:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.855159:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.855165:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60410 expref: 20 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.855171:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60410 expref: 20 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.855195:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60410 expref: 20 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065183.855205:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260316928:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065183.855270:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065183.857666:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260316928:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065183.857680:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065183.857788:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881262939392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2694us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065183.857804:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7305 00000100:00100000:0.0:1746065183.860691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.860906:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262939520 00000100:00100000:3.0:1746065183.860914:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262939520 00010000:00010000:3.0:1746065183.860942:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094970c00/0x14b4f8542d4fc22c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2342912->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603f4 expref: 21 pid: 8851 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065183.860975:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7306 00000100:00100000:3.0:1746065183.860982:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881262939520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065183.860992:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065183.861010:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094970c00/0x14b4f8542d4fc22c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2342912->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603f4 expref: 21 pid: 8851 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.861025:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094970c00/0x14b4f8542d4fc22c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2342912->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603f4 expref: 21 pid: 8851 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.861044:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094970c00/0x14b4f8542d4fc22c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2342912->18446744073709551615] (req 4194304->4788223) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603f4 expref: 21 pid: 8851 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.861059:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.861060:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.861066:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.861072:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.861162:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 26 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065183.861172:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260317056:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065183.861468:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065183.862338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.863217:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260317056:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065183.863233:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065183.863271:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1958:x1830881262939520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2288us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065183.863279:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7306 00000100:00100000:0.0:1746065183.867450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.869273:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262940032 00000100:00100000:3.0:1746065183.869283:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262940032 00002000:00100000:3.0:1746065183.869322:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2342912->3145727) req@ffff880093ba2300 x1830881262940032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.869331:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2300 with x1830881262940032 ext(2342912->3145727) 00002000:00010000:3.0:1746065183.869343:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba2300 00000100:00100000:3.0:1746065183.869371:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8044 00000100:00100000:3.0:1746065183.869377:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881262940032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065183.879533:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881262940032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10147us (12083us total) trans 0 rc 802816/802816 00000100:00100000:3.0:1746065183.879544:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8044 00002000:00100000:3.0:1746065183.879554:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2342912->3145727) req@ffff880093ba2300 x1830881262940032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.879563:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2300 with x1830881262940032 ext(2342912->3145727) 00002000:00010000:3.0:1746065183.879568:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba2300 00000100:00100000:0.0:1746065183.883152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.883963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.883977:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262940160 00000100:00100000:0.0:1746065183.883980:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262940160 00000100:00100000:0.0:1746065183.883996:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14359 00000100:00100000:0.0:1746065183.884001:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:31617:x1830881262940160:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065183.884007:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065183.884016:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6041e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065183.884029:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065183.884034:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065183.884035:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065183.884037:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065183.884050:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065183.884058:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 26 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065183.884065:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260317312:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065183.884911:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065183.885781:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260317312:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065183.885808:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.885832:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a59b8600, rc 0) 00000100:00100000:0.0:1746065183.886458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.886641:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262940416 00000100:00100000:3.0:1746065183.886647:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262940416 00002000:00100000:3.0:1746065183.886678:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2342911) req@ffff880093ba3480 x1830881262940416/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.886685:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3480 with x1830881262940416 ext(2097152->2342911) 00010000:00010000:3.0:1746065183.886691:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 27 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.886699:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 27 pid: 25185 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746065183.886710:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba3480 00000100:00100000:3.0:1746065183.886734:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2452 00000100:00100000:3.0:1746065183.886741:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881262940416:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065183.887281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.887581:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:31617:x1830881262940160:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3577us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.887588:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14359 00000100:00100000:3.0:1746065183.887994:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262940544 00000100:00100000:3.0:1746065183.887998:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262940544 00002000:00100000:3.0:1746065183.888017:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (4087808->4194303) req@ffff880093ba0000 x1830881262940544/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.888025:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0000 with x1830881262940544 ext(4087808->4194303) 00010000:00010000:3.0:1746065183.888032:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ca expref: 18 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.888040:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ca expref: 18 pid: 25185 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746065183.888046:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba0000 00000100:00100000:3.0:1746065183.888058:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2453 00000100:00100000:3.0:1746065183.888062:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881262940544:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065183.891619:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881262940416:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4033us (4317us total) trans 21474840852 rc 0/0 00000100:00100000:3.0:1746065183.891626:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2452 00002000:00100000:3.0:1746065183.891632:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2342911) req@ffff880093ba3480 x1830881262940416/t21474840852(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/448 e 0 to 0 dl 1746065194 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.891639:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3480 with x1830881262940416 ext(2097152->2342911) 00010000:00010000:3.0:1746065183.891645:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 29 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.891651:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 29 pid: 25185 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746065183.891656:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba3480 00000100:00100000:0.0:1746065183.892358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.892423:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262940672 00000100:00100000:3.0:1746065183.892428:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262940672 00010000:00010000:3.0:1746065183.892447:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 29 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065183.892932:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7307 00000100:00100000:3.0:1746065183.892940:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881262940672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065183.893033:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065183.893050:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 29 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.893059:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 29 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.893077:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc233 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->2342911] (req 2097152->2342911) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603fb expref: 29 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065183.893243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065183.893429:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.893480:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.893487:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065183.893566:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262940800 00000100:00100000:1.0:1746065183.893570:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262940800 00010000:00010000:3.0:1746065183.893602:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.893635:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ca expref: 20 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065183.893655:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065183.893661:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7308 00000100:00100000:3.0:1746065183.893666:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260317440:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065183.893666:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262940800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065183.893672:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065183.893684:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ca expref: 20 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065183.893691:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ca expref: 20 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065183.893704:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e2e800/0x14b4f8542d4fc1c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603ca expref: 20 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065183.893721:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065183.893721:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.893722:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.893726:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.893732:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.893778:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065183.893787:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260317568:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065183.893854:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065183.896557:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260317440:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065183.896601:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260317568:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065183.896616:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065183.896658:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881262940800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2990us (3413us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065183.896704:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065183.896720:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881262940672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3781us (4366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.896937:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7308 00000100:00100000:3.0:1746065183.897007:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7307 00000100:00100000:0.0:1746065183.897113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.897239:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262941056 00000100:00100000:3.0:1746065183.897245:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262941056 00002000:00100000:3.0:1746065183.897273:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009fb12300 x1830881262941056/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.897281:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830881262941056 ext(2097152->3145727) 00002000:00010000:3.0:1746065183.897284:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12300 00000100:00100000:3.0:1746065183.897754:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8045 00000100:00100000:3.0:1746065183.897761:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262941056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065183.905995:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262941056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8224us (8872us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065183.906008:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8045 00002000:00100000:3.0:1746065183.906019:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009fb12300 x1830881262941056/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.906028:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830881262941056 ext(2097152->3145727) 00002000:00010000:3.0:1746065183.906033:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12300 00000100:00100000:0.0:1746065183.907103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.907303:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262941312 00000100:00100000:3.0:1746065183.907309:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262941312 00002000:00100000:3.0:1746065183.907340:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fb11180 x1830881262941312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.907348:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11180 with x1830881262941312 ext(2097152->3145727) 00002000:00010000:3.0:1746065183.907352:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11180 00000100:00100000:3.0:1746065183.908431:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8046 00000100:00100000:3.0:1746065183.908441:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262941312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.908892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.911202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065183.911222:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262941568 00000100:00100000:1.0:1746065183.911229:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262941568 00002000:00100000:1.0:1746065183.911259:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb13100 x1830881262941568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.911268:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13100 with x1830881262941568 ext(3145728->4194303) 00002000:00010000:1.0:1746065183.911272:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13100 00000100:00100000:1.0:1746065183.911294:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262941824 00000100:00100000:1.0:1746065183.911296:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262941824 00002000:00100000:1.0:1746065183.911309:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f9cfb80 x1830881262941824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065183.911309:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8047 00002000:00100000:1.0:1746065183.911315:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cfb80 with x1830881262941824 ext(3145728->4194303) 00000100:00100000:0.0:1746065183.911317:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262941568:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:1.0:1746065183.911318:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cfb80 00000100:00100000:1.0:1746065183.911485:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8048 00000100:00100000:1.0:1746065183.911491:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881262941824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065183.915132:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262941952 00000100:00100000:1.0:1746065183.915140:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262941952 00000100:00100000:1.0:1746065183.915183:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14360 00000100:00100000:1.0:1746065183.915189:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:31617:x1830881262941952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065183.915203:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.915215:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6042c expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.915236:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.915238:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065183.915243:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.915255:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.915263:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed88000, rc 0) 00000100:00100000:1.0:1746065183.915290:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:31617:x1830881262941952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 102us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065183.915299:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14360 00000100:00100000:3.0:1746065183.927646:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262941312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19195us (20535us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065183.927657:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8046 00002000:00100000:3.0:1746065183.927668:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fb11180 x1830881262941312/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.927676:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11180 with x1830881262941312 ext(2097152->3145727) 00002000:00010000:3.0:1746065183.927681:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11180 00000100:00100000:0.0:1746065183.930263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.930294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.930326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.930338:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262942208 00000100:00100000:3.0:1746065183.930345:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262942208 00002000:00100000:3.0:1746065183.930372:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fb10380 x1830881262942208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.930383:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881262942208 ext(2097152->3145727) 00002000:00010000:3.0:1746065183.930387:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10380 00000100:00100000:3.0:1746065183.930398:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262942464 00000100:00100000:3.0:1746065183.930399:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262942464 00002000:00100000:3.0:1746065183.930405:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb12680 x1830881262942464/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.930408:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12680 with x1830881262942464 ext(3145728->4194303) 00002000:00010000:3.0:1746065183.930410:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb12680 00000100:00100000:3.0:1746065183.930419:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262942720 00000100:00100000:3.0:1746065183.930420:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262942720 00002000:00100000:3.0:1746065183.930426:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009fb12a00 x1830881262942720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.930430:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12a00 with x1830881262942720 ext(3145728->4194303) 00002000:00010000:3.0:1746065183.930432:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12a00 00000100:00100000:3.0:1746065183.930455:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8050 00000100:00100000:3.0:1746065183.930458:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262942464:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065183.930491:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8051 00000100:00100000:1.0:1746065183.930499:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262942720:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.933747:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881262941824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22248us (22544us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065183.933756:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8048 00002000:00100000:0.0:1746065183.933764:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f9cfb80 x1830881262941824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065183.933772:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cfb80 with x1830881262941824 ext(3145728->4194303) 00002000:00010000:0.0:1746065183.933776:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cfb80 00000100:00100000:1.0:1746065183.942157:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262941568:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30831us (33255us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065183.942167:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8047 00002000:00100000:1.0:1746065183.942177:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb13100 x1830881262941568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.942185:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13100 with x1830881262941568 ext(3145728->4194303) 00002000:00010000:1.0:1746065183.942190:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13100 00000100:00100000:3.0:1746065183.945897:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881262942464:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15430us (15594us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065183.945908:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8050 00002000:00100000:3.0:1746065183.945917:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb12680 x1830881262942464/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.945926:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12680 with x1830881262942464 ext(3145728->4194303) 00002000:00010000:3.0:1746065183.945931:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb12680 00000100:00100000:1.0:1746065183.946702:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262942720:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16202us (16373us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065183.946710:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8051 00002000:00100000:1.0:1746065183.946716:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009fb12a00 x1830881262942720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065183.946723:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12a00 with x1830881262942720 ext(3145728->4194303) 00002000:00010000:1.0:1746065183.946727:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12a00 00000100:00100000:0.0:1746065183.950045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.950082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.950453:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262942208:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20009us (20196us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065183.950463:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8049 00002000:00100000:3.0:1746065183.950473:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fb10380 x1830881262942208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.950481:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881262942208 ext(2097152->3145727) 00002000:00010000:3.0:1746065183.950486:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10380 00000100:00100000:3.0:1746065183.950623:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14362 00000100:00100000:3.0:1746065183.950630:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262942976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065183.950640:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065183.950652:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6043a expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065183.950671:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.950672:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065183.950679:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 30 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.950691:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 30 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065183.950700:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73ca00, rc 0) 00000100:00100000:3.0:1746065183.950719:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262942976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 91us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065183.950724:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14362 00000100:00100000:0.0:1746065183.957231:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.957326:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262943232 00000100:00100000:3.0:1746065183.957334:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262943232 00002000:00100000:3.0:1746065183.957371:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb10700 x1830881262943232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.957380:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881262943232 ext(4194304->5013503) 00002000:00010000:3.0:1746065183.957384:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10700 00000100:00100000:3.0:1746065183.957419:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8052 00000100:00100000:3.0:1746065183.957425:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262943232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065183.969346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.969394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.969477:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262943488 00000100:00100000:0.0:1746065183.969484:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262943488 00002000:00100000:0.0:1746065183.969517:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb13480 x1830881262943488/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/0 e 0 to 0 dl 1746065194 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065183.969527:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13480 with x1830881262943488 ext(4194304->5013503) 00002000:00010000:0.0:1746065183.969532:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13480 00000100:00100000:0.0:1746065183.969549:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8053 00000100:00100000:0.0:1746065183.969556:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262943488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065183.970118:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262943232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12691us (12893us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065183.970125:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8052 00002000:00100000:3.0:1746065183.970132:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb10700 x1830881262943232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065183.970138:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881262943232 ext(4194304->5013503) 00002000:00010000:3.0:1746065183.970141:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb10700 00000100:00100000:1.0:1746065183.970268:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262943744 00000100:00100000:1.0:1746065183.970272:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262943744 00000100:00100000:1.0:1746065183.970297:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9902 00000100:00100000:1.0:1746065183.970302:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:31624:x1830881262943744:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065183.970315:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065183.970329:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdbc00/0x14b4f8542d4fc279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60441 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.970414:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970425:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970433:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970444:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970449:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970454:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970539:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970546:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970552:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065183.970559:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065183.970626:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970632:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970641:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970646:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdba00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065183.970649:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970654:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970663:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065183.970665:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065183.970668:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970673:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970685:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970690:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970694:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970697:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdb800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065183.970699:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970703:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970711:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012cf55800) 00010000:00010000:1.0:1746065183.970713:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065183.970715:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970719:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc287 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065183.970750:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdbc00/0x14b4f8542d4fc279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 262 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.970760:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 261 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065183.970765:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065183.970767:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065183.970768:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdb600, rc 0) 00000100:00100000:1.0:1746065183.970786:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31624:x1830881262943744:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 483us (1449us total) trans 8589944112 rc 0/0 00000100:00100000:1.0:1746065183.970791:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9902 00000100:00100000:0.0:1746065183.976902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065183.977894:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262943488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8335us (8496us total) trans 0 rc 819200/819200 00000100:00100000:0.0:1746065183.977903:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8053 00002000:00100000:0.0:1746065183.977911:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb13480 x1830881262943488/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:99/0 lens 488/440 e 0 to 0 dl 1746065194 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065183.977920:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13480 with x1830881262943488 ext(4194304->5013503) 00002000:00010000:0.0:1746065183.977924:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13480 00000100:00100000:3.0:1746065183.978353:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4216 00000100:00100000:3.0:1746065183.978363:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31619:x1830881262944000:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065183.978535:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:31619:x1830881262944000:12345-192.168.202.46@tcp:35:cat.0 Request processed in 174us (1640us total) trans 8589944113 rc 0/0 00000100:00100000:3.0:1746065183.978541:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4216 00000100:00100000:0.0:1746065183.985611:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065183.987214:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4217 00000100:00100000:3.0:1746065183.987228:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:31617:x1830881262944256:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065183.987424:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:31617:x1830881262944256:12345-192.168.202.46@tcp:35:cat.0 Request processed in 200us (1818us total) trans 8589944114 rc 0/0 00000100:00100000:3.0:1746065183.987433:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4217 00000100:00100000:0.0:1746065184.056278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.056348:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262944512 00000100:00100000:3.0:1746065184.056355:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262944512 00000100:00100000:3.0:1746065184.056401:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9903 00000100:00100000:3.0:1746065184.056408:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+21:31628:x1830881262944512:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065184.056428:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.056441:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc29c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60448 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.056518:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056528:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056536:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056546:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056551:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056555:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056641:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc2b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056648:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056654:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065184.056661:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065184.056723:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056729:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056734:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056739:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f73d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.056743:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056748:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056755:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065184.056758:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.056761:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056765:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056789:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056802:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056840:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056844:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f73da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.056847:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056851:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056857:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205800) 00010000:00010000:3.0:1746065184.056859:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.056861:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056866:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.056895:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc29c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60448 expref: 24 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.056904:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc2b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60448 expref: 23 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.056910:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.056912:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065184.056914:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73dc00, rc 0) 00000100:00100000:3.0:1746065184.057147:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+23:31628:x1830881262944512:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 737us (874us total) trans 8589944115 rc 0/0 00000100:00100000:3.0:1746065184.057153:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9903 00000100:00100000:0.0:1746065184.059885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:1.0:1746065184.060465:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065184.080563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.083254:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262944768 00000100:00100000:3.0:1746065184.083264:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262944768 00000100:00100000:3.0:1746065184.083320:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 739 00000100:00100000:3.0:1746065184.083326:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881262944768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.083337:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.083357:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc2b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60448 expref: 23 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.083381:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.083385:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.083438:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881262944768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 112us (2884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.083444:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 739 00000100:00100000:3.0:1746065184.087349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.087396:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260317696:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.087405:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260317824:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.087411:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260317952:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.087436:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [143360->864255] (req 143360->864255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 31 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.087451:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c877000, rc 0) 00000100:00100000:3.0:1746065184.087493:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31624:x1830881262944640:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 27431us (27613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.087500:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14363 00000100:00100000:1.0:1746065184.087573:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262944896 00000100:00100000:1.0:1746065184.087579:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262944896 00010000:00010000:1.0:1746065184.087599:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fbf31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60265 expref: 7 pid: 25185 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065184.087625:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7309 00000100:00100000:1.0:1746065184.087630:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881262944896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.087643:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.087659:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fbf31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60265 expref: 7 pid: 25185 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.087667:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fbf31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60265 expref: 7 pid: 25185 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.087684:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c29e800/0x14b4f8542d4fbf31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60265 expref: 7 pid: 25185 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.087697:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.087711:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881262944896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.087716:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7309 00000100:00100000:0.0:1746065184.088683:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.088715:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.088769:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262945024 00000100:00100000:1.0:1746065184.088773:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262945024 00010000:00010000:1.0:1746065184.088787:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f08c400/0x14b4f8542d4fbe9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601f5 expref: 21 pid: 25185 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065184.088833:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262945152 00000100:00100000:1.0:1746065184.088835:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262945152 00010000:00010000:1.0:1746065184.088845:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9400/0x14b4f8542d4fbec1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60226 expref: 31 pid: 2462 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065184.088871:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7310 00000100:00100000:1.0:1746065184.088877:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881262945024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.088884:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.088896:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f08c400/0x14b4f8542d4fbe9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601f5 expref: 21 pid: 25185 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.088905:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f08c400/0x14b4f8542d4fbe9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601f5 expref: 21 pid: 25185 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.088919:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f08c400/0x14b4f8542d4fbe9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e601f5 expref: 21 pid: 25185 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.088929:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.088947:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:1958:x1830881262945024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.088952:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7310 00000100:00100000:1.0:1746065184.088962:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7311 00000100:00100000:1.0:1746065184.088967:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262945152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.088974:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.088980:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9400/0x14b4f8542d4fbec1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60226 expref: 31 pid: 2462 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.088989:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9400/0x14b4f8542d4fbec1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60226 expref: 31 pid: 2462 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.089000:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9400/0x14b4f8542d4fbec1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60226 expref: 31 pid: 2462 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.089007:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.089009:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.089015:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.089022:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.089045:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065184.089233:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260318080:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065184.089543:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065184.090952:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260318080:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065184.090967:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.091235:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881262945152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2265us (2517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.091244:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7311 00000100:00100000:0.0:1746065184.091595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.099603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.099842:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262945664 00000100:00100000:3.0:1746065184.099850:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262945664 00002000:00100000:3.0:1746065184.099888:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (860160->864255) req@ffff880095350a80 x1830881262945664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.099897:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350a80 with x1830881262945664 ext(860160->864255) 00002000:00010000:3.0:1746065184.099902:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350a80 00000100:00100000:3.0:1746065184.099919:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8055 00000100:00100000:3.0:1746065184.099926:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881262945664:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065184.100063:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881262945664:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 136us (466us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.100069:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8055 00002000:00100000:3.0:1746065184.100075:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (860160->864255) req@ffff880095350a80 x1830881262945664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.100082:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350a80 with x1830881262945664 ext(860160->864255) 00002000:00010000:3.0:1746065184.100084:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095350a80 00000100:00100000:0.0:1746065184.105318:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.120246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.120308:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262946176 00000100:00100000:3.0:1746065184.120315:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262946176 00000100:00100000:3.0:1746065184.120369:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9904 00000100:00100000:3.0:1746065184.120377:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+22:31633:x1830881262946176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.120396:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.120410:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc2c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60456 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.120779:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.120790:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.120809:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065184.120848:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065184.121253:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc2c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 25 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.121301:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 24 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.121308:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.121311:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065184.121314:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73d600, rc 0) 00000100:00100000:3.0:1746065184.122548:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:31633:x1830881262946176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2169us (2305us total) trans 8589944117 rc 0/0 00000100:00100000:3.0:1746065184.122556:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9904 00000100:00100000:0.0:1746065184.122725:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.122839:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262946304 00000100:00100000:3.0:1746065184.122845:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262946304 00000100:00100000:3.0:1746065184.122873:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9905 00000100:00100000:3.0:1746065184.122880:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31632:x1830881262946304:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065184.122895:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.122908:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6045d expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.122954:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.122965:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.122975:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.122988:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.122994:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.122999:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123102:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123111:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123117:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065184.123142:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065184.123147:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065184.123159:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123168:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123174:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123179:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123188:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123193:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f73d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.123196:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123201:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123211:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065184.123213:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.123217:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123221:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc2e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123231:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123235:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123239:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123243:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f73d400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.123245:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123250:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123258:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205500) 00010000:00010000:3.0:1746065184.123260:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.123263:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123267:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc2e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.123290:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc2db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6045d expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.123302:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6045d expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.123307:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.123308:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065184.123310:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73d000, rc 0) 00000100:00100000:3.0:1746065184.123349:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31632:x1830881262946304:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 468us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.123354:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9905 00000100:00100000:0.0:1746065184.127410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.127509:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262946432 00000100:00100000:3.0:1746065184.127517:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262946432 00000100:00100000:0.0:1746065184.128665:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262946560 00000100:00100000:0.0:1746065184.128670:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262946560 00000100:00100000:3.0:1746065184.128755:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262946816 00000100:00100000:3.0:1746065184.128759:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262946816 00000100:00100000:3.0:1746065184.128767:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262946944 00000100:00100000:3.0:1746065184.128770:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262946944 00000100:00100000:3.0:1746065184.128791:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14364 00000100:00100000:3.0:1746065184.128808:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262946432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.128835:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065184.129003:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14365 00000100:00100000:0.0:1746065184.129009:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881262946944:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065184.129017:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065184.129023:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471be00/0x14b4f8542d4fc2fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60480 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.129041:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065184.129042:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065184.129052:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471be00/0x14b4f8542d4fc2fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60480 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065184.129064:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471be00/0x14b4f8542d4fc2fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60480 expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065184.129073:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471be00, rc 0) 00010000:00010000:3.0:1746065184.129394:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73cc00/0x14b4f8542d4fc2f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60464 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.129425:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260318208:192.168.202.46@tcp:106: 00000100:00080000:1.0:1746065184.129608:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065184.129635:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14367 00000100:00100000:1.0:1746065184.129640:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881262946560:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065184.129646:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.129651:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc30c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6046b expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065184.129670:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260318336:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065184.129711:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262946944:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 701us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.129716:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14365 00000100:00100000:3.0:1746065184.129799:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.129848:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14368 00000100:00100000:3.0:1746065184.129853:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262946816:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065184.129858:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.129864:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fc313 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60479 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.129872:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.129873:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.129878:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fc313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60479 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.129886:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fc313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60479 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.129892:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c000, rc 0) 00000100:00100000:3.0:1746065184.129906:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262946816:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 53us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.129910:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14368 00000100:00100000:3.0:1746065184.129948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.129958:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262947072 00000100:00100000:3.0:1746065184.129961:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262947072 00000100:00100000:3.0:1746065184.129973:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14369 00000100:00100000:3.0:1746065184.129976:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262947072:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065184.129981:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.129987:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fc31a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60487 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.129995:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.129996:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.130000:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fc31a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60487 expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.130008:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fc31a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60487 expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.130014:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c800, rc 0) 00000100:00100000:3.0:1746065184.130028:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881262947072:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 51us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.130032:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14369 00000100:00100000:3.0:1746065184.130087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.130097:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262947200 00000100:00100000:3.0:1746065184.130100:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262947200 00000100:00100000:3.0:1746065184.130114:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14370 00000100:00100000:3.0:1746065184.130118:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881262947200:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065184.130123:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.130128:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6048e expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.130137:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.130138:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.130142:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.130150:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.130156:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73dc00, rc 0) 00000100:00100000:3.0:1746065184.130169:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881262947200:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 51us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.130173:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14370 00000100:00100000:1.0:1746065184.130469:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00002000:00010000:1.0:1746065184.132230:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime: 1746065180 -> 1746065185 00002000:00010000:1.0:1746065184.132237:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime: 1746065180 -> 1746065184 00002000:00010000:1.0:1746065184.132239:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime: 1746065180 -> 1746065185 00000100:00100000:1.0:1746065184.132263:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260318336:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065184.132292:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc30c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6046b expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.132304:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc30c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6046b expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.132321:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdbe00, rc 0) 00000100:00100000:1.0:1746065184.132384:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881262946560:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2741us (4114us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065184.132392:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14367 00000100:00100000:3.0:1746065184.132566:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260318208:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065184.132581:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73cc00/0x14b4f8542d4fc2f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60464 expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.132594:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73cc00/0x14b4f8542d4fc2f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60464 expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.132603:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73cc00, rc 0) 00000100:00100000:3.0:1746065184.132622:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262946432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3816us (5221us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065184.132626:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14364 00000100:00100000:0.0:1746065184.137766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.137846:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262947328 00000100:00100000:3.0:1746065184.137854:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262947328 00000100:00100000:3.0:1746065184.137904:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14371 00000100:00100000:3.0:1746065184.137911:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:31633:x1830881262947328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.137924:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.137939:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60495 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.137964:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.137970:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.137971:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.137974:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.137997:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.138008:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 29 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.138018:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260318464:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.138088:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.138346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.138915:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262947584 00000100:00100000:1.0:1746065184.138920:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262947584 00000100:00100000:1.0:1746065184.138954:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9906 00000100:00100000:1.0:1746065184.138960:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31632:x1830881262947584:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065184.138968:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.138979:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc32f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6049c expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139049:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.139060:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602b9 expref: 262 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139067:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b4600/0x14b4f8542d4fc01f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602dc expref: 23 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139074:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 262 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139080:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6045d expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139085:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.139102:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6045d expref: 10 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139108:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6045d expref: 10 pid: 14645 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.139115:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260318592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.139172:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 262 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139180:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 262 pid: 14644 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.139188:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260318720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.139211:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b4600/0x14b4f8542d4fc01f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602dc expref: 23 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139218:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b4600/0x14b4f8542d4fc01f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602dc expref: 23 pid: 14644 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.139225:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260318848:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.139244:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602b9 expref: 262 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.139251:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602b9 expref: 262 pid: 20754 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.139257:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260318976:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.139271:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.141032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.141050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.141068:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262947840 00000100:00100000:0.0:1746065184.141073:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262947840 00010000:00010000:0.0:1746065184.141097:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 263 pid: 14644 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.141132:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262947712 00000100:00100000:0.0:1746065184.141134:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262947712 00010000:00010000:0.0:1746065184.141143:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6045d expref: 11 pid: 14645 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.141152:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7312 00000100:00100000:0.0:1746065184.141157:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1958:x1830881262947840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.141168:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.141172:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 263 pid: 14644 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.141180:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 263 pid: 14644 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.141240:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260318464:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.141260:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.141270:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c400, rc 0) 00000100:00100000:3.0:1746065184.141286:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:31633:x1830881262947328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3376us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.141291:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14371 00010000:00010000:1.0:1746065184.141359:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc2f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6045d expref: 10 pid: 14645 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.141369:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260318592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.141376:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260318720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.141382:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b4600/0x14b4f8542d4fc01f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602dc expref: 24 pid: 14644 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.141389:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260318848:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065184.141485:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc28e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60441 expref: 263 pid: 14644 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.141507:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065184.141510:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065184.141515:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065184.141519:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.141547:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1958:x1830881262947840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 389us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.141553:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7312 00000100:00100000:0.0:1746065184.142575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.142627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.142637:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262948224 00000100:00100000:0.0:1746065184.142640:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262948224 00010000:00010000:0.0:1746065184.142650:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602b9 expref: 262 pid: 20754 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.142675:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7315 00000100:00100000:0.0:1746065184.142680:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1959:x1830881262948224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.142686:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.142690:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602b9 expref: 262 pid: 20754 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.142697:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602b9 expref: 262 pid: 20754 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.142709:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065184.142712:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065184.142718:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065184.142722:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065184.142733:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.142751:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1959:x1830881262948224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.142756:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7315 00010000:00010000:1.0:1746065184.142892:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fbfd2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602b9 expref: 261 pid: 20754 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.142902:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260318976:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.142920:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.142930:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.142935:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065184.142948:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065184.143053:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc32f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6049c expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.143062:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6049c expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.143067:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.143069:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065184.143071:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdb200, rc 0) 00000100:00100000:1.0:1746065184.143090:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31632:x1830881262947584:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 4131us (4745us total) trans 8589944118 rc 0/0 00000100:00100000:1.0:1746065184.143096:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9906 00000100:00100000:0.0:1746065184.145352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.146791:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262948480 00000100:00100000:1.0:1746065184.146808:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262948480 00000100:00100000:1.0:1746065184.147922:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9907 00000100:00100000:1.0:1746065184.147932:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31632:x1830881262948480:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065184.147951:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.147954:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065184.147976:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc336 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6049c expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.147992:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.147996:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065184.148004:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda200/0x14b4f8542d4fc344 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604a3 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.148075:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148084:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148091:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148099:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148103:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148107:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148111:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbda800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.148114:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148119:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148125:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.148127:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065184.148130:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148134:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc34b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.148150:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda200/0x14b4f8542d4fc344 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604a3 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.148156:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda200/0x14b4f8542d4fc344 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604a3 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.148161:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbda200, rc 0) 00000100:00100000:1.0:1746065184.148300:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31632:x1830881262948480:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 368us (2951us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065184.148306:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9907 00000100:00100000:3.0:1746065184.156695:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262948736 00000100:00100000:3.0:1746065184.156702:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262948736 00000100:00100000:3.0:1746065184.157062:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4219 00000100:00100000:3.0:1746065184.157071:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31632:x1830881262948736:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065184.161789:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31632:x1830881262948736:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 4719us (5610us total) trans 8589944119 rc 0/0 00000100:00100000:3.0:1746065184.161806:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4219 00000100:00100000:3.0:1746065184.165741:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262948864 00000100:00100000:3.0:1746065184.165750:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262948864 00010000:00010000:3.0:1746065184.165779:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 32 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.167941:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7316 00000100:00100000:1.0:1746065184.168004:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881262948864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.168022:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.168051:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 32 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.168064:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 32 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.168085:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c877000/0x14b4f8542d4fc2bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 143360->864255) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6044f expref: 32 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.168101:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.168104:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.168111:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.168118:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.168148:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065184.168158:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260319104:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065184.168240:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.174474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.174690:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260319104:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065184.174711:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.174752:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881262948864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6802us (10575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.174760:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7316 00000100:00100000:0.0:1746065184.208007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.208188:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262949248 00000100:00100000:3.0:1746065184.208195:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262949248 00000100:00100000:3.0:1746065184.208649:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14372 00000100:00100000:3.0:1746065184.208658:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:31628:x1830881262949248:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065184.208674:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.208690:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604aa expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.208714:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.208721:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fc31a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60487 expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.208727:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 30 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.208734:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.208739:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.208741:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.208744:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2961408->3145727] (req 2961408->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604aa expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.208770:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.208780:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 30 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.208791:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260319232:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.211602:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 30 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.211940:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 30 pid: 4544 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746065184.211954:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260319360:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065184.214563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.214649:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262949376 00000100:00100000:1.0:1746065184.214655:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262949376 00010000:00010000:1.0:1746065184.214679:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 31 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.215299:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7317 00000100:00100000:3.0:1746065184.215307:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262949376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.215321:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.215338:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 31 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.215348:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 31 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.215366:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6189a00/0x14b4f8542d4fc24f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2342912->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60417 expref: 31 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.215443:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.215481:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262949376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 175us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.215487:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7317 00000100:00100000:0.0:1746065184.223522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.223603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.223618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.223637:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262949760 00000100:00100000:0.0:1746065184.223644:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262949760 00010000:00010000:0.0:1746065184.223672:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fc31a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60487 expref: 8 pid: 2463 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746065184.223692:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262949888 00000100:00100000:0.0:1746065184.223694:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262949888 00010000:00010000:0.0:1746065184.223702:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 30 pid: 4544 timeout: 883 lvb_type: 1 00000100:00100000:0.0:1746065184.223715:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7318 00000100:00100000:0.0:1746065184.223720:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262949760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.223730:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.223746:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fc31a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60487 expref: 8 pid: 2463 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746065184.223754:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fc31a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60487 expref: 8 pid: 2463 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746065184.223773:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.223838:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262949760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.223844:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7318 00000100:00100000:0.0:1746065184.223861:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7319 00000100:00100000:0.0:1746065184.223866:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881262949888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.223873:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.223880:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 30 pid: 4544 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746065184.223888:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 30 pid: 4544 timeout: 883 lvb_type: 1 00010000:00010000:0.0:1746065184.223897:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.223910:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881262949888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 43us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.223914:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7319 00000100:00100000:0.0:1746065184.223961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.223972:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262950016 00000100:00100000:0.0:1746065184.223974:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262950016 00010000:00010000:0.0:1746065184.223984:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 23 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.223997:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7320 00000100:00100000:0.0:1746065184.224001:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881262950016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.224006:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.224013:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 23 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.224021:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 23 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.224031:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065184.224033:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065184.224038:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2961408->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604aa expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.224045:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2961408->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604aa expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.224069:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2961408->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604aa expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065184.224079:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260319744:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065184.224138:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065184.224307:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc26b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6043a expref: 29 pid: 4544 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746065184.224324:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260319360:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.224335:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262949632 00010000:00010000:3.0:1746065184.224336:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fc31a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60487 expref: 7 pid: 2463 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065184.224339:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262949632 00000100:00100000:3.0:1746065184.224344:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260319488:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.224352:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a59b8600/0x14b4f8542d4fc25d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6041e expref: 23 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.224362:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9908 00000100:00100000:3.0:1746065184.224365:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260319616:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.224366:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31638:x1830881262949632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065184.224382:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.224389:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604aa expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.224393:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604b1 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.224396:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73d200, rc 0) 00000100:00100000:3.0:1746065184.224419:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:31628:x1830881262949248:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 15763us (16420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.224425:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14372 00010000:00010000:1.0:1746065184.224478:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224487:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224495:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224505:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224510:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224515:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224598:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224604:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224610:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065184.224616:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065184.224678:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224683:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224689:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224694:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdac00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.224697:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224703:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224710:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065184.224712:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.224715:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224719:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224730:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224734:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224738:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224742:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdaa00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.224744:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224747:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224755:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669500) 00010000:00010000:1.0:1746065184.224757:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.224759:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224763:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc367 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065184.224789:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.224810:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 263 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.224835:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.224837:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065184.224839:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdb000, rc 0) 00000100:00100000:1.0:1746065184.224862:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:31638:x1830881262949632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 495us (1347us total) trans 8589944120 rc 0/0 00000100:00100000:1.0:1746065184.224867:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9908 00000100:00100000:1.0:1746065184.229010:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.229037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.229063:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262950144 00000100:00100000:3.0:1746065184.229070:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262950144 00000100:00100000:1.0:1746065184.229102:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.229105:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262950272 00000100:00100000:3.0:1746065184.229108:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262950272 00000100:00100000:3.0:1746065184.229120:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14373 00000100:00100000:3.0:1746065184.229126:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262950144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.229139:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.229152:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604b8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.229170:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.229172:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.229179:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.229192:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.229205:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73ce00, rc 0) 00000100:00100000:3.0:1746065184.229243:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262950144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 117us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.229676:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14374 00000100:00100000:1.0:1746065184.229683:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881262950272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065184.229689:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.229696:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc383 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604bf expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065184.229726:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260319872:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065184.229760:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.229859:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14373 00002000:00010000:1.0:1746065184.231331:0:2462:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime: 1746065184 -> 1746065185 00002000:00010000:1.0:1746065184.231336:0:2462:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065184 -> 1746065185 00002000:00010000:1.0:1746065184.231338:0:2462:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime: 1746065184 -> 1746065185 00000100:00100000:1.0:1746065184.231352:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260319872:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065184.231371:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc383 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604bf expref: 31 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.231380:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc383 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604bf expref: 31 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.231404:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdae00, rc 0) 00000100:00100000:1.0:1746065184.231435:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881262950272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1753us (2397us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065184.231441:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14374 00000100:00100000:0.0:1746065184.239138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.239175:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.239206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.239677:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262950656 00000100:00100000:1.0:1746065184.239685:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262950656 00000100:00100000:1.0:1746065184.239732:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14375 00000100:00100000:1.0:1746065184.239740:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+20:31628:x1830881262950656:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065184.239755:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.239768:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604c6 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.239808:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.240247:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.240255:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.240261:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.240263:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.240266:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->2912255] (req 2097152->2912255) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 21 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.240291:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.240301:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 21 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.240312:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260320000:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.240654:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.240662:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 8 pid: 2463 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065184.240671:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260320128:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.240693:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 28 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.240700:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 28 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.240707:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260320256:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.240720:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.240843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.240881:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262951424 00000100:00100000:0.0:1746065184.240884:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262951424 00000100:00100000:0.0:1746065184.240905:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9909 00000100:00100000:0.0:1746065184.240911:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:31640:x1830881262951424:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065184.240924:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065184.240934:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a200/0x14b4f8542d4fc391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604cd expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.241000:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.241010:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.241016:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.241030:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.241037:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 264 pid: 14644 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.241044:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260320384:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065184.241075:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.241523:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8058 00000100:00100000:3.0:1746065184.241531:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262950912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065184.244592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.244621:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260320000:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.244631:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260320128:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.245904:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262951552 00000100:00100000:3.0:1746065184.245912:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262951552 00010000:00010000:3.0:1746065184.245946:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 9 pid: 2463 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746065184.245975:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7321 00000100:00100000:3.0:1746065184.245982:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881262951552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.245992:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.246013:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 9 pid: 2463 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.246023:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 9 pid: 2463 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.246041:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc321 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6048e expref: 9 pid: 2463 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.246072:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.246107:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262951552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 126us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.246113:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7321 00000100:00100000:1.0:1746065184.251047:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260320256:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.251076:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->2912255] (req 2097152->2912255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 21 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.251091:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdbe00, rc 0) 00000100:00100000:1.0:1746065184.251122:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+21:31628:x1830881262950656:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11383us (11992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.251129:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14375 00000100:00100000:0.0:1746065184.251494:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262951680 00000100:00100000:0.0:1746065184.251501:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262951680 00010000:00010000:0.0:1746065184.251521:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 21 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.251538:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262951808 00000100:00100000:0.0:1746065184.251539:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262951808 00010000:00010000:0.0:1746065184.251558:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 29 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.251573:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262951936 00000100:00100000:0.0:1746065184.251575:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262951936 00010000:00010000:0.0:1746065184.251584:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 265 pid: 14644 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.251595:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7322 00000100:00100000:0.0:1746065184.251600:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881262951680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.251610:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.251626:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 21 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.251635:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 21 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.251651:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed88000/0x14b4f8542d4fc264 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6042c expref: 21 pid: 25185 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.251662:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.251678:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881262951680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.251683:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7322 00000100:00100000:0.0:1746065184.251696:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7323 00000100:00100000:0.0:1746065184.251700:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881262951808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.251705:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.251711:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 29 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.251718:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 29 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.251728:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6189c00/0x14b4f8542d4fc256 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60425 expref: 29 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.251735:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065184.251736:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065184.251741:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 19 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.251749:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 19 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.251769:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 19 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065184.251778:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260320512:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065184.251847:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7324 00000100:00100000:0.0:1746065184.251852:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1961:x1830881262951936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.251858:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.251863:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 265 pid: 14644 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.251875:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 265 pid: 14644 timeout: 883 lvb_type: 0 00010000:00010000:0.0:1746065184.251886:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065184.251890:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.251896:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.251901:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.251908:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.251919:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1961:x1830881262951936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.251923:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7324 00000100:00100000:0.0:1746065184.251949:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00010000:00010000:0.0:1746065184.251965:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb000/0x14b4f8542d4fc36e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b1 expref: 264 pid: 14644 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.251974:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260320384:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065184.251983:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.251989:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.251994:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065184.252008:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065184.252107:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a200/0x14b4f8542d4fc391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 265 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.252116:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 264 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.252122:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065184.252124:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065184.252126:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471a000, rc 0) 00000100:00100000:0.0:1746065184.252140:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:31640:x1830881262951424:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11230us (11299us total) trans 8589944121 rc 0/0 00000100:00100000:0.0:1746065184.252145:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9909 00000100:00080000:1.0:1746065184.252212:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065184.258023:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881262950912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16486us (18839us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065184.258033:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8058 00002000:00100000:3.0:1746065184.258042:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f2c5c00 x1830881262950912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.258050:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5c00 with x1830881262950912 ext(0->1048575) 00002000:00010000:3.0:1746065184.258054:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c5c00 00000100:00100000:1.0:1746065184.259646:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260320512:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065184.259661:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.259686:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881262951808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7985us (9257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.259694:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7323 00000100:00100000:0.0:1746065184.269753:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.269846:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.270246:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262952064 00000100:00100000:1.0:1746065184.270250:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262952064 00000100:00100000:1.0:1746065184.270272:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14376 00000100:00100000:1.0:1746065184.270277:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31640:x1830881262952064:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065184.270285:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.270297:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc3a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604d4 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.270317:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 19 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.270323:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065184.270325:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065184.270327:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc3a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3178496->3387391] (req 3178496->3387391) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604d4 expref: 29 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.270351:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 19 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.270361:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 19 pid: 2462 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.270372:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260320640:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.270431:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.272431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.276139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.276506:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260320640:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.276527:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc3a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3178496->3387391] (req 3178496->3387391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604d4 expref: 31 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.276538:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdb200, rc 0) 00000100:00100000:1.0:1746065184.276557:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31640:x1830881262952064:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6280us (6814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.276563:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14376 00000100:00100000:0.0:1746065184.277452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.277515:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262953088 00000100:00100000:3.0:1746065184.277519:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262953088 00000100:00100000:3.0:1746065184.277548:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4220 00000100:00100000:3.0:1746065184.277553:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090021850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+23:31628:x1830881262953088:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065184.277730:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090021850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:31628:x1830881262953088:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 176us (280us total) trans 8589944122 rc 0/0 00000100:00100000:3.0:1746065184.277736:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4220 00000100:00100000:3.0:1746065184.278363:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262952960 00000100:00100000:3.0:1746065184.278367:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262952960 00002000:00100000:3.0:1746065184.278389:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2912255) req@ffff88009f468700 x1830881262952960/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.278397:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468700 with x1830881262952960 ext(2097152->2912255) 00010000:00010000:3.0:1746065184.278403:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 20 pid: 2462 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.278412:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 20 pid: 2462 timeout: 883 lvb_type: 0 00002000:00010000:3.0:1746065184.278417:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f468700 00000100:00100000:3.0:1746065184.278439:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2455 00000100:00100000:3.0:1746065184.278445:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881262952960:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065184.279347:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260320896:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065184.279372:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3b4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604db expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.279382:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604db expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.279389:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7d7600, rc 0) 00000100:00100000:3.0:1746065184.279415:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881262952448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3098us (3279us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065184.279421:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14378 00000100:00100000:0.0:1746065184.294203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.296617:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262953216 00000100:00100000:3.0:1746065184.296623:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262953216 00000100:00100000:3.0:1746065184.296661:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14379 00000100:00100000:3.0:1746065184.296668:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31638:x1830881262953216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.296680:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.296691:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73c600/0x14b4f8542d4fc3bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604e9 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.296710:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604aa expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.296720:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.296721:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.296724:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c600/0x14b4f8542d4fc3bb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604e9 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.296744:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604aa expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.296752:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2961408->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604aa expref: 20 pid: 8851 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.296760:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260321024:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.296832:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.301005:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260321024:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.301030:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c600/0x14b4f8542d4fc3bb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604e9 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.301043:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c600, rc 0) 00000100:00100000:3.0:1746065184.301074:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31638:x1830881262953216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4406us (6877us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.301081:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14379 00000100:00100000:0.0:1746065184.301650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.301693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.302378:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262953472 00000100:00100000:1.0:1746065184.302384:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262953472 00010000:00010000:1.0:1746065184.302409:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 22 pid: 2462 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.302441:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7325 00000100:00100000:1.0:1746065184.302448:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881262953472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.302457:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.302475:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 22 pid: 2462 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.302484:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 22 pid: 2462 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.302503:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbdbe00/0x14b4f8542d4fc38a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2912255) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604c6 expref: 22 pid: 2462 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.302516:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.302519:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.302525:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc3a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3387391) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604d4 expref: 28 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.302532:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc3a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3387391) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604d4 expref: 28 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.302556:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc3a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3387391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604d4 expref: 28 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065184.302565:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260321152:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065184.302619:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.308363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.308426:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262953856 00000100:00100000:3.0:1746065184.308433:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262953856 00002000:00100000:3.0:1746065184.308457:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3178496->3182591) req@ffff880134d86d80 x1830881262953856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.308470:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86d80 with x1830881262953856 ext(3178496->3182591) 00002000:00010000:3.0:1746065184.308473:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86d80 00000100:00100000:3.0:1746065184.308485:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8061 00000100:00100000:3.0:1746065184.308490:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262953856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065184.308577:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262953856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 87us (215us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.308582:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8061 00002000:00100000:3.0:1746065184.308587:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3178496->3182591) req@ffff880134d86d80 x1830881262953856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.308593:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134d86d80 with x1830881262953856 ext(3178496->3182591) 00002000:00010000:3.0:1746065184.308596:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134d86d80 00000100:00100000:0.0:1746065184.310745:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.314565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.315257:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262954240 00000100:00100000:3.0:1746065184.315263:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262954240 00002000:00100000:3.0:1746065184.315291:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3383296->3387391) req@ffff88012d7fce00 x1830881262954240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.315299:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fce00 with x1830881262954240 ext(3383296->3387391) 00002000:00010000:3.0:1746065184.315303:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fce00 00000100:00100000:3.0:1746065184.315318:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8062 00000100:00100000:3.0:1746065184.315324:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262954240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065184.315877:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262954240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 552us (1316us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.315883:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8062 00002000:00100000:3.0:1746065184.315889:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3383296->3387391) req@ffff88012d7fce00 x1830881262954240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.315896:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fce00 with x1830881262954240 ext(3383296->3387391) 00002000:00010000:3.0:1746065184.315898:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fce00 00000100:00100000:0.0:1746065184.323140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.323715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.323748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.324173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.324265:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262954496 00000100:00100000:3.0:1746065184.324273:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262954496 00002000:00100000:3.0:1746065184.324317:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012d7fc380 x1830881262954496/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.324326:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc380 with x1830881262954496 ext(2097152->3145727) 00002000:00010000:3.0:1746065184.324330:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fc380 00000100:00100000:1.0:1746065184.324401:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262955136 00000100:00100000:1.0:1746065184.324405:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262955136 00002000:00100000:1.0:1746065184.324422:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45f800 x1830881262955136/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 504/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.324428:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f800 with x1830881262955136 ext(3145728->4194303) 00002000:00010000:1.0:1746065184.324431:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45f800 00000100:00100000:3.0:1746065184.324544:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262955008 00000100:00100000:3.0:1746065184.324547:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262955008 00002000:00100000:3.0:1746065184.324559:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012b45d500 x1830881262955008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.324565:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d500 with x1830881262955008 ext(2097152->3145727) 00002000:00010000:3.0:1746065184.324567:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45d500 00000100:00100000:0.0:1746065184.324963:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8064 00000100:00100000:0.0:1746065184.324970:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881262954496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065184.325302:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8065 00000100:00100000:1.0:1746065184.325308:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881262955136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065184.340918:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262954496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15938us (17776us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065184.340929:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8064 00002000:00100000:0.0:1746065184.340939:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012d7fc380 x1830881262954496/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065184.340948:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc380 with x1830881262954496 ext(2097152->3145727) 00002000:00010000:0.0:1746065184.340953:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fc380 00000100:00100000:0.0:1746065184.347365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.349899:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881262954624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25096us (26174us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065184.349910:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8063 00002000:00100000:3.0:1746065184.349922:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012d7ff800 x1830881262954624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.349931:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff800 with x1830881262954624 ext(3145728->4194303) 00002000:00010000:3.0:1746065184.349936:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7ff800 00000100:00100000:1.0:1746065184.351071:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262955520 00000100:00100000:1.0:1746065184.351083:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262955520 00000100:00100000:1.0:1746065184.351128:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9910 00000100:00100000:1.0:1746065184.351134:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:31645:x1830881262955520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065184.351151:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.351165:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a400/0x14b4f8542d4fc3c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e604f0 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.351259:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351269:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351278:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351289:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351294:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351298:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351386:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351394:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351400:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065184.351407:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065184.351476:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351482:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351491:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351495:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a38a200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.351498:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351504:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351513:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065184.351515:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.351519:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351523:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a200/0x14b4f8542d4fc3c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351547:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351552:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351556:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351560:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a38a000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.351562:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351566:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351575:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669500) 00010000:00010000:1.0:1746065184.351577:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.351580:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351584:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a000/0x14b4f8542d4fc3d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.351614:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38a400/0x14b4f8542d4fc3c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 27 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.351624:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 26 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.351630:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.351631:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065184.351633:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38be00, rc 0) 00000100:00100000:1.0:1746065184.351679:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+26:31645:x1830881262955520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 544us (4321us total) trans 8589944123 rc 0/0 00000100:00100000:1.0:1746065184.351685:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9910 00000100:00100000:0.0:1746065184.354907:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.355066:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262955776 00000100:00100000:1.0:1746065184.355072:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262955776 00000100:00100000:1.0:1746065184.355103:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4221 00000100:00100000:1.0:1746065184.355109:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:31645:x1830881262955776:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065184.355244:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:31645:x1830881262955776:12345-192.168.202.46@tcp:35:cat.0 Request processed in 135us (337us total) trans 8589944124 rc 0/0 00000100:00100000:1.0:1746065184.355250:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4221 00000100:00100000:0.0:1746065184.362081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.362129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.364394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.365166:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260321408:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065184.365193:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7e00/0x14b4f8542d4fc3ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604fe expref: 22 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065184.365204:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7e00/0x14b4f8542d4fc3ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604fe expref: 22 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065184.365227:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7d7e00, rc 0) 00000100:00100000:0.0:1746065184.365438:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881262956032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2999us (3307us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065184.365443:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14381 00000100:00100000:0.0:1746065184.379036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.383643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.396052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.403518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.416180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.419505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.421143:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260321664:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065184.421159:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.421198:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262957184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3227us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.421206:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7327 00000100:00100000:0.0:1746065184.428268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.428360:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262957568 00000100:00100000:3.0:1746065184.428367:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262957568 00000100:00100000:3.0:1746065184.428407:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 740 00000100:00100000:3.0:1746065184.428413:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:1959:x1830881262957568:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.428424:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.428443:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d6e00/0x14b4f8542d4fc40f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6050c expref: 29 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.428507:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.428511:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.428546:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881262957568:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 132us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.428552:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 740 00000100:00100000:0.0:1746065184.434906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.434938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.434966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.434989:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262957824 00000100:00100000:0.0:1746065184.434997:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262957824 00002000:00100000:0.0:1746065184.435033:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009bee2a00 x1830881262957824/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065184.435042:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2a00 with x1830881262957824 ext(2097152->3145727) 00002000:00010000:0.0:1746065184.435046:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee2a00 00000100:00100000:0.0:1746065184.435073:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262958336 00000100:00100000:0.0:1746065184.435076:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262958336 00002000:00100000:0.0:1746065184.435085:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009bee0380 x1830881262958336/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065184.435091:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0380 with x1830881262958336 ext(3145728->4194303) 00002000:00010000:0.0:1746065184.435093:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee0380 00000100:00100000:0.0:1746065184.435100:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262958080 00000100:00100000:0.0:1746065184.435102:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262958080 00002000:00100000:0.0:1746065184.435107:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009bee1500 x1830881262958080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065184.435112:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1500 with x1830881262958080 ext(3145728->4194303) 00002000:00010000:0.0:1746065184.435114:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee1500 00000100:00100000:0.0:1746065184.435123:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8069 00000100:00100000:0.0:1746065184.435129:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881262957824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065184.436230:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8070 00000100:00100000:0.0:1746065184.436238:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262958336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065184.437289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.437859:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8071 00000100:00100000:1.0:1746065184.437870:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262958080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065184.448511:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262957824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13373us (13606us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065184.448521:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8069 00002000:00100000:1.0:1746065184.448530:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009bee2a00 x1830881262957824/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.448539:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2a00 with x1830881262957824 ext(2097152->3145727) 00002000:00010000:1.0:1746065184.448543:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee2a00 00000100:00100000:0.0:1746065184.460253:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.460393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.463343:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262958976 00000100:00100000:3.0:1746065184.463349:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262958976 00002000:00100000:3.0:1746065184.463375:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fc5b480 x1830881262958976/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.463383:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b480 with x1830881262958976 ext(4194304->5013503) 00002000:00010000:3.0:1746065184.463387:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5b480 00000100:00100000:3.0:1746065184.463412:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8072 00000100:00100000:3.0:1746065184.463417:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262958976:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065184.465693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.466085:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262958080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28217us (31116us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065184.466094:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8071 00002000:00100000:1.0:1746065184.466103:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009bee1500 x1830881262958080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.466112:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1500 with x1830881262958080 ext(3145728->4194303) 00002000:00010000:1.0:1746065184.466116:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee1500 00000100:00100000:0.0:1746065184.470393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.470421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.470474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.470525:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262959616 00000100:00100000:3.0:1746065184.470533:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262959616 00010000:00010000:3.0:1746065184.470563:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c730e00/0x14b4f8542d4fc13e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60392 expref: 30 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.470588:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262959360 00000100:00100000:3.0:1746065184.470590:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262959360 00010000:00010000:3.0:1746065184.470597:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fc313 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60479 expref: 8 pid: 2463 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746065184.470607:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262959488 00000100:00100000:3.0:1746065184.470608:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262959488 00010000:00010000:3.0:1746065184.470614:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 23 pid: 8429 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.470624:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7328 00000100:00100000:3.0:1746065184.470629:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881262959616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.470641:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.470659:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c730e00/0x14b4f8542d4fc13e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60392 expref: 30 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.470669:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c730e00/0x14b4f8542d4fc13e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60392 expref: 30 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.470687:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c730e00/0x14b4f8542d4fc13e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60392 expref: 30 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.470703:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.470734:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881262959616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 105us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.470740:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7328 00000100:00100000:3.0:1746065184.470752:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7329 00000100:00100000:3.0:1746065184.470756:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881262959360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.470761:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.470767:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fc313 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60479 expref: 8 pid: 2463 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.470774:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fc313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60479 expref: 8 pid: 2463 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.470785:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fc313 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60479 expref: 8 pid: 2463 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.470801:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.470838:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881262959360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 58us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.470844:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7329 00000100:00100000:3.0:1746065184.470853:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7330 00000100:00100000:3.0:1746065184.470858:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881262959488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.470864:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.470871:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 23 pid: 8429 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.470879:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 23 pid: 8429 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.470893:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c67600/0x14b4f8542d4fc130 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60384 expref: 23 pid: 8429 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.470902:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.470904:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.470910:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7e00/0x14b4f8542d4fc440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6051a expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.470919:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7e00/0x14b4f8542d4fc440 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6051a expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.470948:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7e00/0x14b4f8542d4fc440 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6051a expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.470958:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260322176:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065184.471011:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.471978:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262958976:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8558us (11582us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065184.471987:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8072 00002000:00100000:3.0:1746065184.471994:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fc5b480 x1830881262958976/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 819200/819200 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.472002:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b480 with x1830881262958976 ext(4194304->5013503) 00002000:00010000:3.0:1746065184.472005:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5b480 00000100:00100000:0.0:1746065184.473890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.474668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.474732:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262959744 00000100:00100000:3.0:1746065184.474739:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262959744 00000100:00100000:3.0:1746065184.474769:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262959872 00000100:00100000:3.0:1746065184.474770:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262959872 00000100:00100000:3.0:1746065184.474782:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14384 00000100:00100000:3.0:1746065184.474787:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31650:x1830881262959744:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065184.474809:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.474833:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60521 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065184.474979:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14385 00000100:00100000:0.0:1746065184.474984:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262959872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065184.474991:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065184.474998:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cc4da00/0x14b4f8542d4fc44e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60528 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065184.475036:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260322304:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065184.475087:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065184.475273:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.475280:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 32 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.475285:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.475287:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.475289:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [770048->917503] (req 770048->917503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.475305:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 32 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.475313:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 32 pid: 8851 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746065184.475321:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260322432:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.475347:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.475355:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 22 pid: 8851 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.475361:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260322560:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.475371:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.476724:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260322176:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065184.476739:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.476761:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881262959488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5903us (6286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.476768:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7330 00000100:00100000:1.0:1746065184.479122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.479259:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262960128 00000100:00100000:3.0:1746065184.479267:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262960128 00002000:00100000:3.0:1746065184.479301:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1212416->1216511) req@ffff88009f9cc380 x1830881262960128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.479311:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc380 with x1830881262960128 ext(1212416->1216511) 00002000:00010000:3.0:1746065184.479316:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cc380 00000100:00100000:3.0:1746065184.479330:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8073 00000100:00100000:3.0:1746065184.479335:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262960128:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065184.479952:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262960128:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 615us (835us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.479959:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8073 00002000:00100000:3.0:1746065184.479964:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1212416->1216511) req@ffff88009f9cc380 x1830881262960128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.479978:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc380 with x1830881262960128 ext(1212416->1216511) 00002000:00010000:3.0:1746065184.479980:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cc380 00000100:00100000:0.0:1746065184.484697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.484764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.485200:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260322432:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.485214:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260322560:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.485235:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [770048->917503] (req 770048->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.485249:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73ca00, rc 0) 00000100:00100000:3.0:1746065184.485264:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31650:x1830881262959744:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10477us (11378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.485269:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14384 00000100:00100000:1.0:1746065184.485315:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262960256 00000100:00100000:1.0:1746065184.485320:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262960256 00010000:00010000:1.0:1746065184.485341:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 23 pid: 8851 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.485356:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262960384 00000100:00100000:1.0:1746065184.485358:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262960384 00010000:00010000:1.0:1746065184.485365:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 32 pid: 8851 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065184.485375:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7331 00000100:00100000:1.0:1746065184.485379:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881262960256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.485388:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.485400:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 23 pid: 8851 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.485408:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 23 pid: 8851 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.485422:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc328 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60495 expref: 23 pid: 8851 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.485431:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.485445:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:1959:x1830881262960256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.485450:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7331 00000100:00100000:1.0:1746065184.485462:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7332 00000100:00100000:1.0:1746065184.485466:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881262960384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.485472:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.485478:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 32 pid: 8851 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.485487:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 32 pid: 8851 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.485499:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc37c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604b8 expref: 32 pid: 8851 timeout: 883 lvb_type: 1 00010000:00010000:1.0:1746065184.485506:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.485508:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.485513:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.485520:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.485544:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065184.485554:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260322688:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065184.485592:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.489325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.489425:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260322688:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065184.489443:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.489479:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262960384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4011us (4714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.489488:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7332 00000100:00100000:3.0:1746065184.489734:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262960640 00000100:00100000:3.0:1746065184.489740:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262960640 00002000:00100000:3.0:1746065184.489770:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (770048->774143) req@ffff88008fd06d80 x1830881262960640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.489780:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06d80 with x1830881262960640 ext(770048->774143) 00002000:00010000:3.0:1746065184.489784:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd06d80 00000100:00100000:3.0:1746065184.489810:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8074 00000100:00100000:3.0:1746065184.489833:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262960640:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065184.489954:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262960640:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 138us (636us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.489960:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8074 00002000:00100000:3.0:1746065184.489965:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (770048->774143) req@ffff88008fd06d80 x1830881262960640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.489972:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06d80 with x1830881262960640 ext(770048->774143) 00002000:00010000:3.0:1746065184.489975:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd06d80 00000100:00100000:0.0:1746065184.490105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.490298:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262960896 00000100:00100000:1.0:1746065184.490302:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262960896 00002000:00100000:1.0:1746065184.490318:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1589248->1593343) req@ffff88008fd06a00 x1830881262960896/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.490330:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06a00 with x1830881262960896 ext(1589248->1593343) 00002000:00010000:1.0:1746065184.490334:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd06a00 00000100:00100000:1.0:1746065184.490356:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8075 00000100:00100000:1.0:1746065184.490362:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881262960896:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065184.494218:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881262960896:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 3845us (4102us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065184.494228:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8075 00002000:00100000:1.0:1746065184.494240:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1589248->1593343) req@ffff88008fd06a00 x1830881262960896/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.494248:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06a00 with x1830881262960896 ext(1589248->1593343) 00002000:00010000:1.0:1746065184.494253:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd06a00 00000100:00100000:0.0:1746065184.494340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.494460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.494496:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262961280 00000100:00100000:1.0:1746065184.494503:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262961280 00002000:00100000:1.0:1746065184.494530:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (913408->917503) req@ffff88008fd07480 x1830881262961280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.494537:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07480 with x1830881262961280 ext(913408->917503) 00002000:00010000:1.0:1746065184.494541:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd07480 00000100:00100000:1.0:1746065184.494554:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8076 00000100:00100000:1.0:1746065184.494560:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881262961280:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065184.494709:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881262961280:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 149us (248us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065184.494715:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8076 00002000:00100000:1.0:1746065184.494721:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (913408->917503) req@ffff88008fd07480 x1830881262961280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065184.494724:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262961024 00000100:00100000:3.0:1746065184.494727:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262961024 00002000:00100000:1.0:1746065184.494728:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07480 with x1830881262961280 ext(913408->917503) 00002000:00010000:1.0:1746065184.494730:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd07480 00000100:00100000:3.0:1746065184.495167:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14386 00000100:00100000:3.0:1746065184.495174:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881262961024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.495182:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.495194:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc455 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6052f expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.495233:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260322816:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065184.495298:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00002000:00010000:3.0:1746065184.496435:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime: 1746065184 -> 1746065185 00000100:00100000:3.0:1746065184.496454:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260322816:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065184.496477:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc455 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6052f expref: 23 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.496488:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73d800/0x14b4f8542d4fc455 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6052f expref: 23 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.496546:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73d800, rc 0) 00000100:00100000:3.0:1746065184.496582:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881262961024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1408us (2242us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065184.496588:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14386 00000100:00100000:0.0:1746065184.499233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.499315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.499528:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262961664 00000100:00100000:3.0:1746065184.499536:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262961664 00000100:00100000:3.0:1746065184.499571:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14387 00000100:00100000:3.0:1746065184.499577:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881262961664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.499591:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.499604:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73cc00/0x14b4f8542d4fc45c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60536 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.499645:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260322944:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065184.499713:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.501119:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260322944:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065184.501141:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73cc00/0x14b4f8542d4fc45c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60536 expref: 23 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.501151:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73cc00/0x14b4f8542d4fc45c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60536 expref: 23 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.501218:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73cc00, rc 0) 00000100:00100000:3.0:1746065184.501321:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881262961664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1743us (2005us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065184.501327:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14387 00000100:00100000:0.0:1746065184.516066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.517726:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262961920 00000100:00100000:1.0:1746065184.517736:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262961920 00000100:00100000:1.0:1746065184.517800:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9913 00000100:00100000:1.0:1746065184.517807:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:31656:x1830881262961920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065184.517852:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.517866:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b400/0x14b4f8542d4fc463 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6053d expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.517950:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.517960:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.517967:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.517976:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.517980:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.517985:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518066:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc478 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518073:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc478 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518078:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc478 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065184.518085:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065184.518144:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518149:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518153:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518157:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a38b200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.518160:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518165:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518173:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065184.518175:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.518179:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518183:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b200/0x14b4f8542d4fc46a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518209:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518217:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518220:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518224:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a38b000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.518226:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518229:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518234:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669300) 00010000:00010000:1.0:1746065184.518236:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.518238:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518242:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b000/0x14b4f8542d4fc471 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.518271:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38b400/0x14b4f8542d4fc463 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6053d expref: 271 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.518281:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc478 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6053d expref: 270 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.518287:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.518289:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065184.518291:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38ae00, rc 0) 00000100:00100000:1.0:1746065184.518337:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:31656:x1830881262961920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 530us (2279us total) trans 8589944130 rc 0/0 00000100:00100000:1.0:1746065184.518343:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9913 00000100:00100000:0.0:1746065184.520567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.520642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.520777:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262962048 00000100:00100000:1.0:1746065184.520784:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262962048 00000100:00100000:3.0:1746065184.521067:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262962176 00000100:00100000:3.0:1746065184.521072:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262962176 00000100:00100000:3.0:1746065184.521097:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14388 00000100:00100000:3.0:1746065184.521103:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881262962176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.521116:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.521132:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f73d200/0x14b4f8542d4fc486 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60544 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.521176:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260323072:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065184.521230:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065184.521327:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 741 00000100:00100000:1.0:1746065184.521333:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:1959:x1830881262962048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.521342:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.521357:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc478 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6053d expref: 270 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.521368:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.521371:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.521391:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:1959:x1830881262962048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.521396:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 741 00000100:00100000:0.0:1746065184.521643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.521951:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262962304 00000100:00100000:3.0:1746065184.521954:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262962304 00000100:00100000:3.0:1746065184.522001:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14389 00000100:00100000:3.0:1746065184.522006:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262962304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.522013:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.522021:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6054b expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.522033:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.522034:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.522041:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 32 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.522052:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 32 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.522060:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73d800, rc 0) 00000100:00100000:3.0:1746065184.522078:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881262962304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.522083:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14389 00000100:00100000:3.0:1746065184.522714:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260323072:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065184.522733:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f73d200/0x14b4f8542d4fc486 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60544 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.522746:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f73d200/0x14b4f8542d4fc486 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60544 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.522800:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73d200, rc 0) 00000100:00100000:3.0:1746065184.523084:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881262962176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1979us (2440us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065184.523089:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14388 00000100:00100000:0.0:1746065184.529267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.529306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.529386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.529620:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262962816 00000100:00100000:3.0:1746065184.529624:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262962816 00000100:00100000:3.0:1746065184.529759:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 208 00000100:00100000:3.0:1746065184.529766:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262962816:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1746065184.529834:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881262962816:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 48us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.529840:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 208 00000100:00100000:0.0:1746065184.547226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.547256:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262962944 00000100:00100000:0.0:1746065184.547263:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262962944 00000100:00100000:0.0:1746065184.547301:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14390 00000100:00100000:0.0:1746065184.547308:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31656:x1830881262962944:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065184.547324:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065184.547340:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60552 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.547366:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7e00/0x14b4f8542d4fc440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6051a expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.547374:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065184.547375:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065184.547378:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.547410:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7e00/0x14b4f8542d4fc440 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1593343) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6051a expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.547420:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7e00/0x14b4f8542d4fc440 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1593343) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6051a expref: 21 pid: 25185 timeout: 883 lvb_type: 0 00000100:00100000:0.0:1746065184.547430:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260323200:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.547530:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.549456:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.549547:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260323200:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.549571:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.549583:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc4ce00, rc 0) 00000100:00100000:3.0:1746065184.549941:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31656:x1830881262962944:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2632us (2719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.549947:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14390 00000100:00100000:0.0:1746065184.559183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.568950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.591218:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.591263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.591697:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8080 00000100:00100000:1.0:1746065184.591703:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881262963712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065184.604377:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881262963712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12668us (13106us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065184.604386:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8080 00002000:00100000:1.0:1746065184.604395:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880130447b80 x1830881262963712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.605284:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447b80 with x1830881262963712 ext(2097152->3145727) 00002000:00010000:1.0:1746065184.605289:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130447b80 00000100:00100000:0.0:1746065184.621033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.621128:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262964224 00000100:00100000:3.0:1746065184.621138:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262964224 00000100:00100000:3.0:1746065184.621191:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4225 00000100:00100000:3.0:1746065184.621199:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:31656:x1830881262964224:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065184.621386:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:31656:x1830881262964224:12345-192.168.202.46@tcp:35:cat.0 Request processed in 188us (361us total) trans 8589944131 rc 0/0 00000100:00100000:3.0:1746065184.621392:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4225 00000100:00100000:0.0:1746065184.636967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.637049:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262964480 00000100:00100000:1.0:1746065184.637058:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262964480 00000100:00100000:1.0:1746065184.637147:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9914 00000100:00100000:1.0:1746065184.637154:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+270:31658:x1830881262964480:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065184.637173:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.637188:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6400/0x14b4f8542d4fc49b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60559 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.637276:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.637288:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.637297:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.637309:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.637314:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638528:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638639:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6a00/0x14b4f8542d4fc4b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638648:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6a00/0x14b4f8542d4fc4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638655:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6a00/0x14b4f8542d4fc4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065184.638666:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065184.638733:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638739:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638744:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638749:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942c6600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.638753:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638759:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638768:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065184.638771:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.638774:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638779:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6600/0x14b4f8542d4fc4a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638807:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638812:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638828:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638836:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942c6800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.638838:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638842:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638848:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669800) 00010000:00010000:1.0:1746065184.638849:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.638851:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638855:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6800/0x14b4f8542d4fc4a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.638887:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6400/0x14b4f8542d4fc49b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60559 expref: 273 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.638896:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6a00/0x14b4f8542d4fc4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60559 expref: 272 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.638902:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.638903:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065184.638905:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942c6a00, rc 0) 00000100:00100000:1.0:1746065184.640019:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:31658:x1830881262964480:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2860us (3055us total) trans 8589944132 rc 0/0 00000100:00100000:1.0:1746065184.640028:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9914 00000100:00100000:0.0:1746065184.644247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.644298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.644408:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262964736 00000100:00100000:1.0:1746065184.644415:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262964736 00000100:00100000:1.0:1746065184.644452:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9915 00000100:00100000:1.0:1746065184.644459:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+29:31660:x1830881262964736:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065184.644479:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.644492:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6c00/0x14b4f8542d4fc4be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60560 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.644576:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644586:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644594:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644604:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644609:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644614:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644698:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7200/0x14b4f8542d4fc4d3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644706:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7200/0x14b4f8542d4fc4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644711:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7200/0x14b4f8542d4fc4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065184.644719:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065184.644783:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644799:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644805:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644809:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942c6e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.644812:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644846:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644855:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065184.644857:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.644861:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644865:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6e00/0x14b4f8542d4fc4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644880:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644885:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644890:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644893:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942c7000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.644895:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644900:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644906:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669800) 00010000:00010000:1.0:1746065184.644907:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065184.644909:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644914:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7000/0x14b4f8542d4fc4cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.644942:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6c00/0x14b4f8542d4fc4be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60560 expref: 32 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.644952:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c7200/0x14b4f8542d4fc4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60560 expref: 31 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.644957:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.644959:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065184.644961:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942c7200, rc 0) 00000100:00100000:1.0:1746065184.644994:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+31:31660:x1830881262964736:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 536us (755us total) trans 8589944133 rc 0/0 00000100:00100000:1.0:1746065184.645000:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9915 00000100:00100000:3.0:1746065184.645364:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262964992 00000100:00100000:3.0:1746065184.645368:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262964992 00000100:00100000:3.0:1746065184.645391:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4226 00000100:00100000:3.0:1746065184.645397:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090020050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:31658:x1830881262964992:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065184.645482:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090020050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:31658:x1830881262964992:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 84us (1183us total) trans 8589944134 rc 0/0 00000100:00100000:3.0:1746065184.645487:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4226 00000100:00100000:3.0:1746065184.645977:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262965120 00000100:00100000:3.0:1746065184.645980:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262965120 00000100:00100000:3.0:1746065184.646005:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 742 00000100:00100000:3.0:1746065184.646009:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:1958:x1830881262965120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.646017:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.646030:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942c6a00/0x14b4f8542d4fc4b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60559 expref: 273 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.646040:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.646043:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.646061:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:1958:x1830881262965120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.646066:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 742 00000100:00100000:0.0:1746065184.647573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.663951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065184.667210:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc4f6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667229:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667241:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065184.667253:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065184.667344:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667351:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc4e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667357:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc4e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667362:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdaa00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.667365:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc4e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667371:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc4e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667382:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065184.667385:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.667389:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc4e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667394:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc4e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667435:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc4ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667442:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc4ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667446:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc4ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667450:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdb600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.667452:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc4ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667456:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc4ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667463:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f715000) 00010000:00010000:3.0:1746065184.667466:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.667468:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc4ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667472:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc4ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.667522:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc4e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60567 expref: 33 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.667535:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60567 expref: 32 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.667541:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.667543:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065184.667544:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73dc00, rc 0) 00000100:00100000:3.0:1746065184.667624:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:31664:x1830881262965504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3093us (3679us total) trans 8589944135 rc 0/0 00000100:00100000:3.0:1746065184.667632:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9916 00000100:00100000:0.0:1746065184.672408:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262965888 00000100:00100000:0.0:1746065184.672415:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262965888 00000100:00100000:0.0:1746065184.672464:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4227 00000100:00100000:0.0:1746065184.672471:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:31664:x1830881262965888:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065184.672901:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262965632 00000100:00100000:3.0:1746065184.672905:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262965632 00000100:00100000:3.0:1746065184.672943:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 744 00000100:00100000:3.0:1746065184.672948:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881262965632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.672956:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.672973:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc4f6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60567 expref: 33 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.673001:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.673005:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.673040:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881262965632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 92us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.673046:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 744 00000100:00100000:1.0:1746065184.673465:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:31664:x1830881262965888:12345-192.168.202.46@tcp:35:cat.0 Request processed in 993us (1117us total) trans 8589944136 rc 0/0 00000100:00100000:1.0:1746065184.673472:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4227 00000100:00100000:0.0:1746065184.675888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.675938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.676022:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262966016 00000100:00100000:3.0:1746065184.676029:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262966016 00000100:00100000:3.0:1746065184.676066:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262966144 00000100:00100000:3.0:1746065184.676069:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262966144 00000100:00100000:3.0:1746065184.676084:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14391 00000100:00100000:3.0:1746065184.676090:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881262966016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.676103:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.676117:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc504 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6056e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.676160:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260323456:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065184.676238:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.676253:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14392 00000100:00100000:3.0:1746065184.676258:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881262966144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.676264:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.676272:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60575 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.676283:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.676285:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.676291:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 24 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.676303:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 24 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.676312:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c800, rc 0) 00000100:00100000:3.0:1746065184.676331:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262966144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 73us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.676335:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14392 00000100:00100000:3.0:1746065184.677742:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260323456:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065184.677771:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc504 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6056e expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.677781:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc504 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6056e expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.677801:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73ce00, rc 0) 00000100:00100000:3.0:1746065184.677860:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881262966016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1769us (1975us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065184.677867:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14391 00000100:00100000:0.0:1746065184.680166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.680395:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262966272 00000100:00100000:3.0:1746065184.680402:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262966272 00000100:00100000:3.0:1746065184.680453:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14393 00000100:00100000:3.0:1746065184.680461:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:31664:x1830881262966272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.680475:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.680488:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6057c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.680512:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.680519:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.680520:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.680523:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.680547:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.680557:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 30 pid: 9716 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.680568:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260323584:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.680635:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.685069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.685243:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262966400 00000100:00100000:1.0:1746065184.685252:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262966400 00000100:00100000:1.0:1746065184.685433:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14394 00000100:00100000:1.0:1746065184.685441:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31658:x1830881262966400:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065184.685454:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.685468:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60583 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.685493:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 32 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.685500:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c876200/0x14b4f8542d4fc305 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60472 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.685506:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0x14b4f8542d4fc168 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a0 expref: 23 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.685511:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.685513:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.685515:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1224704->1642495] (req 1224704->1642495) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60583 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.685539:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0x14b4f8542d4fc168 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a0 expref: 23 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.685547:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0x14b4f8542d4fc168 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a0 expref: 23 pid: 8429 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065184.685559:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260323712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.685637:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c876200/0x14b4f8542d4fc305 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60472 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.685645:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c876200/0x14b4f8542d4fc305 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60472 expref: 6 pid: 8429 timeout: 883 lvb_type: 1 00000100:00100000:1.0:1746065184.685653:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260323840:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.685678:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 32 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.685685:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 32 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:1.0:1746065184.685691:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260323968:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.685707:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.686169:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260323584:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.686192:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.686202:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c400, rc 0) 00000100:00100000:3.0:1746065184.686240:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:31664:x1830881262966272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5779us (6079us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.686246:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14393 00000100:00100000:0.0:1746065184.687734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.687871:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262966528 00000100:00100000:1.0:1746065184.687877:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262966528 00002000:00100000:1.0:1746065184.687911:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (770048->917503) req@ffff88009b9ffb80 x1830881262966528/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.687919:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ffb80 with x1830881262966528 ext(770048->917503) 00010000:00010000:1.0:1746065184.687926:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 31 pid: 9716 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.687936:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 31 pid: 9716 timeout: 883 lvb_type: 0 00002000:00010000:1.0:1746065184.687947:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9ffb80 00000100:00100000:1.0:1746065184.687970:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2459 00000100:00100000:1.0:1746065184.687975:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262966528:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065184.691682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.691712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.691733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.691809:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262966784 00000100:00100000:3.0:1746065184.691833:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262966784 00010000:00010000:3.0:1746065184.691861:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c876200/0x14b4f8542d4fc305 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60472 expref: 7 pid: 8429 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746065184.691882:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262966656 00000100:00100000:3.0:1746065184.691884:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262966656 00010000:00010000:3.0:1746065184.691893:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0x14b4f8542d4fc168 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a0 expref: 24 pid: 8429 timeout: 883 lvb_type: 1 00000100:00100000:3.0:1746065184.691905:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262966912 00000100:00100000:3.0:1746065184.691907:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262966912 00010000:00010000:3.0:1746065184.691915:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 33 pid: 8427 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.691928:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7334 00000100:00100000:3.0:1746065184.691934:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881262966784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.691944:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.691962:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c876200/0x14b4f8542d4fc305 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60472 expref: 7 pid: 8429 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.691974:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c876200/0x14b4f8542d4fc305 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60472 expref: 7 pid: 8429 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.691999:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.692029:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881262966784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.692035:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7334 00000100:00100000:3.0:1746065184.692049:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7335 00000100:00100000:3.0:1746065184.692053:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881262966656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.692060:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.692066:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0x14b4f8542d4fc168 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a0 expref: 24 pid: 8429 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.692073:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0x14b4f8542d4fc168 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a0 expref: 24 pid: 8429 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.692083:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4a4600/0x14b4f8542d4fc168 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e603a0 expref: 24 pid: 8429 timeout: 883 lvb_type: 1 00010000:00010000:3.0:1746065184.692094:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.692108:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262966656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.692113:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7335 00000100:00100000:3.0:1746065184.692150:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7336 00000100:00100000:3.0:1746065184.692155:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262966912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.692160:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.692167:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 33 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.692174:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 33 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.692184:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c730c00/0x14b4f8542d4fc137 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6038b expref: 33 pid: 8427 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.692192:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.692193:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.692198:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1642495) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60583 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.692205:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1642495) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60583 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.692235:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1642495) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60583 expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.692245:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260324096:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065184.692288:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065184.699111:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881262966528:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 11127us (11373us total) trans 21474840855 rc 0/0 00000100:00100000:1.0:1746065184.699123:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2459 00002000:00100000:1.0:1746065184.699132:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (770048->917503) req@ffff88009b9ffb80 x1830881262966528/t21474840855(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/448 e 0 to 0 dl 1746065195 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.699140:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ffb80 with x1830881262966528 ext(770048->917503) 00010000:00010000:1.0:1746065184.699149:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 33 pid: 9716 timeout: 883 lvb_type: 0 00010000:00010000:1.0:1746065184.699163:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 33 pid: 9716 timeout: 883 lvb_type: 0 00002000:00010000:1.0:1746065184.699168:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9ffb80 00000100:00100000:3.0:1746065184.700440:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260324096:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065184.700457:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.701035:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262966912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8783us (9204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.701046:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7336 00000100:00100000:0.0:1746065184.702270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.702324:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262967168 00000100:00100000:1.0:1746065184.702330:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262967168 00002000:00100000:1.0:1746065184.702361:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1224704->1228799) req@ffff88009b9ff800 x1830881262967168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.702369:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff800 with x1830881262967168 ext(1224704->1228799) 00002000:00010000:1.0:1746065184.702373:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9ff800 00000100:00100000:1.0:1746065184.702397:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8081 00000100:00100000:1.0:1746065184.702404:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262967168:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065184.702523:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881262967168:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 119us (256us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065184.702528:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8081 00002000:00100000:1.0:1746065184.702532:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1224704->1228799) req@ffff88009b9ff800 x1830881262967168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.702538:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff800 with x1830881262967168 ext(1224704->1228799) 00002000:00010000:1.0:1746065184.702541:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9ff800 00000100:00100000:0.0:1746065184.703395:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.704845:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262967296 00000100:00100000:3.0:1746065184.704853:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262967296 00010000:00010000:3.0:1746065184.704880:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 33 pid: 9716 timeout: 883 lvb_type: 0 00000100:00100000:3.0:1746065184.704903:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7337 00000100:00100000:3.0:1746065184.704909:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262967296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.704920:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.704936:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 33 pid: 9716 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.704950:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 33 pid: 9716 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.704966:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc447 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->917503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60521 expref: 33 pid: 9716 timeout: 883 lvb_type: 0 00010000:00010000:3.0:1746065184.704988:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.704989:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.704997:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.705004:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.705031:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.705042:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260324224:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065184.706622:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.709317:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262967552 00000100:00100000:3.0:1746065184.709324:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262967552 00002000:00100000:3.0:1746065184.709361:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1638400->1642495) req@ffff88009f468e00 x1830881262967552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.709369:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468e00 with x1830881262967552 ext(1638400->1642495) 00002000:00010000:3.0:1746065184.709374:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f468e00 00000100:00100000:0.0:1746065184.710443:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260324224:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065184.710461:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.710498:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881262967296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5588us (7103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.710507:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7337 00000100:00100000:3.0:1746065184.710642:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8082 00000100:00100000:3.0:1746065184.710650:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262967552:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065184.710765:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262967552:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 117us (1653us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.710770:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8082 00002000:00100000:3.0:1746065184.710775:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1638400->1642495) req@ffff88009f468e00 x1830881262967552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.710782:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468e00 with x1830881262967552 ext(1638400->1642495) 00002000:00010000:3.0:1746065184.710785:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f468e00 00000100:00100000:0.0:1746065184.712017:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.712148:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262967808 00000100:00100000:1.0:1746065184.712155:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262967808 00002000:00100000:1.0:1746065184.712182:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009b9fdc00 x1830881262967808/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.712189:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdc00 with x1830881262967808 ext(0->1048575) 00002000:00010000:1.0:1746065184.712193:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fdc00 00000100:00100000:1.0:1746065184.712206:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8083 00000100:00100000:1.0:1746065184.712211:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262967808:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065184.721810:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262967808:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9591us (9787us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065184.721843:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8083 00002000:00100000:1.0:1746065184.721851:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009b9fdc00 x1830881262967808/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.721861:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdc00 with x1830881262967808 ext(0->1048575) 00002000:00010000:1.0:1746065184.721865:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fdc00 00000100:00100000:0.0:1746065184.727278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.729603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.729928:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262968064 00000100:00100000:1.0:1746065184.729934:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262968064 00002000:00100000:1.0:1746065184.729964:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1224704->1642495) req@ffff880130447100 x1830881262968064/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.729973:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447100 with x1830881262968064 ext(1224704->1642495) 00010000:00010000:1.0:1746065184.729978:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60583 expref: 31 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065184.729989:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60583 expref: 31 pid: 2462 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065184.729994:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130447100 00000100:00100000:1.0:1746065184.730220:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2460 00000100:00100000:1.0:1746065184.730228:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881262968064:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065184.742521:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262968064:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 12284us (12912us total) trans 17179873587 rc 0/0 00000100:00100000:1.0:1746065184.742532:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2460 00002000:00100000:1.0:1746065184.742542:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1224704->1642495) req@ffff880130447100 x1830881262968064/t17179873587(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/448 e 0 to 0 dl 1746065195 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.742551:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447100 with x1830881262968064 ext(1224704->1642495) 00010000:00010000:1.0:1746065184.742559:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60583 expref: 33 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065184.742573:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942c7a00/0x14b4f8542d4fc519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1642495) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60583 expref: 33 pid: 2462 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065184.742585:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130447100 00000100:00100000:0.0:1746065184.746916:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.754451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.756045:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262968448 00000100:00100000:3.0:1746065184.756057:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262968448 00000100:00100000:3.0:1746065184.756110:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9917 00000100:00100000:3.0:1746065184.756118:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:31668:x1830881262968448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.756141:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.756157:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60591 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.756242:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.756253:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.756262:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.756281:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.756286:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.756291:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.756379:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc53c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.756387:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc53c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.756393:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc53c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065184.756400:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065184.757019:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757027:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757034:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757038:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f73ca00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.757041:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757047:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757056:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065184.757059:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.757062:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757067:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ca00/0x14b4f8542d4fc52e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757103:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757109:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757113:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757117:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f73d000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.757119:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757123:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757133:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205000) 00010000:00010000:3.0:1746065184.757135:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.757137:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757141:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d000/0x14b4f8542d4fc535 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.757180:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60591 expref: 275 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.757192:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc53c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60591 expref: 274 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.757198:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.757200:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065184.757202:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73de00, rc 0) 00000100:00100000:3.0:1746065184.757268:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:31668:x1830881262968448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1149us (2821us total) trans 8589944137 rc 0/0 00000100:00100000:3.0:1746065184.757275:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9917 00000100:00100000:0.0:1746065184.758213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.758257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.758385:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262968832 00000100:00100000:3.0:1746065184.758392:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262968832 00002000:00100000:3.0:1746065184.758421:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880129b0c700 x1830881262968832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.758429:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c700 with x1830881262968832 ext(1048576->2097151) 00002000:00010000:3.0:1746065184.758434:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0c700 00000100:00100000:3.0:1746065184.758460:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262968704 00000100:00100000:3.0:1746065184.758462:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262968704 00002000:00100000:3.0:1746065184.758473:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880095350e00 x1830881262968704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.758479:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350e00 with x1830881262968704 ext(1048576->2097151) 00002000:00010000:3.0:1746065184.758481:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350e00 00000100:00100000:3.0:1746065184.758497:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8084 00000100:00100000:3.0:1746065184.758502:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881262968832:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065184.761563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.761587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.761650:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.761713:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262969344 00000100:00100000:0.0:1746065184.761720:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262969344 00000100:00100000:0.0:1746065184.761758:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 745 00000100:00100000:0.0:1746065184.761764:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:1959:x1830881262969344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.761773:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.761802:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc53c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60591 expref: 274 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.761836:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065184.761840:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.761875:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:1959:x1830881262969344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.761881:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 745 00000100:00100000:1.0:1746065184.775579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.775623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.775674:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262969600 00000100:00100000:3.0:1746065184.775682:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262969600 00002000:00100000:3.0:1746065184.775713:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f9cc700 x1830881262969600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.775722:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc700 with x1830881262969600 ext(0->1048575) 00002000:00010000:3.0:1746065184.775726:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cc700 00000100:00100000:3.0:1746065184.775741:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262969856 00000100:00100000:3.0:1746065184.775743:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262969856 00002000:00100000:3.0:1746065184.775753:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f9ce300 x1830881262969856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.775759:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce300 with x1830881262969856 ext(1048576->2097151) 00002000:00010000:3.0:1746065184.775761:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9ce300 00000100:00100000:3.0:1746065184.775770:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8086 00000100:00100000:3.0:1746065184.775776:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262969600:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065184.780358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.782991:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262968832:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24487us (24779us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065184.783001:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8084 00002000:00100000:3.0:1746065184.783009:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880129b0c700 x1830881262968832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.783017:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c700 with x1830881262968832 ext(1048576->2097151) 00002000:00010000:3.0:1746065184.783021:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0c700 00000100:00100000:0.0:1746065184.793408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.793483:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.793503:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262970112 00000100:00100000:0.0:1746065184.793510:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262970112 00010000:00010000:0.0:1746065184.793543:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c876a00/0x14b4f8542d4fc272 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60433 expref: 35 pid: 8427 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746065184.793563:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262970368 00000100:00100000:0.0:1746065184.793564:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262970368 00010000:00010000:0.0:1746065184.793573:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60410 expref: 25 pid: 8427 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065184.793601:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7339 00000100:00100000:0.0:1746065184.793607:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262970112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.793616:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.793636:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c876a00/0x14b4f8542d4fc272 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60433 expref: 35 pid: 8427 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746065184.793645:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c876a00/0x14b4f8542d4fc272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60433 expref: 35 pid: 8427 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746065184.793669:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c876a00/0x14b4f8542d4fc272 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60433 expref: 35 pid: 8427 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746065184.793682:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.793699:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881262970112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.793704:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7339 00000100:00100000:0.0:1746065184.793717:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262970240 00000100:00100000:0.0:1746065184.793719:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262970240 00010000:00010000:0.0:1746065184.793727:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009471be00/0x14b4f8542d4fc2fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60480 expref: 7 pid: 4545 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746065184.793740:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7340 00000100:00100000:0.0:1746065184.793744:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881262970368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.793750:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.793757:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60410 expref: 24 pid: 8427 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065184.793764:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60410 expref: 24 pid: 8427 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065184.793775:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b52c0400/0x14b4f8542d4fc248 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60410 expref: 24 pid: 8427 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065184.793784:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.793856:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7341 00000100:00100000:3.0:1746065184.793864:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881262970240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.793871:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.793881:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009471be00/0x14b4f8542d4fc2fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60480 expref: 7 pid: 4545 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746065184.793889:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009471be00/0x14b4f8542d4fc2fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60480 expref: 7 pid: 4545 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746065184.793901:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471be00/0x14b4f8542d4fc2fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60480 expref: 7 pid: 4545 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746065184.793921:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.793922:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.793927:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7800/0x14b4f8542d4fc558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605a6 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.793934:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7800/0x14b4f8542d4fc558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605a6 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.793958:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7800/0x14b4f8542d4fc558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605a6 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.794576:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260324992:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065184.796003:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881262970368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2255us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.796012:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7340 00000100:00100000:3.0:1746065184.796315:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.796648:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262969856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20771us (21023us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065184.796655:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8087 00002000:00100000:0.0:1746065184.796662:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f9ce300 x1830881262969856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065184.796671:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce300 with x1830881262969856 ext(1048576->2097151) 00002000:00010000:0.0:1746065184.796674:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9ce300 00000100:00100000:3.0:1746065184.798919:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881262969600:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23135us (23342us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065184.798928:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8086 00002000:00100000:3.0:1746065184.798937:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f9cc700 x1830881262969600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.798945:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc700 with x1830881262969600 ext(0->1048575) 00002000:00010000:3.0:1746065184.798949:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cc700 00000100:00100000:3.0:1746065184.802179:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260324992:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065184.802200:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.802239:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881262970240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8375us (8554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.802248:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7341 00000100:00100000:0.0:1746065184.802524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.802766:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260325120:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.802834:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc55f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ad expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.802849:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3d9600, rc 0) 00000100:00100000:3.0:1746065184.802883:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+24:31664:x1830881262970496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7304us (7717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.802889:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14399 00000100:00100000:3.0:1746065184.802911:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262970752 00000100:00100000:3.0:1746065184.802916:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262970752 00002000:00100000:3.0:1746065184.802942:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1900544->1904639) req@ffff88009c3f8380 x1830881262970752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.802955:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8380 with x1830881262970752 ext(1900544->1904639) 00010000:00010000:3.0:1746065184.802960:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7800/0x14b4f8542d4fc558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605a6 expref: 24 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.802970:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7800/0x14b4f8542d4fc558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605a6 expref: 24 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065184.802976:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3f8380 00000100:00100000:3.0:1746065184.803003:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2461 00000100:00100000:3.0:1746065184.803010:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881262970752:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065184.804139:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881262970752:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1125us (1612us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.804146:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2461 00002000:00100000:3.0:1746065184.804151:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1900544->1904639) req@ffff88009c3f8380 x1830881262970752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.804158:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8380 with x1830881262970752 ext(1900544->1904639) 00010000:00010000:3.0:1746065184.804163:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7800/0x14b4f8542d4fc558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605a6 expref: 24 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.804173:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7d7800/0x14b4f8542d4fc558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605a6 expref: 24 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065184.804179:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3f8380 00000100:00100000:0.0:1746065184.809045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.809094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.809155:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262971136 00000100:00100000:3.0:1746065184.809163:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262971136 00000100:00100000:3.0:1746065184.809198:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14400 00000100:00100000:3.0:1746065184.809205:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+24:31660:x1830881262971136:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065184.809220:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.809233:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605b4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.809256:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c600/0x14b4f8542d4fc3bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604e9 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.809264:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6c00/0x14b4f8542d4fc3e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f7 expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.809269:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.809271:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.809273:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2695167] (req 2097152->2695167) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.809296:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6c00/0x14b4f8542d4fc3e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f7 expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065184.809305:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6c00/0x14b4f8542d4fc3e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f7 expref: 25 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746065184.809315:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260325248:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.809397:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73c600/0x14b4f8542d4fc3bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604e9 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.809410:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c600/0x14b4f8542d4fc3bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604e9 expref: 31 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065184.809417:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260325376:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.809434:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.813618:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260325248:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.813649:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260325376:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.813673:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2695167] (req 2097152->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.813684:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73de00, rc 0) 00000100:00100000:3.0:1746065184.813705:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+28:31660:x1830881262971136:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4501us (4669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.813711:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14400 00000100:00100000:0.0:1746065184.814648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.814698:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262971264 00000100:00100000:3.0:1746065184.814704:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262971264 00000100:00100000:3.0:1746065184.814739:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14401 00000100:00100000:3.0:1746065184.814745:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31668:x1830881262971264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.814755:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.814770:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605bb expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.814797:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.814802:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.814809:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.814847:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73d400, rc 0) 00000100:00100000:3.0:1746065184.814883:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31668:x1830881262971264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 137us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.814888:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14401 00000100:00100000:0.0:1746065184.817767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.817938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.818293:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262971520 00000100:00100000:3.0:1746065184.818300:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262971520 00000100:00100000:0.0:1746065184.818300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065184.818330:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6c00/0x14b4f8542d4fc3e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f7 expref: 27 pid: 25185 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065184.818875:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73c600/0x14b4f8542d4fc3bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604e9 expref: 33 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065184.818886:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c600/0x14b4f8542d4fc3bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604e9 expref: 33 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065184.818892:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.818894:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.818896:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.818901:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.818916:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065184.818923:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260325760:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065184.818944:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.823742:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260325760:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065184.823762:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.823809:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881262971392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4955us (5508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.823836:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7344 00000100:00100000:2.0:1746065184.823846:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260325504:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065184.823855:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260325632:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065184.823867:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065184.823884:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881262971648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5265us (5946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.823890:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7343 00000100:00100000:0.0:1746065184.824246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.824295:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262971904 00000100:00100000:3.0:1746065184.824301:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262971904 00002000:00100000:3.0:1746065184.824333:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009ba1c000 x1830881262971904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.824341:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c000 with x1830881262971904 ext(1048576->2097151) 00002000:00010000:3.0:1746065184.824346:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1c000 00000100:00100000:3.0:1746065184.824375:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8088 00000100:00100000:3.0:1746065184.824381:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881262971904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065184.830894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.830942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.831050:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262972416 00000100:00100000:1.0:1746065184.831058:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262972416 00002000:00100000:1.0:1746065184.831093:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2691072->2695167) req@ffff88009ba1e680 x1830881262972416/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.831102:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e680 with x1830881262972416 ext(2691072->2695167) 00002000:00010000:1.0:1746065184.831107:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1e680 00000100:00100000:1.0:1746065184.831135:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262972160 00000100:00100000:1.0:1746065184.831137:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262972160 00002000:00100000:1.0:1746065184.831147:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009ba1e300 x1830881262972160/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.831153:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e300 with x1830881262972160 ext(1048576->2097151) 00002000:00010000:1.0:1746065184.831156:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1e300 00000100:00100000:1.0:1746065184.831166:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8089 00000100:00100000:1.0:1746065184.831172:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881262972416:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065184.831316:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881262972416:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 143us (427us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065184.831322:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8089 00002000:00100000:1.0:1746065184.831328:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2691072->2695167) req@ffff88009ba1e680 x1830881262972416/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.831334:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e680 with x1830881262972416 ext(2691072->2695167) 00002000:00010000:1.0:1746065184.831337:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1e680 00000100:00100000:1.0:1746065184.831350:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8090 00000100:00100000:1.0:1746065184.831354:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881262972160:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065184.835912:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881262971904:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11522us (11659us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065184.835922:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8088 00002000:00100000:3.0:1746065184.835932:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009ba1c000 x1830881262971904/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.835941:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c000 with x1830881262971904 ext(1048576->2097151) 00002000:00010000:3.0:1746065184.835946:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1c000 00000100:00100000:0.0:1746065184.839953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.841110:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262972672 00000100:00100000:1.0:1746065184.841119:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262972672 00000100:00100000:1.0:1746065184.841171:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4228 00000100:00100000:1.0:1746065184.841179:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:31660:x1830881262972672:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065184.841361:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+33:31660:x1830881262972672:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 181us (1416us total) trans 8589944138 rc 0/0 00000100:00100000:1.0:1746065184.841367:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4228 00000100:00100000:2.0:1746065184.842283:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881262972160:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10926us (11338us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065184.842294:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8090 00002000:00100000:2.0:1746065184.842301:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009ba1e300 x1830881262972160/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.842308:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e300 with x1830881262972160 ext(1048576->2097151) 00002000:00010000:2.0:1746065184.842313:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1e300 00000100:00100000:0.0:1746065184.855065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.855158:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262972800 00000100:00100000:3.0:1746065184.855165:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262972800 00000100:00100000:3.0:1746065184.855424:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14402 00000100:00100000:3.0:1746065184.855432:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31668:x1830881262972800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065184.855448:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.855464:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605c2 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.855486:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.855493:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.855494:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065184.855497:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.855521:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.855537:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 24 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065184.855547:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260325888:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065184.857930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.858030:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262972928 00000100:00100000:2.0:1746065184.858037:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262972928 00002000:00100000:2.0:1746065184.858070:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2695167) req@ffff88012bd3c380 x1830881262972928/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.858079:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c380 with x1830881262972928 ext(2097152->2695167) 00010000:00010000:2.0:1746065184.858085:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 25 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065184.858096:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 25 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065184.858102:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bd3c380 00000100:00100000:2.0:1746065184.858117:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2463 00000100:00100000:2.0:1746065184.858122:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:1959:x1830881262972928:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065184.859018:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065184.859041:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260325888:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065184.859063:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.859076:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73da00, rc 0) 00000100:00100000:3.0:1746065184.859097:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31668:x1830881262972800:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3666us (4039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.859103:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14402 00000100:00100000:0.0:1746065184.862453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.862498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.865634:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262973312 00000100:00100000:2.0:1746065184.865644:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262973312 00000100:00100000:1.0:1746065184.865860:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262973184 00000100:00100000:1.0:1746065184.865865:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262973184 00002000:00100000:1.0:1746065184.866056:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2695168->3743743) req@ffff88012bd3ed80 x1830881262973184/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.866066:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ed80 with x1830881262973184 ext(2695168->3743743) 00010000:00010000:1.0:1746065184.866074:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 28 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065184.866088:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 28 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065184.866094:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bd3ed80 00000100:00100000:1.0:1746065184.866123:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2464 00000100:00100000:1.0:1746065184.866130:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881262973184:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:2.0:1746065184.870920:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3743744->4194303) req@ffff88012bd3f480 x1830881262973312/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.870933:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f480 with x1830881262973312 ext(3743744->4194303) 00010000:00010000:2.0:1746065184.870943:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 29 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065184.870958:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 29 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065184.870965:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bd3f480 00000100:00100000:2.0:1746065184.870992:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2465 00000100:00100000:2.0:1746065184.871000:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262973312:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065184.873683:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881262972928:12345-192.168.202.46@tcp:4:cat.0 Request processed in 15552us (15750us total) trans 21474840857 rc 0/0 00000100:00100000:3.0:1746065184.873694:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2463 00002000:00100000:3.0:1746065184.873703:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2695167) req@ffff88012bd3c380 x1830881262972928/t21474840857(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/448 e 0 to 0 dl 1746065195 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.873712:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c380 with x1830881262972928 ext(2097152->2695167) 00010000:00010000:3.0:1746065184.873720:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 31 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.873734:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 31 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065184.873741:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bd3c380 00000100:00100000:0.0:1746065184.877041:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.877082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.877106:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262973696 00000100:00100000:0.0:1746065184.877112:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262973696 00000100:00100000:0.0:1746065184.877157:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262973824 00000100:00100000:0.0:1746065184.877159:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262973824 00000100:00100000:0.0:1746065184.877174:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9918 00000100:00100000:0.0:1746065184.877180:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:31672:x1830881262973696:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065184.877199:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065184.877213:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc57b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605c9 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.877295:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877305:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877314:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877325:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877330:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877334:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877424:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc590 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877431:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc590 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877440:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc590 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065184.877446:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065184.877512:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877517:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877523:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877527:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065184.877530:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877535:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877543:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065184.877545:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065184.877548:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877552:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877565:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877569:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877576:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877579:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdb800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065184.877581:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877584:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877589:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f500) 00010000:00010000:0.0:1746065184.877591:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065184.877593:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877596:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb800/0x14b4f8542d4fc589 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877624:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc57b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c9 expref: 276 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.877634:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc590 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c9 expref: 275 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.877640:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065184.877642:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065184.877644:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdb600, rc 0) 00000100:00100000:0.0:1746065184.877680:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:31672:x1830881262973696:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 500us (645us total) trans 8589944139 rc 0/0 00000100:00100000:0.0:1746065184.877686:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9918 00000100:00100000:0.0:1746065184.877704:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9919 00000100:00100000:0.0:1746065184.877710:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31673:x1830881262973824:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065184.877717:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065184.877722:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc59e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605d0 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.877745:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877751:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877757:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877765:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877769:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877774:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877850:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877857:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 274 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.877863:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.877888:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 274 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.877895:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 274 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065184.877905:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260326016:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065184.877952:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.880871:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260326016:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065184.880890:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065184.881365:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881262973184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15234us (18865us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065184.881373:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2464 00002000:00100000:1.0:1746065184.881382:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2695168->3743743) req@ffff88012bd3ed80 x1830881262973184/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.881390:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ed80 with x1830881262973184 ext(2695168->3743743) 00010000:00010000:1.0:1746065184.881396:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 29 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065184.881406:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 29 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065184.881411:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bd3ed80 00000100:00100000:2.0:1746065184.881614:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881262973312:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10615us (19169us total) trans 0 rc 450560/450560 00000100:00100000:2.0:1746065184.881621:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2465 00002000:00100000:2.0:1746065184.881626:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3743744->4194303) req@ffff88012bd3f480 x1830881262973312/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:H/200/0 rc 450560/450560 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.881632:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f480 with x1830881262973312 ext(3743744->4194303) 00010000:00010000:2.0:1746065184.881637:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 27 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065184.881644:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 27 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065184.881649:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bd3f480 00000100:00100000:0.0:1746065184.881768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.881853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.881914:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262974080 00000100:00100000:3.0:1746065184.881921:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262974080 00000100:00100000:3.0:1746065184.881950:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4229 00000100:00100000:3.0:1746065184.881955:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:7710:x1830881262974080:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065184.882092:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:7710:x1830881262974080:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 135us (323us total) trans 8589944140 rc 0/0 00000100:00100000:3.0:1746065184.882097:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4229 00000100:00100000:2.0:1746065184.882669:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262974208 00000100:00100000:2.0:1746065184.882673:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262974208 00000100:00100000:2.0:1746065184.882712:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 746 00000100:00100000:2.0:1746065184.882718:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:1960:x1830881262974208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065184.882728:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065184.882745:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb600/0x14b4f8542d4fc590 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c9 expref: 276 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.882771:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065184.882776:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065184.882783:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065184.882798:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065184.882802:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065184.882856:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:1960:x1830881262974208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 137us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.882862:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 746 00000100:00100000:0.0:1746065184.885353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.885403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.885478:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262974336 00000100:00100000:3.0:1746065184.885485:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262974336 00010000:00010000:3.0:1746065184.885514:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 275 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065184.885695:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262974464 00000100:00100000:2.0:1746065184.885699:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262974464 00000100:00100000:2.0:1746065184.885733:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14403 00000100:00100000:2.0:1746065184.885740:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:31664:x1830881262974464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065184.885752:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.885765:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605d7 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.885783:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065184.885796:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065184.885800:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.885810:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.885844:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba4800, rc 0) 00000100:00100000:2.0:1746065184.885892:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+28:31664:x1830881262974464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 152us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.885898:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14403 00000100:00100000:3.0:1746065184.886086:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7345 00000100:00100000:3.0:1746065184.886093:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:1960:x1830881262974336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.886103:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.886108:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 275 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.886117:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 275 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.886132:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471a000/0x14b4f8542d4fc398 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604cd expref: 275 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.886141:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.886146:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.886154:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.886159:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.886381:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.886829:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:1960:x1830881262974336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 722us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.886835:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7345 00000100:00100000:1.0:1746065184.886914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.887009:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262974592 00000100:00100000:3.0:1746065184.887013:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262974592 00010000:00010000:3.0:1746065184.887026:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 28 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065184.887043:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7346 00000100:00100000:3.0:1746065184.887048:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881262974592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.887055:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.887072:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 28 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.887080:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 28 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.887092:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73de00/0x14b4f8542d4fc566 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2695167) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605b4 expref: 28 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.887105:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.887107:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.887111:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.887118:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.887124:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.887126:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.887128:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.887134:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.887157:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.887167:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260326144:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065184.887218:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.887226:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260326272:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065184.887245:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c000 going to sleep for 11 seconds 00010000:00010000:0.0:1746065184.887296:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887303:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065184.887334:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:0.0:1746065184.887338:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065184.887350:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887359:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887370:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887375:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887380:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887384:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdaa00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065184.887387:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887392:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887400:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065184.887402:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065184.887405:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887409:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc5a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887421:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887426:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887431:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887434:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdba00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065184.887437:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887441:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887446:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ed64100) 00010000:00010000:0.0:1746065184.887448:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065184.887450:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887454:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc5ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.887481:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb200/0x14b4f8542d4fc59e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.887490:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.887495:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065184.887497:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065184.887499:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbda800, rc 0) 00000100:00100000:0.0:1746065184.887521:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31673:x1830881262973824:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 9811us (10438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.887527:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9919 00000100:00100000:0.0:1746065184.889731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.889771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.889848:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262974720 00000100:00100000:1.0:1746065184.889854:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262974720 00000100:00100000:1.0:1746065184.889878:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262974848 00000100:00100000:1.0:1746065184.889880:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262974848 00000100:00100000:1.0:1746065184.889893:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14404 00000100:00100000:1.0:1746065184.889900:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881262974720:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065184.889913:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.889924:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605de expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.889944:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.889946:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.889953:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.889965:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.889974:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b3000, rc 0) 00000100:00100000:1.0:1746065184.890000:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881262974720:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.890005:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14404 00000100:00100000:1.0:1746065184.890016:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14405 00000100:00100000:1.0:1746065184.890021:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881262974848:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065184.890027:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.890035:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605e5 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.890045:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.890046:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.890050:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.890058:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065184.890069:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b2600, rc 0) 00000100:00100000:1.0:1746065184.890083:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881262974848:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 61us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.890087:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14405 00000100:00100000:3.0:1746065184.890199:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260326144:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065184.890207:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260326272:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065184.890222:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.890242:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881262974592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3194us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.890249:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7346 00000100:00100000:2.0:1746065184.890443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.890488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.890506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.890515:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262974976 00000100:00100000:2.0:1746065184.890518:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262974976 00000100:00100000:2.0:1746065184.890531:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262975104 00000100:00100000:2.0:1746065184.890532:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262975104 00000100:00100000:2.0:1746065184.890539:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262975232 00000100:00100000:2.0:1746065184.890540:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262975232 00000100:00100000:2.0:1746065184.890549:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14406 00000100:00100000:2.0:1746065184.890553:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881262974976:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065184.890559:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.890565:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605ec expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.890573:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.890575:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.890578:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.890590:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.890596:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba4000, rc 0) 00000100:00100000:2.0:1746065184.890610:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262974976:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 57us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.890614:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14406 00000100:00100000:2.0:1746065184.890623:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14407 00000100:00100000:2.0:1746065184.890626:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262975104:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065184.890630:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.890635:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605f3 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.890643:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.890644:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.890647:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.890654:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.890659:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba4600, rc 0) 00000100:00100000:2.0:1746065184.890668:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130719050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262975104:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 41us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.890672:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14407 00000100:00100000:2.0:1746065184.890778:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14408 00000100:00100000:2.0:1746065184.890782:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262975232:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065184.890795:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.890800:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e605fa expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.890807:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.890809:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.890812:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.890837:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.890843:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba4400, rc 0) 00000100:00100000:2.0:1746065184.890855:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262975232:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.890858:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14408 00000100:00100000:2.0:1746065184.890885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.890895:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262975360 00000100:00100000:2.0:1746065184.890897:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262975360 00000100:00100000:2.0:1746065184.890908:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14409 00000100:00100000:2.0:1746065184.890912:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262975360:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065184.890918:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.890923:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60601 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.890936:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.890937:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.890941:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.890948:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.890954:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba4a00, rc 0) 00000100:00100000:2.0:1746065184.890968:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262975360:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 55us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.890972:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14409 00000100:00100000:0.0:1746065184.891897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.891967:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262975616 00000100:00100000:2.0:1746065184.891972:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262975616 00002000:00100000:2.0:1746065184.891995:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094d96300 x1830881262975616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.892003:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96300 with x1830881262975616 ext(3145728->4194303) 00002000:00010000:2.0:1746065184.892007:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d96300 00000100:00100000:2.0:1746065184.892033:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8091 00000100:00100000:2.0:1746065184.892039:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881262975616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065184.894280:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.895279:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262975872 00000100:00100000:0.0:1746065184.895286:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262975872 00000100:00100000:0.0:1746065184.895328:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9920 00000100:00100000:0.0:1746065184.895335:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31673:x1830881262975872:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065184.895351:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065184.895366:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdbc00/0x14b4f8542d4fc5eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60608 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.895439:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.895452:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.895459:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065184.895485:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.895496:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 12 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065184.895506:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260326400:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065184.895569:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.898175:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.898232:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260326400:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.898249:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:2.0:1746065184.898342:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881262975616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6301us (6444us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065184.898351:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8091 00002000:00100000:2.0:1746065184.898361:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094d96300 x1830881262975616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.898370:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96300 with x1830881262975616 ext(3145728->4194303) 00002000:00010000:2.0:1746065184.898374:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d96300 00000100:00100000:2.0:1746065184.898392:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262976128 00000100:00100000:2.0:1746065184.898396:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262976128 00002000:00100000:2.0:1746065184.898420:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094d95f80 x1830881262976128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.898427:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881262976128 ext(2097152->3145727) 00002000:00010000:2.0:1746065184.898430:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:2.0:1746065184.898442:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8092 00000100:00100000:2.0:1746065184.898448:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262976128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065184.900089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.900463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.900482:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262976512 00000100:00100000:1.0:1746065184.900487:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262976512 00002000:00100000:1.0:1746065184.900513:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009bee1880 x1830881262976512/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.900520:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1880 with x1830881262976512 ext(3145728->4194303) 00002000:00010000:1.0:1746065184.900524:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee1880 00000100:00100000:1.0:1746065184.900551:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8093 00000100:00100000:1.0:1746065184.900556:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881262976512:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065184.902051:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262976384 00000100:00100000:3.0:1746065184.902058:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262976384 00010000:00010000:3.0:1746065184.902082:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 13 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065184.902130:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7347 00000100:00100000:3.0:1746065184.902137:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881262976384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.902148:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.902153:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 13 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.902163:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 13 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.902180:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc5b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d0 expref: 13 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.902190:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.902194:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.902202:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.902208:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065184.902240:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.902267:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881262976384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 130us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.902273:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7347 00010000:00010000:1.0:1746065184.903971:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.903983:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065184.904004:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065184.904121:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdbc00/0x14b4f8542d4fc5eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60608 expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.904139:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60608 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.904146:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.904148:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065184.904151:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdb400, rc 0) 00000100:00100000:1.0:1746065184.904186:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31673:x1830881262975872:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 8851us (9910us total) trans 8589944141 rc 0/0 00000100:00100000:1.0:1746065184.904193:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9920 00000100:00100000:0.0:1746065184.911031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.911118:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262976768 00000100:00100000:3.0:1746065184.911128:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262976768 00002000:00100000:3.0:1746065184.911168:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d97100 x1830881262976768/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.911176:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97100 with x1830881262976768 ext(4194304->5013503) 00002000:00010000:3.0:1746065184.911181:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97100 00000100:00100000:3.0:1746065184.911199:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8094 00000100:00100000:3.0:1746065184.911206:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881262976768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065184.912084:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881262976128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13634us (13913us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065184.912090:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8092 00002000:00100000:2.0:1746065184.912095:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094d95f80 x1830881262976128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.912100:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881262976128 ext(2097152->3145727) 00002000:00010000:2.0:1746065184.912103:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:1.0:1746065184.922048:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881262976512:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21482us (21576us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065184.922059:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8093 00002000:00100000:1.0:1746065184.922074:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009bee1880 x1830881262976512/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065184.922082:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1880 with x1830881262976512 ext(3145728->4194303) 00002000:00010000:1.0:1746065184.922088:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee1880 00000100:00100000:1.0:1746065184.922177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.922208:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262977024 00000100:00100000:1.0:1746065184.922213:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262977024 00000100:00100000:1.0:1746065184.922257:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9921 00000100:00100000:1.0:1746065184.922263:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31673:x1830881262977024:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065184.922280:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065184.922282:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065184.922310:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdb400/0x14b4f8542d4fc5f2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60608 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.922328:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.922332:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065184.922343:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdbc00/0x14b4f8542d4fc600 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6060f expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.922412:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922423:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922430:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922439:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922443:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922448:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922453:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbda800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065184.922456:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922462:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922468:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065184.922470:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065184.922473:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922476:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda800/0x14b4f8542d4fc607 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065184.922496:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdbc00/0x14b4f8542d4fc600 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6060f expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.922502:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdbc00/0x14b4f8542d4fc600 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6060f expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.922508:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdbc00, rc 0) 00000100:00100000:1.0:1746065184.922524:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31673:x1830881262977024:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 262us (348us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065184.922529:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9921 00000100:00100000:3.0:1746065184.923509:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881262976768:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12301us (12483us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065184.923517:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8094 00002000:00100000:3.0:1746065184.923525:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d97100 x1830881262976768/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.923533:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97100 with x1830881262976768 ext(4194304->5013503) 00002000:00010000:3.0:1746065184.923537:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97100 00000100:00100000:0.0:1746065184.931053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.931121:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262977280 00000100:00100000:1.0:1746065184.931129:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262977280 00000100:00100000:0.0:1746065184.931142:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.931205:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262977408 00000100:00100000:2.0:1746065184.931209:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262977408 00000100:00100000:2.0:1746065184.931247:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14410 00000100:00100000:2.0:1746065184.931255:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31672:x1830881262977408:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065184.931272:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.931286:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60616 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.931310:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.931316:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.931322:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.931328:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.931329:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.931332:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 34 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.931356:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.931365:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 26 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065184.931374:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260326528:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065184.931448:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.931455:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 8 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.931463:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260326656:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065184.931492:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.931499:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 34 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065184.931506:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260326784:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065184.931520:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065184.932242:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4230 00000100:00100000:1.0:1746065184.932250:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31673:x1830881262977280:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065184.932520:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31673:x1830881262977280:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 270us (1475us total) trans 8589944142 rc 0/0 00000100:00100000:1.0:1746065184.932526:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4230 00000100:00100000:0.0:1746065184.935943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.936103:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262977664 00000100:00100000:3.0:1746065184.936110:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262977664 00002000:00100000:3.0:1746065184.936145:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d97b80 x1830881262977664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.936154:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97b80 with x1830881262977664 ext(4194304->5013503) 00010000:00010000:3.0:1746065184.936162:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 35 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.936172:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 35 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065184.936178:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d97b80 00000100:00100000:3.0:1746065184.936211:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2466 00000100:00100000:3.0:1746065184.936218:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881262977664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065184.936350:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260326528:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065184.939152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.939185:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262977920 00000100:00100000:1.0:1746065184.939191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.939192:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262977920 00010000:00010000:3.0:1746065184.939217:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 9 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.939278:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260326656:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065184.939288:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260326784:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.939369:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262977792 00000100:00100000:3.0:1746065184.939373:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262977792 00010000:00010000:3.0:1746065184.939383:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 27 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065184.939399:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7348 00010000:00010000:2.0:1746065184.939404:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 36 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.939405:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881262977920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.939415:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065184.939419:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba4e00, rc 0) 00010000:00010000:3.0:1746065184.939430:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 9 pid: 25185 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746065184.939442:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 9 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.939456:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:31672:x1830881262977408:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8201us (8313us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065184.939460:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4400/0x14b4f8542d4fc5dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605fa expref: 9 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.939462:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14410 00010000:00010000:3.0:1746065184.939475:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.939493:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262977920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.939498:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7348 00000100:00100000:3.0:1746065184.939510:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7349 00000100:00100000:3.0:1746065184.939514:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881262977792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.939519:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.939525:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 27 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.939533:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 27 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.939542:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4800/0x14b4f8542d4fc5ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605d7 expref: 27 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.939549:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.939559:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881262977792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 45us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.939567:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7349 00000100:00100000:3.0:1746065184.944484:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881262977664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8257us (8538us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065184.944494:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2466 00002000:00100000:3.0:1746065184.944504:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d97b80 x1830881262977664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/440 e 0 to 0 dl 1746065195 ref 1 fl Complete:H/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.944513:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97b80 with x1830881262977664 ext(4194304->5013503) 00010000:00010000:3.0:1746065184.944525:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 34 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.944536:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 34 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065184.944542:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d97b80 00000100:00100000:0.0:1746065184.950025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.950084:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262978048 00000100:00100000:2.0:1746065184.950091:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262978048 00000100:00100000:2.0:1746065184.950128:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14411 00000100:00100000:2.0:1746065184.950139:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881262978048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065184.950154:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.950180:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fba5800/0x14b4f8542d4fc615 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6061d expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.950199:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.950208:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fba5800/0x14b4f8542d4fc615 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6061d expref: 35 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.950217:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fba5800/0x14b4f8542d4fc615 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6061d expref: 35 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.950228:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba5800, rc 0) 00000100:00100000:2.0:1746065184.950264:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881262978048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 129us (343us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065184.950269:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14411 00000100:00100000:0.0:1746065184.952737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.952907:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262978176 00000100:00100000:2.0:1746065184.952915:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262978176 00000100:00100000:2.0:1746065184.952946:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14412 00000100:00100000:2.0:1746065184.952952:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31668:x1830881262978176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065184.952965:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.952978:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60624 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.952998:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.952999:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.953005:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 35 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.953023:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 35 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.953031:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba5e00, rc 0) 00000100:00100000:2.0:1746065184.953077:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31668:x1830881262978176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 124us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.953083:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14412 00000100:00100000:1.0:1746065184.953537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.953696:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262978304 00000100:00100000:3.0:1746065184.953700:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262978304 00010000:00010000:3.0:1746065184.953716:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 35 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065184.954135:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7350 00000100:00100000:3.0:1746065184.954144:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881262978304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065184.954153:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065184.954171:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 35 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.954185:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 35 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.954200:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73da00/0x14b4f8542d4fc574 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605c2 expref: 35 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065184.954225:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.954226:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065184.954231:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 34 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.954237:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 34 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.954261:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 34 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065184.954271:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260326912:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065184.954331:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.955241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.955340:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262978432 00000100:00100000:2.0:1746065184.955344:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262978432 00000100:00100000:2.0:1746065184.955367:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14413 00000100:00100000:2.0:1746065184.955373:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881262978432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065184.955383:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.955391:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fba5400/0x14b4f8542d4fc623 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6062b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.955408:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fba5400/0x14b4f8542d4fc623 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6062b expref: 36 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.955416:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fba5400/0x14b4f8542d4fc623 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6062b expref: 36 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.955424:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba5400, rc 0) 00000100:00100000:2.0:1746065184.955549:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881262978432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 174us (307us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065184.955555:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14413 00000100:00100000:3.0:1746065184.957519:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260326912:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065184.957538:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065184.957573:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881262978304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3429us (4035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065184.957581:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7350 00000100:00100000:0.0:1746065184.957766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.957864:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262978688 00000100:00100000:3.0:1746065184.957869:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262978688 00002000:00100000:3.0:1746065184.957894:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4145152->4149247) req@ffff88009baa1180 x1830881262978688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.957902:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1180 with x1830881262978688 ext(4145152->4149247) 00002000:00010000:3.0:1746065184.957905:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1180 00000100:00100000:3.0:1746065184.957917:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8095 00000100:00100000:3.0:1746065184.957922:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881262978688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065184.958031:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881262978688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 108us (266us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.958036:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8095 00002000:00100000:3.0:1746065184.958040:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4145152->4149247) req@ffff88009baa1180 x1830881262978688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.958046:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1180 with x1830881262978688 ext(4145152->4149247) 00002000:00010000:3.0:1746065184.958049:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1180 00000100:00100000:0.0:1746065184.958717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.958798:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262978944 00000100:00100000:2.0:1746065184.958802:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262978944 00002000:00100000:2.0:1746065184.958839:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88009baa1500 x1830881262978944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.958846:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1500 with x1830881262978944 ext(5009408->5013503) 00002000:00010000:2.0:1746065184.958849:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1500 00000100:00100000:2.0:1746065184.958865:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8096 00000100:00100000:2.0:1746065184.958871:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881262978944:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065184.958952:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881262978944:12345-192.168.202.46@tcp:3:cat.0 Request processed in 81us (235us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065184.958958:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8096 00002000:00100000:2.0:1746065184.958963:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88009baa1500 x1830881262978944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.958969:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1500 with x1830881262978944 ext(5009408->5013503) 00002000:00010000:2.0:1746065184.958971:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1500 00000100:00100000:0.0:1746065184.961428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.961500:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262979072 00000100:00100000:2.0:1746065184.961506:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262979072 00000100:00100000:2.0:1746065184.961532:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14414 00000100:00100000:2.0:1746065184.961537:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31672:x1830881262979072:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065184.961548:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.961559:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60632 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.961577:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60505 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.961586:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.961590:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.961593:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.961594:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.961596:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->3665919] (req 3145728->3665919) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 34 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.961618:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.961628:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 34 pid: 8851 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.961637:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327040:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065184.961719:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.961726:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 8 pid: 8429 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.961734:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327168:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065184.961759:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60505 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.961766:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60505 expref: 23 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065184.961774:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327296:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065184.961808:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.968048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.968084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.968101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.968142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065184.968163:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262979584 00000100:00100000:1.0:1746065184.968174:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262979584 00010000:00010000:1.0:1746065184.968208:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 35 pid: 8851 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746065184.968229:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262979200 00000100:00100000:1.0:1746065184.968231:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262979200 00010000:00010000:1.0:1746065184.968240:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 9 pid: 8429 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746065184.968251:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262979712 00000100:00100000:1.0:1746065184.968253:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262979712 00010000:00010000:1.0:1746065184.968261:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60505 expref: 24 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746065184.968275:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7351 00000100:00100000:1.0:1746065184.968281:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881262979584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.968292:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.968312:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 35 pid: 8851 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.968321:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 35 pid: 8851 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.968341:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065184.968379:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f73d800/0x14b4f8542d4fc48d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6054b expref: 35 pid: 8851 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746065184.968433:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262979456 00000100:00100000:3.0:1746065184.968437:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262979456 00000100:00100000:1.0:1746065184.968446:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881262979584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 164us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.968452:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7351 00000100:00100000:3.0:1746065184.968461:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4231 00000100:00100000:3.0:1746065184.968467:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:31668:x1830881262979456:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065184.968468:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7352 00000100:00100000:1.0:1746065184.968473:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262979200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.968479:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.968487:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 9 pid: 8429 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.968494:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 9 pid: 8429 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.968504:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.968519:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881262979200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.968525:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7352 00000100:00100000:1.0:1746065184.968534:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7353 00000100:00100000:1.0:1746065184.968539:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881262979712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.968544:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.968551:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60505 expref: 24 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065184.968559:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60505 expref: 24 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065184.968569:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065184.968571:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065184.968572:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327040:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.968578:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065184.968585:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.968586:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4a00/0x14b4f8542d4fc5e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60601 expref: 8 pid: 8429 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.968594:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327168:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065184.968602:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7600/0x14b4f8542d4fc3f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60505 expref: 24 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065184.968609:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327296:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065184.968610:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065184.968619:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260327424:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065184.968632:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.968641:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba5000, rc 0) 00000100:00100000:1.0:1746065184.968655:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065184.968660:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31672:x1830881262979072:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7122us (7238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.968667:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14414 00000100:00100000:3.0:1746065184.969081:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:31668:x1830881262979456:12345-192.168.202.46@tcp:35:cat.0 Request processed in 613us (1041us total) trans 8589944143 rc 0/0 00000100:00100000:3.0:1746065184.969088:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4231 00000100:00100000:0.0:1746065184.974340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.974485:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262979968 00000100:00100000:3.0:1746065184.974493:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262979968 00000100:00100000:3.0:1746065184.974532:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9922 00000100:00100000:3.0:1746065184.974539:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+33:31677:x1830881262979968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065184.974558:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065184.974573:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60639 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.974666:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.974677:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.974686:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.974697:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.974703:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.974708:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065184.975738:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260327424:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065184.975756:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065184.975843:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881262979712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7302us (7699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065184.975853:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7353 00010000:00010000:3.0:1746065184.977125:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977139:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977150:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065184.977164:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065184.977257:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977267:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977272:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977276:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f73c000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.977279:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977285:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977294:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065184.977296:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.977299:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977303:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fc638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977313:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977317:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977322:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977325:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f73d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065184.977328:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977336:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977341:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205100) 00010000:00010000:3.0:1746065184.977342:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065184.977344:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977347:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d200/0x14b4f8542d4fc63f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065184.977387:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73dc00/0x14b4f8542d4fc631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 36 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.977397:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 35 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065184.977402:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065184.977404:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065184.977406:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73ce00, rc 0) 00000100:00100000:3.0:1746065184.977441:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+35:31677:x1830881262979968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2902us (3109us total) trans 8589944144 rc 0/0 00000100:00100000:3.0:1746065184.977447:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9922 00000100:00100000:0.0:1746065184.978316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.980348:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262980224 00000100:00100000:2.0:1746065184.980358:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262980224 00002000:00100000:2.0:1746065184.980399:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3661824->3665919) req@ffff8800a5882680 x1830881262980224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.980407:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882680 with x1830881262980224 ext(3661824->3665919) 00002000:00010000:2.0:1746065184.980413:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882680 00000100:00100000:2.0:1746065184.980446:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8097 00000100:00100000:2.0:1746065184.980452:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881262980224:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065184.980623:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881262980224:12345-192.168.202.46@tcp:3:cat.0 Request processed in 170us (2308us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065184.980630:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8097 00002000:00100000:2.0:1746065184.980635:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3661824->3665919) req@ffff8800a5882680 x1830881262980224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.980642:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882680 with x1830881262980224 ext(3661824->3665919) 00002000:00010000:2.0:1746065184.980645:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882680 00000100:00100000:0.0:1746065184.984379:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.984471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.984559:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262980608 00000100:00100000:3.0:1746065184.984567:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262980608 00000100:00100000:2.0:1746065184.984753:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262980352 00000100:00100000:2.0:1746065184.984757:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262980352 00000100:00100000:2.0:1746065184.984796:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14415 00000100:00100000:2.0:1746065184.984804:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+23:31677:x1830881262980352:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:3.0:1746065184.984846:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4232 00000100:00100000:3.0:1746065184.984853:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090022850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:31672:x1830881262980608:12345-192.168.202.46@tcp:35:multiop.0 00010000:00010000:2.0:1746065184.984875:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065184.984891:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60640 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.984915:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d6e00/0x14b4f8542d4fc520 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6058a expref: 24 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.984922:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.984928:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7200/0x14b4f8542d4fc551 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6059f expref: 32 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.984933:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.984935:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065184.984938:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1187840->1294335] (req 1187840->1294335) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 24 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.984961:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7200/0x14b4f8542d4fc551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6059f expref: 32 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.984970:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7200/0x14b4f8542d4fc551 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6059f expref: 32 pid: 2462 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.984980:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327552:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065184.985395:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090022850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:31672:x1830881262980608:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 541us (923us total) trans 8589944145 rc 0/0 00000100:00100000:3.0:1746065184.985403:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4232 00010000:00010000:2.0:1746065184.985661:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065184.985670:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 7 pid: 9716 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065184.985678:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327680:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065184.985704:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7d6e00/0x14b4f8542d4fc520 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6058a expref: 24 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.985711:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7d6e00/0x14b4f8542d4fc520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6058a expref: 24 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065184.985718:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327808:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065184.985736:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801298b13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065184.989516:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.989548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.989651:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327552:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065184.989660:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327680:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065184.989665:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260327808:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065184.989696:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1187840->1294335] (req 1187840->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 24 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065184.989712:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba4800, rc 0) 00000100:00100000:2.0:1746065184.989747:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+24:31677:x1830881262980352:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4943us (5376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065184.989754:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14415 00000100:00100000:1.0:1746065184.990075:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262980864 00000100:00100000:1.0:1746065184.990081:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262980864 00010000:00010000:1.0:1746065184.990105:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7200/0x14b4f8542d4fc551 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6059f expref: 33 pid: 2462 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746065184.990130:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262980736 00000100:00100000:1.0:1746065184.990132:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262980736 00010000:00010000:1.0:1746065184.990141:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 8 pid: 9716 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746065184.990152:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7354 00000100:00100000:1.0:1746065184.990158:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881262980864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.990169:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.990185:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7200/0x14b4f8542d4fc551 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6059f expref: 33 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.990194:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7200/0x14b4f8542d4fc551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6059f expref: 33 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.990211:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d7200/0x14b4f8542d4fc551 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6059f expref: 33 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.990225:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.990241:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881262980864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.990246:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7354 00000100:00100000:1.0:1746065184.990281:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7355 00000100:00100000:1.0:1746065184.990285:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262980736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065184.990290:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065184.990296:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 8 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.990303:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 8 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.990313:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b2600/0x14b4f8542d4fc5c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605e5 expref: 8 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:1.0:1746065184.990321:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.990333:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881262980736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 48us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.990338:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7355 00000100:00100000:0.0:1746065184.990533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065184.990554:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262980992 00000100:00100000:0.0:1746065184.990556:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262980992 00010000:00010000:0.0:1746065184.990570:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7d6e00/0x14b4f8542d4fc520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6058a expref: 24 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065184.990585:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7356 00000100:00100000:0.0:1746065184.990591:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881262980992:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065184.990596:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065184.990604:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7d6e00/0x14b4f8542d4fc520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6058a expref: 24 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065184.990612:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7d6e00/0x14b4f8542d4fc520 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6058a expref: 24 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065184.990624:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7d6e00/0x14b4f8542d4fc520 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6058a expref: 24 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065184.990637:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065184.990638:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065184.990644:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 23 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.990651:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 23 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065184.990674:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 23 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065184.990683:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260327936:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065184.990729:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065184.992834:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260327936:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065184.992931:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065184.993873:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881262980992:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3276us (3335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065184.993888:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7356 00000100:00100000:0.0:1746065184.994069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065184.994188:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262981248 00000100:00100000:3.0:1746065184.994194:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262981248 00002000:00100000:3.0:1746065184.994371:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1187840->1191935) req@ffff8800a5881500 x1830881262981248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.994381:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881500 with x1830881262981248 ext(1187840->1191935) 00002000:00010000:3.0:1746065184.994385:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5881500 00000100:00100000:3.0:1746065184.994412:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8098 00000100:00100000:3.0:1746065184.994419:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262981248:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065184.994547:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262981248:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 129us (479us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065184.994553:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8098 00002000:00100000:3.0:1746065184.994557:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1187840->1191935) req@ffff8800a5881500 x1830881262981248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065184.994564:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881500 with x1830881262981248 ext(1187840->1191935) 00002000:00010000:3.0:1746065184.994566:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5881500 00010000:00010000:0.0:1746065184.998793:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065184.999368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065184.999472:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262981504 00000100:00100000:2.0:1746065184.999479:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262981504 00002000:00100000:2.0:1746065184.999517:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1290240->1294335) req@ffff8800a5881180 x1830881262981504/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/0 e 0 to 0 dl 1746065195 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.999530:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881180 with x1830881262981504 ext(1290240->1294335) 00002000:00010000:2.0:1746065184.999535:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5881180 00000100:00100000:2.0:1746065184.999683:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8099 00000100:00100000:2.0:1746065184.999692:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881262981504:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065184.999869:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881262981504:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 178us (505us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065184.999876:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8099 00002000:00100000:2.0:1746065184.999881:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1290240->1294335) req@ffff8800a5881180 x1830881262981504/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:100/0 lens 488/4536 e 0 to 0 dl 1746065195 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065184.999887:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881180 with x1830881262981504 ext(1290240->1294335) 00002000:00010000:2.0:1746065184.999890:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5881180 00000100:00100000:0.0:1746065185.002364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.002426:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262981760 00000100:00100000:3.0:1746065185.002433:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262981760 00000100:00100000:3.0:1746065185.002500:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4233 00000100:00100000:3.0:1746065185.002508:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+35:31677:x1830881262981760:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065185.002701:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+36:31677:x1830881262981760:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 193us (342us total) trans 8589944146 rc 0/0 00000100:00100000:3.0:1746065185.002708:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4233 00000100:00080000:1.0:1746065185.002914:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065185.098063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.099387:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262982016 00000100:00100000:3.0:1746065185.099396:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262982016 00000100:00100000:3.0:1746065185.099447:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9923 00000100:00100000:3.0:1746065185.099453:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:31683:x1830881262982016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.099472:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.099488:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be8a200/0x14b4f8542d4fc65b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60647 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.099575:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099585:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099593:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099605:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099609:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099614:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099697:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099703:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099709:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065185.099721:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065185.099782:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099797:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099802:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099807:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a61600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.099810:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099832:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099842:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065185.099844:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065185.099847:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099852:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc662 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099860:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099863:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099867:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099874:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b486400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.099876:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099880:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099885:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205400) 00010000:00010000:3.0:1746065185.099886:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065185.099888:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099892:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b486400/0x14b4f8542d4fc669 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.099923:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be8a200/0x14b4f8542d4fc65b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 279 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.099933:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 278 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.099939:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.099940:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065185.099942:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092775c00, rc 0) 00000100:00100000:3.0:1746065185.099987:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:31683:x1830881262982016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 534us (1929us total) trans 8589944147 rc 0/0 00000100:00100000:3.0:1746065185.099993:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9923 00000100:00080000:3.0:1746065185.100046:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065185.103354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.103379:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.103398:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262982272 00000100:00100000:0.0:1746065185.103404:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262982272 00000100:00100000:0.0:1746065185.103432:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14416 00000100:00100000:0.0:1746065185.103438:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881262982272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065185.103450:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.103463:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9000/0x14b4f8542d4fc67e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60655 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.103485:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9000/0x14b4f8542d4fc67e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60655 expref: 35 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.103494:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9000/0x14b4f8542d4fc67e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60655 expref: 35 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.103501:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc9000, rc 0) 00000100:00100000:0.0:1746065185.103534:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881262982272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 97us (187us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065185.103539:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14416 00000100:00100000:0.0:1746065185.103551:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262982144 00000100:00100000:0.0:1746065185.103553:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262982144 00000100:00100000:0.0:1746065185.103565:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14417 00000100:00100000:0.0:1746065185.103569:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881262982144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065185.103575:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.103582:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8e00/0x14b4f8542d4fc685 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6064e expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065185.103610:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260328064:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065185.103649:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b3c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746065185.112465:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065184 -> 1746065185 00000100:00100000:0.0:1746065185.116325:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260328064:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065185.116357:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8e00/0x14b4f8542d4fc685 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6064e expref: 33 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.116371:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8e00/0x14b4f8542d4fc685 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6064e expref: 33 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.116381:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc8e00, rc 0) 00000100:00100000:0.0:1746065185.116432:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881262982144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 12861us (13051us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065185.116440:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14417 00000100:00100000:0.0:1746065185.126209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.126242:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.126263:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262982528 00000100:00100000:0.0:1746065185.126269:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262982528 00000100:00100000:0.0:1746065185.126304:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9924 00000100:00100000:0.0:1746065185.126311:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:31685:x1830881262982528:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065185.126329:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.126342:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9e00/0x14b4f8542d4fc68c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6065c expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.126420:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.126432:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 35 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.126439:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 279 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.126444:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.126470:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 279 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.126480:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 279 pid: 14644 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.126490:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260328192:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.126560:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 35 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.126568:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 35 pid: 14644 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.126576:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260328320:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.126592:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.133949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.134010:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262982784 00000100:00100000:0.0:1746065185.134015:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262982784 00010000:00010000:0.0:1746065185.134042:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 280 pid: 14644 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.134063:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7357 00000100:00100000:0.0:1746065185.134074:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:1961:x1830881262982784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.134083:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065185.134088:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 280 pid: 14644 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.134097:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 280 pid: 14644 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.134114:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065185.134118:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.134125:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.134129:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.134156:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:1961:x1830881262982784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.134161:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7357 00000100:00100000:0.0:1746065185.134197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.134259:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262982912 00000100:00100000:0.0:1746065185.134262:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262982912 00010000:00010000:0.0:1746065185.134272:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 36 pid: 14644 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.134284:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7358 00000100:00100000:0.0:1746065185.134288:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+36:1961:x1830881262982912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.134293:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065185.134295:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 36 pid: 14644 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.134302:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 36 pid: 14644 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.134311:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065185.134313:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.134318:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.134324:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.134344:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.134361:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+36:1961:x1830881262982912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.134366:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7358 00010000:00010000:0.0:1746065185.134414:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092775c00/0x14b4f8542d4fc670 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60647 expref: 279 pid: 14644 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.134426:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260328192:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.134712:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73ce00/0x14b4f8542d4fc646 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60639 expref: 35 pid: 14644 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.134722:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260328320:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.134735:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.134745:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.134749:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065185.134763:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065185.134877:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9e00/0x14b4f8542d4fc68c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 280 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.134887:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 279 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.134892:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065185.134894:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065185.134896:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc9c00, rc 0) 00000100:00100000:0.0:1746065185.134914:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:31685:x1830881262982528:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8604us (8712us total) trans 8589944148 rc 0/0 00000100:00100000:0.0:1746065185.134919:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9924 00000100:00100000:0.0:1746065185.134960:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262982656 00000100:00100000:0.0:1746065185.134963:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262982656 00000100:00100000:0.0:1746065185.134979:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14418 00000100:00100000:0.0:1746065185.134983:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31683:x1830881262982656:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065185.134992:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.135001:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60663 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.135053:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.135059:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065185.135060:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065185.135062:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.135078:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.135087:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 22 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.135096:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260328448:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.135150:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.139486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.139532:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262983040 00000100:00100000:2.0:1746065185.139538:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262983040 00000100:00100000:0.0:1746065185.139544:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260328448:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.139565:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.139578:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc8000, rc 0) 00002000:00100000:2.0:1746065185.139579:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1187840->1294335) req@ffff88012f10dc00 x1830881262983040/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.139586:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f10dc00 with x1830881262983040 ext(1187840->1294335) 00010000:00010000:2.0:1746065185.139592:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.139602:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065185.139608:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f10dc00 00000100:00100000:0.0:1746065185.139609:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31683:x1830881262982656:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4625us (13367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.139615:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14418 00000100:00100000:2.0:1746065185.139622:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2467 00000100:00100000:2.0:1746065185.139628:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881262983040:12345-192.168.202.46@tcp:4:multiop.0 00000100:00080000:2.0:1746065185.139754:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065185.144983:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881262983040:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5347us (5494us total) trans 17179873588 rc 0/0 00000100:00100000:2.0:1746065185.144994:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2467 00002000:00100000:2.0:1746065185.145004:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1187840->1294335) req@ffff88012f10dc00 x1830881262983040/t17179873588(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.145013:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f10dc00 with x1830881262983040 ext(1187840->1294335) 00010000:00010000:2.0:1746065185.145021:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 25 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.145035:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 25 pid: 9716 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065185.145041:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f10dc00 00000100:00100000:0.0:1746065185.153450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.153580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.153600:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262983296 00000100:00100000:0.0:1746065185.153607:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262983296 00010000:00010000:0.0:1746065185.153633:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 25 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746065185.154679:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262983168 00000100:00100000:1.0:1746065185.154684:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262983168 00000100:00100000:1.0:1746065185.154726:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9925 00000100:00100000:1.0:1746065185.154732:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:31687:x1830881262983168:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065185.154748:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.154762:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda200/0x14b4f8542d4fc6a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6066a expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.154835:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.154846:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.154855:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.154864:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.154869:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.154874:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.154957:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.154965:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 278 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.154971:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.154995:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 278 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.155003:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 278 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746065185.155012:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260328576:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.155075:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00000100:00080000:2.0:1746065185.155115:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065185.156354:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7359 00000100:00100000:0.0:1746065185.156363:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881262983296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.156375:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065185.156394:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 25 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.156404:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 25 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.156420:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4800/0x14b4f8542d4fc654 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1187840->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60640 expref: 25 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.159701:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.159704:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.159715:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.159726:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.159775:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065185.159795:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f10e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260328704:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065185.159926:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.160214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.160245:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260328576:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.160260:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065185.160558:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262983424 00000100:00100000:0.0:1746065185.160564:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262983424 00010000:00010000:0.0:1746065185.160584:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 279 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.160605:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7360 00000100:00100000:0.0:1746065185.160612:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:1961:x1830881262983424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.160622:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065185.160626:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 279 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.160635:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 279 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.160651:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9fc9c00/0x14b4f8542d4fc693 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6065c expref: 279 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.160660:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065185.160663:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.160681:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.160686:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.160708:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065185.160727:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065185.160732:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:1961:x1830881262983424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 120us (519us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065185.160734:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065185.160737:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7360 00000004:00200000:2.0:1746065185.160771:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065185.160775:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065185.160797:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160806:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160854:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160861:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160867:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160871:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbdac00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065185.160874:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160880:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160888:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065185.160891:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065185.160894:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160898:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdac00/0x14b4f8542d4fc6af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160907:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160911:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160916:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160920:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbda600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065185.160922:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160925:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160931:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669200) 00010000:00010000:2.0:1746065185.160932:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065185.160935:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160939:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda600/0x14b4f8542d4fc6b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.160963:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbda200/0x14b4f8542d4fc6a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.160972:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.160978:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065185.160980:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065185.160982:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdaa00, rc 0) 00000100:00100000:2.0:1746065185.161052:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:31687:x1830881262983168:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6320us (7607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.161058:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9925 00000100:00100000:3.0:1746065185.163617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.163634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.163653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.163676:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262983552 00000100:00100000:3.0:1746065185.163682:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262983552 00000100:00100000:3.0:1746065185.163706:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262983680 00000100:00100000:3.0:1746065185.163708:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262983680 00000100:00080000:2.0:1746065185.163729:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065185.163731:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262983808 00000100:00100000:3.0:1746065185.163733:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262983808 00000100:00100000:2.0:1746065185.163741:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14419 00000100:00100000:2.0:1746065185.163747:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881262983552:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065185.163748:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14420 00000100:00100000:3.0:1746065185.163752:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881262983680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.163760:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.163760:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.163771:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fc6c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60678 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.163771:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60671 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.163796:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.163798:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.163801:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fc6c4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60678 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.163804:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.163809:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fc6c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60678 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.163827:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.163829:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54000, rc 0) 00010000:00010000:2.0:1746065185.163834:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fba5400, rc 0) 00000100:00100000:3.0:1746065185.163844:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14421 00000100:00100000:3.0:1746065185.163848:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881262983808:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.163853:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065185.163857:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881262983552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 111us (245us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065185.163859:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129b54200/0x14b4f8542d4fc6d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6067f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.163862:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14419 00000100:00100000:3.0:1746065185.163884:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260328832:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065185.163919:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.163922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.163930:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262984064 00000100:00100000:3.0:1746065185.163933:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262984064 00000100:00100000:3.0:1746065185.163947:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14422 00000100:00100000:3.0:1746065185.163951:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881262984064:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:2.0:1746065185.163952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065185.163957:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.163962:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60686 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.163971:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.163972:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.163976:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.163982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065185.163984:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.163991:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953fa000, rc 0) 00000100:00100000:2.0:1746065185.164004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.164006:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262984064:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 55us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.164010:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14422 00000100:00100000:3.0:1746065185.164018:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262984192 00000100:00100000:3.0:1746065185.164020:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262984192 00000100:00100000:3.0:1746065185.164034:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262984320 00000100:00100000:3.0:1746065185.164036:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262984320 00000100:00100000:3.0:1746065185.164045:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14423 00000100:00100000:2.0:1746065185.164046:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262984448 00000100:00100000:2.0:1746065185.164048:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262984448 00000100:00100000:3.0:1746065185.164049:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262984192:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065185.164054:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.164059:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4fc6e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6068d expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065185.164067:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f46b100 x1830881262984448/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065185.164070:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4fc6e0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6068d expref: 9 pid: 2462 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746065185.164074:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b100 with x1830881262984448 ext(1048576->2097151) 00010000:00010000:3.0:1746065185.164077:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090bb7e00/0x14b4f8542d4fc6e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6068d expref: 9 pid: 2462 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746065185.164078:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46b100 00010000:00010000:3.0:1746065185.164083:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090bb7e00, rc 0) 00000100:00100000:2.0:1746065185.164088:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8100 00000100:00100000:2.0:1746065185.164092:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262984448:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.164097:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262984192:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 48us (144us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065185.164101:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14423 00000100:00100000:3.0:1746065185.164109:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14424 00000100:00100000:3.0:1746065185.164112:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262984320:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065185.164117:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.164121:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc6e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60694 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.164137:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260328960:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065185.164154:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065185.164225:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881262983680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 472us (590us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065185.164230:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14420 00000100:00080000:2.0:1746065185.164837:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065185.165950:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f10e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260328704:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065185.165962:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.165986:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881262983296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9625us (12405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.165994:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7359 00002000:00010000:0.0:1746065185.168739:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065185 -> 1746065186 00000100:00100000:0.0:1746065185.168763:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260328832:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065185.168801:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129b54200/0x14b4f8542d4fc6d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6067f expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.168832:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129b54200/0x14b4f8542d4fc6d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6067f expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.168842:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54200, rc 0) 00000100:00100000:0.0:1746065185.168875:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881262983808:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5025us (5219us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065185.168882:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14421 00000100:00100000:0.0:1746065185.171234:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260328960:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065185.171258:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc6e7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60694 expref: 9 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.171275:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc6e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60694 expref: 9 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.171285:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54600, rc 0) 00000100:00100000:0.0:1746065185.171315:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262984320:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 7200us (7331us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065185.171322:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14424 00000100:00100000:0.0:1746065185.182929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.185906:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881262984448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21807us (21895us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065185.185919:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8100 00002000:00100000:3.0:1746065185.185928:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f46b100 x1830881262984448/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.185936:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b100 with x1830881262984448 ext(1048576->2097151) 00002000:00010000:3.0:1746065185.185940:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46b100 00000100:00100000:2.0:1746065185.187619:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262984704 00000100:00100000:2.0:1746065185.187628:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262984704 00000100:00100000:2.0:1746065185.191882:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9926 00000100:00100000:2.0:1746065185.191901:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:31687:x1830881262984704:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065185.191919:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.191934:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc6ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6069b expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.192015:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.192027:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.192033:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.192059:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.192068:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 14 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.192078:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260329088:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.193168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.195078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.195416:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262985088 00000100:00100000:1.0:1746065185.195423:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262985088 00010000:00010000:1.0:1746065185.195446:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 6/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 15 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746065185.195466:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7361 00000100:00100000:1.0:1746065185.195472:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1960:x1830881262985088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.195481:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.195486:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 6/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 15 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.195501:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 15 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.195518:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065185.195522:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.195529:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.195535:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.195545:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.195572:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1960:x1830881262985088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 100us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.195577:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7361 00000100:00100000:2.0:1746065185.195723:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262984960 00000100:00100000:2.0:1746065185.195727:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262984960 00002000:00100000:2.0:1746065185.195755:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fb13800 x1830881262984960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.195764:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13800 with x1830881262984960 ext(1048576->2097151) 00002000:00010000:2.0:1746065185.195769:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13800 00000100:00100000:2.0:1746065185.195780:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8101 00000100:00100000:2.0:1746065185.195795:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881262984960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065185.203956:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ade40 going to sleep for 11 seconds 00010000:00010000:2.0:1746065185.203993:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdaa00/0x14b4f8542d4fc6bd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6066a expref: 14 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.204009:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260329088:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.204023:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.204030:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.204035:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:2.0:1746065185.204050:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065185.204148:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdba00/0x14b4f8542d4fc6ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 15 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.204158:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.204165:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065185.204168:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065185.204170:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbdae00, rc 0) 00000100:00100000:2.0:1746065185.204214:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31687:x1830881262984704:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 12320us (21291us total) trans 8589944149 rc 0/0 00000100:00100000:2.0:1746065185.204222:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9926 00000100:00100000:0.0:1746065185.207381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.207448:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262985216 00000100:00100000:0.0:1746065185.207454:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262985216 00000100:00100000:0.0:1746065185.207482:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14425 00000100:00100000:0.0:1746065185.207489:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31683:x1830881262985216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065185.207502:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.207514:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606a2 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.207534:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.207535:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.207541:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.207553:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.207566:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc9200, rc 0) 00000100:00100000:0.0:1746065185.207602:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31683:x1830881262985216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.207608:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14425 00000100:00100000:3.0:1746065185.210218:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881262984960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14428us (17046us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065185.210227:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8101 00002000:00100000:3.0:1746065185.210236:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fb13800 x1830881262984960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.210402:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13800 with x1830881262984960 ext(1048576->2097151) 00002000:00010000:3.0:1746065185.210407:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13800 00000100:00100000:3.0:1746065185.210460:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.210618:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262985344 00000100:00100000:2.0:1746065185.210625:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262985344 00000100:00100000:2.0:1746065185.210668:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9927 00000100:00100000:2.0:1746065185.210674:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31687:x1830881262985344:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065185.210688:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.210701:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fc70a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606a9 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.210768:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.210779:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 15 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.210796:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.210838:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 15 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.210848:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 15 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.210858:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260329216:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.210908:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.216839:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260329216:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.217442:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065185.220059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.220089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.220276:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262985600 00000100:00100000:2.0:1746065185.220284:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262985600 00002000:00100000:2.0:1746065185.220316:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094d97480 x1830881262985600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.220326:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97480 with x1830881262985600 ext(2097152->3145727) 00002000:00010000:2.0:1746065185.220336:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97480 00000100:00100000:2.0:1746065185.220353:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8102 00000100:00100000:2.0:1746065185.220360:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262985600:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.220478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.220498:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262985728 00000100:00100000:3.0:1746065185.220501:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262985728 00000100:00100000:0.0:1746065185.220518:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262985984 00010000:00010000:3.0:1746065185.220519:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 16 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.220521:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262985984 00002000:00100000:0.0:1746065185.220536:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009baa0a80 x1830881262985984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065185.220537:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7362 00000100:00100000:3.0:1746065185.220541:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:1961:x1830881262985728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746065185.220544:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0a80 with x1830881262985984 ext(2097152->3145727) 00002000:00010000:0.0:1746065185.220547:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0a80 00010000:00010000:3.0:1746065185.220550:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065185.220556:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 16 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.220556:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8103 00000100:00100000:0.0:1746065185.220560:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881262985984:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065185.220566:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 16 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.220582:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbdae00/0x14b4f8542d4fc6f5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6069b expref: 16 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.220593:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.220597:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.220605:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.220610:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.220626:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.220658:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881262985728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 115us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.220663:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7362 00010000:00010000:3.0:1746065185.220685:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.220691:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065185.220721:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065185.220725:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065185.220736:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.220761:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fc70a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 15 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.220771:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.220777:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.220779:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065185.220781:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cd400, rc 0) 00000100:00100000:3.0:1746065185.220828:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31687:x1830881262985344:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 10141us (10355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.220834:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9927 00000100:00100000:3.0:1746065185.229525:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.229553:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262986368 00000100:00100000:3.0:1746065185.229561:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262986368 00000100:00100000:3.0:1746065185.229595:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9928 00000100:00100000:3.0:1746065185.229602:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+35:31691:x1830881262986368:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065185.229620:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.229635:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b19c00/0x14b4f8542d4fc718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606b7 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.229714:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.229727:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.229733:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.229758:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.229768:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 13 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065185.229778:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260329344:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.231161:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.231997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.232052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.232069:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262986112 00000100:00100000:0.0:1746065185.232074:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262986112 00000100:00100000:0.0:1746065185.232099:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262986496 00000100:00100000:0.0:1746065185.232101:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262986496 00000100:00100000:0.0:1746065185.232113:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14426 00000100:00100000:0.0:1746065185.232119:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262986112:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065185.232131:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.232143:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc8c00/0x14b4f8542d4fc726 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606b0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.232166:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc8c00/0x14b4f8542d4fc726 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b0 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.232176:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc8c00/0x14b4f8542d4fc726 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b0 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.232183:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc8c00, rc 0) 00000100:00100000:0.0:1746065185.232580:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14427 00000100:00100000:0.0:1746065185.232586:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262986496:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065185.232593:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.232602:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc9000/0x14b4f8542d4fc72d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606be expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065185.232633:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260329472:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065185.232679:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.232735:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262986112:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 615us (741us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065185.232740:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14426 00000100:00100000:0.0:1746065185.240274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.240316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.240335:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262986624 00000100:00100000:0.0:1746065185.240342:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262986624 00000100:00100000:0.0:1746065185.240367:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262986752 00000100:00100000:0.0:1746065185.240368:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262986752 00000100:00100000:0.0:1746065185.240383:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14428 00000100:00100000:0.0:1746065185.240389:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881262986624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065185.240403:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.240417:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9600/0x14b4f8542d4fc734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606c5 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.240442:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9600/0x14b4f8542d4fc734 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606c5 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.240450:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9600/0x14b4f8542d4fc734 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606c5 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.240458:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc9600, rc 0) 00000100:00100000:0.0:1746065185.240487:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881262986624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 98us (221us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065185.240492:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14428 00000100:00100000:0.0:1746065185.240505:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14429 00000100:00100000:0.0:1746065185.240509:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881262986752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065185.240514:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.240521:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8600/0x14b4f8542d4fc73b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606cc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065185.240547:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260329600:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065185.240579:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.241087:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881262985600:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20726us (21441us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065185.241094:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8102 00002000:00100000:0.0:1746065185.241102:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094d97480 x1830881262985600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065185.241115:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97480 with x1830881262985600 ext(2097152->3145727) 00002000:00010000:0.0:1746065185.241118:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97480 00000100:00100000:2.0:1746065185.246018:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881262985984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25450us (25534us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.246028:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8103 00002000:00100000:2.0:1746065185.246038:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009baa0a80 x1830881262985984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.246046:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0a80 with x1830881262985984 ext(2097152->3145727) 00002000:00010000:2.0:1746065185.246050:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0a80 00000100:00100000:3.0:1746065185.247640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.248850:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260329472:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065185.248875:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc9000/0x14b4f8542d4fc72d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606be expref: 9 pid: 2462 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065185.248878:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260329344:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.248887:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc9000/0x14b4f8542d4fc72d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606be expref: 9 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.248891:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.248895:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc9000, rc 0) 00000100:00100000:3.0:1746065185.248909:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262986880 00000100:00100000:3.0:1746065185.248914:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262986880 00000100:00100000:0.0:1746065185.248930:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881262986496:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 16344us (16878us total) trans 0 rc 301/301 00010000:00010000:3.0:1746065185.248934:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 14 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.248937:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14427 00000100:00100000:3.0:1746065185.248963:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7363 00000100:00100000:3.0:1746065185.248969:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1959:x1830881262986880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065185.248976:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260329600:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065185.248977:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065185.248982:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 14 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.248988:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8600/0x14b4f8542d4fc73b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606cc expref: 26 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.248990:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 14 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.248995:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8600/0x14b4f8542d4fc73b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606cc expref: 26 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.249002:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc8600, rc 0) 00010000:00010000:3.0:1746065185.249008:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fc711 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a9 expref: 14 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.249015:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881262986752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8506us (8699us total) trans 0 rc 301/301 00010000:00010000:3.0:1746065185.249016:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.249020:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065185.249020:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14429 00010000:00010000:3.0:1746065185.249027:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.249032:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.249045:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.249056:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1959:x1830881262986880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 89us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.249061:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7363 00010000:00010000:3.0:1746065185.249077:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.249081:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065185.249094:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065185.249193:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b19c00/0x14b4f8542d4fc718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 38 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.249204:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 37 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.249214:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.249216:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065185.249218:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b18200, rc 0) 00000100:00100000:3.0:1746065185.249237:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+37:31691:x1830881262986368:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 19636us (19718us total) trans 8589944150 rc 0/0 00000100:00100000:3.0:1746065185.249243:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9928 00000001:00080000:1.0:1746065185.254775:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840837 is committed 00000001:00080000:1.0:1746065185.254801:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840794 is committed 00000001:00080000:1.0:1746065185.254838:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840855 is committed 00000001:00080000:1.0:1746065185.254860:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840818 is committed 00000001:00080000:1.0:1746065185.254874:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840856 is committed 00000001:00080000:1.0:1746065185.254892:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840844 is committed 00000001:00080000:1.0:1746065185.254938:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840857 is committed 00000001:00080000:1.0:1746065185.254955:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840846 is committed 00000100:00100000:3.0:1746065185.255887:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.256221:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262987008 00000100:00100000:2.0:1746065185.256229:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262987008 00000100:00100000:2.0:1746065185.256265:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9929 00000100:00100000:2.0:1746065185.256272:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:31687:x1830881262987008:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065185.256288:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.256302:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13a00/0x14b4f8542d4fc749 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606d3 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.256747:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13a00/0x14b4f8542d4fc749 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606d3 expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.256759:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13a00/0x14b4f8542d4fc749 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606d3 expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.256933:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065185.256936:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065185.256939:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe13a00, rc 0) 00000100:00100000:2.0:1746065185.256976:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31687:x1830881262987008:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 704us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.256981:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9929 00000100:00100000:3.0:1746065185.258862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.259057:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262987264 00000100:00100000:2.0:1746065185.259064:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262987264 00000100:00100000:3.0:1746065185.259530:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9930 00000100:00100000:3.0:1746065185.259538:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31687:x1830881262987264:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065185.259553:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.259568:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4fc750 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606da expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065185.259628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065185.259637:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.259649:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 36 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.259656:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.259680:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 36 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.259689:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 36 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065185.259699:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260329728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.259754:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.259813:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262987392 00000100:00100000:1.0:1746065185.259831:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262987392 00000100:00100000:1.0:1746065185.259856:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14430 00000100:00100000:1.0:1746065185.259861:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:31689:x1830881262987392:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065185.259869:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.259878:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606e1 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.259893:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.259895:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.259901:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 9 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.259911:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 9 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.259920:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953d3600, rc 0) 00000100:00100000:1.0:1746065185.259940:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:31689:x1830881262987392:12345-192.168.202.46@tcp:101:cat.0 Request processed in 79us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.259945:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14430 00000001:00080000:2.0:1746065185.260135:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873543 is committed 00000001:00080000:2.0:1746065185.260148:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873587 is committed 00000001:00080000:2.0:1746065185.260154:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873578 is committed 00000001:00080000:2.0:1746065185.260178:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873552 is committed 00000001:00080000:2.0:1746065185.260196:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873586 is committed 00000100:00100000:0.0:1746065185.265307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.265364:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262987520 00000100:00100000:2.0:1746065185.265372:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262987520 00000100:00100000:2.0:1746065185.265403:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14431 00000100:00100000:2.0:1746065185.265410:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:31683:x1830881262987520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.265424:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.265442:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606e8 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.265472:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.265479:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.265480:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.265483:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.265506:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.265514:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 16 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.265524:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260329856:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.265587:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.267459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.267524:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262987648 00000100:00100000:2.0:1746065185.267530:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262987648 00010000:00010000:2.0:1746065185.267552:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 37 pid: 14645 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065185.267568:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260329728:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.267583:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7364 00000100:00100000:2.0:1746065185.267588:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+37:1959:x1830881262987648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.267599:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.267604:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 37 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.267617:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 37 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.267631:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b18200/0x14b4f8542d4fc71f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606b7 expref: 37 pid: 14645 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.267643:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065185.267647:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065185.267655:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065185.267660:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065185.267672:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.267697:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+36:1959:x1830881262987648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.267702:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7364 00010000:00010000:3.0:1746065185.267808:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267833:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267838:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267852:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267857:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267861:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267866:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a60a3c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.267869:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267874:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267881:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.267883:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065185.267886:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267891:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3c00/0x14b4f8542d4fc757 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.267922:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4fc750 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606da expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.267929:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a3a00/0x14b4f8542d4fc750 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606da expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.267936:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a3a00, rc 0) 00000100:00100000:3.0:1746065185.268393:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31687:x1830881262987264:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 8852us (9532us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065185.268400:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9930 00000100:00100000:2.0:1746065185.274950:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260329856:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.274957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065185.274978:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.274993:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe12e00, rc 0) 00000100:00100000:2.0:1746065185.275029:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:31683:x1830881262987520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9618us (9731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.275034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.275036:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14431 00000100:00100000:0.0:1746065185.275096:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262987904 00000100:00100000:0.0:1746065185.275102:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262987904 00000100:00100000:0.0:1746065185.275146:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4234 00000100:00100000:0.0:1746065185.275152:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31687:x1830881262987904:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:3.0:1746065185.275246:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262988032 00000100:00100000:3.0:1746065185.275253:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262988032 00002000:00100000:3.0:1746065185.275286:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4145152->4194303) req@ffff88009a4ea680 x1830881262988032/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.275295:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ea680 with x1830881262988032 ext(4145152->4194303) 00010000:00010000:3.0:1746065185.275302:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 16 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.275310:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:31687:x1830881262987904:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 158us (353us total) trans 8589944151 rc 0/0 00010000:00010000:3.0:1746065185.275315:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 16 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:0.0:1746065185.275316:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4234 00002000:00010000:3.0:1746065185.275322:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4ea680 00000100:00100000:3.0:1746065185.275353:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2468 00000100:00100000:3.0:1746065185.275360:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881262988032:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065185.276161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.276441:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262988288 00000100:00100000:2.0:1746065185.276445:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262988288 00002000:00100000:2.0:1746065185.276461:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009a4e9180 x1830881262988288/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.276468:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9180 with x1830881262988288 ext(2097152->3145727) 00002000:00010000:2.0:1746065185.276472:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e9180 00000100:00100000:2.0:1746065185.276491:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8104 00000100:00100000:2.0:1746065185.276495:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881262988288:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.281267:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881262988032:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5899us (6223us total) trans 21474840858 rc 0/0 00000100:00100000:3.0:1746065185.281278:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2468 00002000:00100000:3.0:1746065185.281286:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4145152->4194303) req@ffff88009a4ea680 x1830881262988032/t21474840858(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.281294:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ea680 with x1830881262988032 ext(4145152->4194303) 00010000:00010000:3.0:1746065185.281302:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.281315:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065185.281321:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4ea680 00000100:00100000:2.0:1746065185.284267:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881262988288:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7761us (8097us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.284277:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8104 00002000:00100000:2.0:1746065185.284288:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009a4e9180 x1830881262988288/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.284295:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9180 with x1830881262988288 ext(2097152->3145727) 00002000:00010000:2.0:1746065185.284300:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e9180 00000100:00100000:0.0:1746065185.288555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.288606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.288686:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262988544 00000100:00100000:2.0:1746065185.288693:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262988544 00000100:00100000:2.0:1746065185.288736:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14432 00000100:00100000:2.0:1746065185.288742:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+9:31689:x1830881262988544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.288757:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.288771:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606ef expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.288807:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.288851:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.288853:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.288856:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.288881:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 20 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.288891:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 20 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.288901:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260329984:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.288959:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065185.289190:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262988416 00000100:00100000:3.0:1746065185.289194:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262988416 00010000:00010000:3.0:1746065185.289212:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065185.289234:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7365 00000100:00100000:3.0:1746065185.289239:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881262988416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.289246:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065185.289261:0:7079:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065185 -> 1746065186 00002000:00010000:3.0:1746065185.289263:0:7079:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5729 -> 5771 00010000:00010000:3.0:1746065185.289268:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.289277:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.289293:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4e00/0x14b4f8542d4fc60e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4145152->4194303] (req 4145152->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60616 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.289304:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.289305:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.289310:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 17 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.289317:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 17 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.289336:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 17 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.289343:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260330112:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065185.289811:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e15ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.291131:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260329984:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.291155:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.291167:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b55200, rc 0) 00000100:00100000:2.0:1746065185.291208:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:31689:x1830881262988544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2465us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.291214:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14432 00000100:00100000:0.0:1746065185.291769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.292238:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262988672 00000100:00100000:2.0:1746065185.292243:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262988672 00002000:00100000:2.0:1746065185.292272:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3665919) req@ffff88009ba3f480 x1830881262988672/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.292285:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f480 with x1830881262988672 ext(3145728->3665919) 00010000:00010000:2.0:1746065185.292291:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 21 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.292301:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 21 pid: 9716 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065185.292308:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba3f480 00000100:00100000:2.0:1746065185.292799:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2469 00000100:00100000:2.0:1746065185.292805:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262988672:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065185.306603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.306706:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260330112:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065185.306725:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.306761:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881262988416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 17520us (18154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.306771:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7365 00000100:00100000:3.0:1746065185.306838:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262988928 00000100:00100000:3.0:1746065185.306845:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262988928 00002000:00100000:3.0:1746065185.306873:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fc5ad80 x1830881262988928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.306882:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5ad80 with x1830881262988928 ext(3145728->4194303) 00002000:00010000:3.0:1746065185.306886:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5ad80 00000100:00100000:3.0:1746065185.306906:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8105 00000100:00100000:3.0:1746065185.306913:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881262988928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065185.309414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.310007:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262989056 00000100:00100000:2.0:1746065185.310014:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262989056 00000100:00100000:2.0:1746065185.310056:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14433 00000100:00100000:2.0:1746065185.310063:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:31691:x1830881262989056:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065185.310082:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.310096:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606f6 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.310126:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.311626:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.311632:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.311637:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.311639:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.311641:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1409024->1798143] (req 1409024->1798143) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.311668:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.311676:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 11 pid: 9716 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065185.311945:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260330240:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.312466:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 7 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.312476:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 7 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065185.312486:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260330368:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.312514:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.312522:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 22 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.312535:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260330496:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.312553:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.316549:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881262988672:12345-192.168.202.46@tcp:4:cat.0 Request processed in 23735us (24773us total) trans 17179873589 rc 0/0 00000100:00100000:2.0:1746065185.316560:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2469 00002000:00100000:2.0:1746065185.316570:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3665919) req@ffff88009ba3f480 x1830881262988672/t17179873589(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.316579:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f480 with x1830881262988672 ext(3145728->3665919) 00010000:00010000:2.0:1746065185.316587:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.316599:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065185.316605:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba3f480 00000100:00100000:2.0:1746065185.317287:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260330240:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.317297:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260330368:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.317303:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260330496:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.317330:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1409024->1798143] (req 1409024->1798143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.317343:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b55e00, rc 0) 00000100:00100000:2.0:1746065185.317375:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:31691:x1830881262989056:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7312us (7967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.317381:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14433 00000100:00100000:0.0:1746065185.322181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.322398:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262989440 00000100:00100000:2.0:1746065185.322405:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262989440 00010000:00010000:2.0:1746065185.322434:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 11 pid: 9716 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065185.322570:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7366 00000100:00100000:2.0:1746065185.322577:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881262989440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.322587:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065185.322602:0:7079:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:2.0:1746065185.322607:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 11 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.322616:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 11 pid: 9716 timeout: 884 lvb_type: 1 00000100:00100000:0.0:1746065185.322625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065185.322635:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f73c800/0x14b4f8542d4fc50b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60575 expref: 11 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.322650:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.322683:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881262989440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.322689:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7366 00000100:00100000:2.0:1746065185.322928:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262989184 00000100:00100000:2.0:1746065185.322931:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262989184 00010000:00010000:2.0:1746065185.322943:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 8 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065185.322961:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7367 00000100:00100000:2.0:1746065185.322966:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881262989184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.322972:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.322979:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 8 pid: 25185 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.322986:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 8 pid: 25185 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.322996:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fba4000/0x14b4f8542d4fc5cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ec expref: 8 pid: 25185 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.323004:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.323018:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881262989184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.323023:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7367 00000100:00100000:3.0:1746065185.323404:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881262988928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16491us (16808us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065185.323419:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8105 00002000:00100000:3.0:1746065185.323426:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fc5ad80 x1830881262988928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.323705:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5ad80 with x1830881262988928 ext(3145728->4194303) 00002000:00010000:3.0:1746065185.323709:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5ad80 00000100:00100000:0.0:1746065185.324899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.325043:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262989312 00000100:00100000:2.0:1746065185.325049:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262989312 00010000:00010000:2.0:1746065185.325071:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.325103:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7368 00000100:00100000:2.0:1746065185.325109:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881262989312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.325117:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.325132:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.325142:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.325159:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cc4ce00/0x14b4f8542d4fc494 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60552 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.325169:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.325171:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.325177:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.325184:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.325210:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.325220:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260330624:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.325289:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.329108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.329150:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262989568 00000100:00100000:1.0:1746065185.329158:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262989568 00010000:00010000:1.0:1746065185.329190:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746065185.329225:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7369 00000100:00100000:1.0:1746065185.329233:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881262989568:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.329243:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.329262:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.329273:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.329294:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fba5000/0x14b4f8542d4fc62a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60632 expref: 23 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.330112:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.330115:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.330122:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.330130:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.330163:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.330174:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260330752:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065185.330244:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.331765:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.331891:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260330624:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065185.331907:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.331935:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262989312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6825us (7039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.331944:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7368 00000100:00100000:2.0:1746065185.332018:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262989696 00000100:00100000:2.0:1746065185.332023:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262989696 00000100:00100000:1.0:1746065185.332049:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260330752:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065185.332059:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.332063:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14434 00000100:00100000:2.0:1746065185.332069:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31683:x1830881262989696:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065185.332073:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262989568:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2841us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.332078:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7369 00010000:00010000:2.0:1746065185.332080:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.332093:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e606fd expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.332118:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.332119:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.332130:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.332141:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.332148:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54600, rc 0) 00000100:00100000:2.0:1746065185.332168:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31683:x1830881262989696:12345-192.168.202.46@tcp:101:cat.0 Request processed in 99us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.332173:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14434 00000100:00100000:0.0:1746065185.333083:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.333253:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262989952 00000100:00100000:3.0:1746065185.333257:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262989952 00002000:00100000:3.0:1746065185.333280:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1409024->1413119) req@ffff880094a13800 x1830881262989952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.333288:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13800 with x1830881262989952 ext(1409024->1413119) 00002000:00010000:3.0:1746065185.333293:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13800 00000100:00100000:3.0:1746065185.333315:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8106 00000100:00100000:3.0:1746065185.333321:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881262989952:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065185.333479:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881262989952:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 157us (398us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065185.333485:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8106 00002000:00100000:3.0:1746065185.333490:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1409024->1413119) req@ffff880094a13800 x1830881262989952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.333496:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13800 with x1830881262989952 ext(1409024->1413119) 00002000:00010000:3.0:1746065185.333499:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13800 00000100:00100000:0.0:1746065185.334442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.335685:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262990208 00000100:00100000:3.0:1746065185.335692:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262990208 00002000:00100000:3.0:1746065185.335720:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a10a80 x1830881262990208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.335727:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10a80 with x1830881262990208 ext(2097152->3145727) 00002000:00010000:3.0:1746065185.335731:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10a80 00000100:00100000:3.0:1746065185.335761:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8107 00000100:00100000:3.0:1746065185.335767:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262990208:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065185.340019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.340234:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262990464 00000100:00100000:1.0:1746065185.340242:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262990464 00002000:00100000:1.0:1746065185.340276:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a10e00 x1830881262990464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.340285:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10e00 with x1830881262990464 ext(3145728->4194303) 00002000:00010000:1.0:1746065185.340290:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10e00 00000100:00100000:1.0:1746065185.340307:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8108 00000100:00100000:1.0:1746065185.340313:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262990464:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065185.348426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.348568:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262990720 00000100:00100000:2.0:1746065185.348576:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262990720 00002000:00100000:2.0:1746065185.348616:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1794048->1798143) req@ffff880094a11880 x1830881262990720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.348625:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881262990720 ext(1794048->1798143) 00002000:00010000:2.0:1746065185.348629:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11880 00000100:00100000:2.0:1746065185.348648:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8109 00000100:00100000:2.0:1746065185.348655:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262990720:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065185.348793:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881262990720:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 128us (365us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065185.348799:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8109 00002000:00100000:2.0:1746065185.348805:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1794048->1798143) req@ffff880094a11880 x1830881262990720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.348812:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881262990720 ext(1794048->1798143) 00002000:00010000:2.0:1746065185.348829:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11880 00000100:00100000:3.0:1746065185.349039:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262990208:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13271us (14599us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065185.349047:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8107 00002000:00100000:3.0:1746065185.349052:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a10a80 x1830881262990208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.349063:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10a80 with x1830881262990208 ext(2097152->3145727) 00002000:00010000:3.0:1746065185.349067:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10a80 00000100:00100000:0.0:1746065185.351737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.351844:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262990848 00000100:00100000:3.0:1746065185.351852:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262990848 00000100:00100000:3.0:1746065185.351902:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14435 00000100:00100000:3.0:1746065185.351909:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:31685:x1830881262990848:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065185.351926:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.351940:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60704 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.351966:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 18 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.351973:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.351974:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.351977:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.352001:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 18 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.352011:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065185.352022:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260330880:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.352100:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.353126:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262990464:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12810us (13137us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065185.353134:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8108 00002000:00100000:1.0:1746065185.353142:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a10e00 x1830881262990464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.353150:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10e00 with x1830881262990464 ext(3145728->4194303) 00002000:00010000:1.0:1746065185.353154:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10e00 00000100:00100000:2.0:1746065185.354129:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260330880:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.354150:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.354163:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25d000, rc 0) 00000100:00100000:2.0:1746065185.354184:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:31685:x1830881262990848:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2276us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.354190:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14435 00000100:00100000:0.0:1746065185.355961:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.356104:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262990976 00000100:00100000:2.0:1746065185.356111:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262990976 00000100:00100000:2.0:1746065185.356173:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14436 00000100:00100000:2.0:1746065185.356180:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881262990976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.356192:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.356205:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fc788 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6070b expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.356245:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260331008:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065185.356564:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.357061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.357110:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262991104 00000100:00100000:2.0:1746065185.357113:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262991104 00000100:00100000:2.0:1746065185.357213:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14437 00000100:00100000:2.0:1746065185.357219:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+9:31689:x1830881262991104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.357230:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.357239:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60712 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.357252:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.357257:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.357263:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.357266:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.357285:0:2462:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.357296:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.357304:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c66200, rc 0) 00000100:00100000:2.0:1746065185.357337:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:31689:x1830881262991104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.357342:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14437 00002000:00010000:2.0:1746065185.358242:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime: 1746065185 -> 1746065186 00002000:00010000:2.0:1746065185.358246:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime: 1746065185 -> 1746065186 00002000:00010000:2.0:1746065185.358248:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime: 1746065185 -> 1746065186 00000100:00100000:2.0:1746065185.358263:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260331008:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065185.358279:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fc788 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6070b expref: 23 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.358294:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fc788 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6070b expref: 23 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.358306:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c67200, rc 0) 00000100:00100000:2.0:1746065185.358335:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881262990976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2155us (2380us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065185.358341:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14436 00000100:00100000:0.0:1746065185.359007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.359058:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262991360 00000100:00100000:2.0:1746065185.359063:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262991360 00000100:00100000:2.0:1746065185.359085:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4235 00000100:00100000:2.0:1746065185.359090:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+36:31691:x1830881262991360:12345-192.168.202.46@tcp:35:multiop.0 00000001:00080000:2.0:1746065185.359625:0:14647:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589944152 00000100:00100000:2.0:1746065185.359905:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+38:31691:x1830881262991360:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 813us (898us total) trans 8589944153 rc 0/0 00000100:00100000:2.0:1746065185.359911:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4235 00000020:00080000:2.0:1746065185.359914:0:14647:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746065185.360169:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.360361:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262991488 00000100:00100000:2.0:1746065185.360365:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262991488 00010000:00010000:2.0:1746065185.360384:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.360411:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7370 00000100:00100000:2.0:1746065185.360415:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881262991488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.360424:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.360439:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.360448:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.360464:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fc765 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e8 expref: 18 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.360474:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.360476:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.360481:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.360488:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.360603:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.360613:0:7080:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.360697:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260331264:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.360981:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.363542:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260331264:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065185.363559:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.363601:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881262991488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3184us (3431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.363610:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7370 00000100:00100000:0.0:1746065185.364188:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.364215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.364231:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262991744 00000100:00100000:0.0:1746065185.364236:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262991744 00002000:00100000:0.0:1746065185.364268:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3272704->3276799) req@ffff88009c7adc00 x1830881262991744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065185.364276:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7adc00 with x1830881262991744 ext(3272704->3276799) 00010000:00010000:0.0:1746065185.364284:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.364294:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00002000:00010000:0.0:1746065185.364301:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7adc00 00000100:00100000:0.0:1746065185.364501:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262992000 00000100:00100000:0.0:1746065185.364504:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262992000 00002000:00100000:0.0:1746065185.364517:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5009407) req@ffff88009c7afb80 x1830881262992000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065185.364523:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7afb80 with x1830881262992000 ext(4194304->5009407) 00002000:00010000:0.0:1746065185.364526:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7afb80 00000100:00100000:1.0:1746065185.364576:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2470 00000100:00100000:1.0:1746065185.364584:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881262991744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065185.364698:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881262991744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 116us (512us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065185.364703:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2470 00002000:00100000:1.0:1746065185.364707:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3272704->3276799) req@ffff88009c7adc00 x1830881262991744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.364713:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7adc00 with x1830881262991744 ext(3272704->3276799) 00010000:00010000:1.0:1746065185.364717:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 18 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.364726:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 18 pid: 25185 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065185.364730:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7adc00 00000100:00100000:1.0:1746065185.364743:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8110 00000100:00100000:1.0:1746065185.364746:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881262992000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065185.374562:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881262992000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9806us (10338us total) trans 0 rc 815104/815104 00000100:00100000:1.0:1746065185.374572:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8110 00002000:00100000:1.0:1746065185.374581:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5009407) req@ffff88009c7afb80 x1830881262992000/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.374590:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7afb80 with x1830881262992000 ext(4194304->5009407) 00002000:00010000:1.0:1746065185.374595:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7afb80 00000100:00100000:0.0:1746065185.377879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.377946:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262992256 00000100:00100000:1.0:1746065185.377954:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262992256 00002000:00100000:1.0:1746065185.377995:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4190208->4194303) req@ffff88009c7af480 x1830881262992256/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.378024:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af480 with x1830881262992256 ext(4190208->4194303) 00010000:00010000:1.0:1746065185.378033:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.378043:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065185.378054:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7af480 00000100:00100000:1.0:1746065185.378083:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2471 00000100:00100000:1.0:1746065185.378091:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881262992256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065185.379181:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881262992256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1088us (1305us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065185.379187:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2471 00002000:00100000:1.0:1746065185.379193:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4190208->4194303) req@ffff88009c7af480 x1830881262992256/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.379200:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af480 with x1830881262992256 ext(4190208->4194303) 00010000:00010000:1.0:1746065185.379205:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.379215:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065185.379220:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7af480 00000100:00100000:0.0:1746065185.379502:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.379554:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262992384 00000100:00100000:3.0:1746065185.379559:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262992384 00000100:00100000:0.0:1746065185.379571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.380061:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262992512 00000100:00100000:3.0:1746065185.380064:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262992512 00000100:00100000:3.0:1746065185.380079:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14438 00000100:00100000:3.0:1746065185.380085:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881262992384:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065185.380091:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14439 00010000:00010000:3.0:1746065185.380096:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065185.380099:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881262992512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065185.380106:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.380107:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c25ce00/0x14b4f8542d4fc796 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60719 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.380115:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc8600/0x14b4f8542d4fc79d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60720 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.380132:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc8600/0x14b4f8542d4fc79d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60720 expref: 18 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.380140:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc8600/0x14b4f8542d4fc79d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60720 expref: 18 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065185.380148:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260331392:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065185.380152:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9fc8600, rc 0) 00000100:00100000:0.0:1746065185.380180:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881262992512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 82us (608us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065185.380185:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14439 00000100:00100000:3.0:1746065185.380194:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.382541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.382553:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260331392:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065185.382575:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c25ce00/0x14b4f8542d4fc796 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60719 expref: 23 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.382586:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c25ce00/0x14b4f8542d4fc796 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60719 expref: 23 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.382589:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262993024 00000100:00100000:2.0:1746065185.382595:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262993024 00010000:00010000:3.0:1746065185.382608:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25ce00, rc 0) 00000100:00100000:3.0:1746065185.382634:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881262992384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2550us (3134us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065185.382637:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4236 00000100:00100000:3.0:1746065185.382640:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14438 00000100:00100000:2.0:1746065185.382643:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:31685:x1830881262993024:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065185.382908:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:31685:x1830881262993024:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 264us (372us total) trans 8589944154 rc 0/0 00000100:00100000:2.0:1746065185.382914:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4236 00000100:00100000:0.0:1746065185.383519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.383907:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262992768 00000100:00100000:1.0:1746065185.383912:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262992768 00002000:00100000:1.0:1746065185.383938:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3272704->4194303) req@ffff88009fa74380 x1830881262992768/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.383947:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74380 with x1830881262992768 ext(3272704->4194303) 00010000:00010000:1.0:1746065185.383953:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.383968:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065185.383974:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa74380 00000100:00100000:1.0:1746065185.383998:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2472 00000100:00100000:1.0:1746065185.384004:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881262992768:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065185.387298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.387339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.387420:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262993280 00000100:00100000:2.0:1746065185.387428:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262993280 00000100:00100000:2.0:1746065185.387458:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262993152 00000100:00100000:2.0:1746065185.387460:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262993152 00000100:00100000:2.0:1746065185.387473:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14440 00000100:00100000:2.0:1746065185.387479:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881262993280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.387494:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.387508:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a38a400/0x14b4f8542d4fc7a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6072e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.387534:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a38a400/0x14b4f8542d4fc7a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6072e expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.387543:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a38a400/0x14b4f8542d4fc7a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6072e expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.387551:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38a400, rc 0) 00000100:00100000:2.0:1746065185.387583:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881262993280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 104us (292us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065185.387588:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14440 00000100:00100000:2.0:1746065185.387601:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14441 00000100:00100000:2.0:1746065185.387606:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881262993152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.387612:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.387619:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc7ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60727 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.387650:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260331520:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065185.387697:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.389708:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260331520:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065185.389732:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc7ab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60727 expref: 23 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.389743:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc7ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60727 expref: 23 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.389752:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38ba00, rc 0) 00000100:00100000:2.0:1746065185.389779:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881262993152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2172us (2440us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065185.389796:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14441 00000100:00100000:0.0:1746065185.395773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.395848:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262993536 00000100:00100000:2.0:1746065185.395856:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262993536 00000100:00100000:2.0:1746065185.395897:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4237 00000100:00100000:2.0:1746065185.395904:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:31683:x1830881262993536:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065185.396061:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:31683:x1830881262993536:12345-192.168.202.46@tcp:35:cat.0 Request processed in 156us (294us total) trans 8589944155 rc 0/0 00000100:00100000:2.0:1746065185.396066:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4237 00000100:00100000:1.0:1746065185.397655:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881262992768:12345-192.168.202.46@tcp:4:cat.0 Request processed in 13648us (14133us total) trans 21474840859 rc 0/0 00000100:00100000:1.0:1746065185.397662:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2472 00002000:00100000:1.0:1746065185.397669:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3272704->4194303) req@ffff88009fa74380 x1830881262992768/t21474840859(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.397676:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74380 with x1830881262992768 ext(3272704->4194303) 00010000:00010000:1.0:1746065185.397683:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 19 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.397694:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 19 pid: 25185 timeout: 884 lvb_type: 0 00002000:00010000:1.0:1746065185.397698:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa74380 00000100:00100000:0.0:1746065185.400299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.400431:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262993664 00000100:00100000:2.0:1746065185.400440:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262993664 00010000:00010000:2.0:1746065185.400468:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 19 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.400508:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7371 00000100:00100000:2.0:1746065185.400515:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262993664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.400527:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065185.400542:0:7080:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065185 -> 1746065186 00002000:00010000:2.0:1746065185.400545:0:7080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065185 -> 1746065186 00010000:00010000:2.0:1746065185.400550:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 19 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.400560:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 19 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.400580:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60704 expref: 19 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.400593:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.400595:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.400601:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.400613:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.400639:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 9 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.400649:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260331648:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.400730:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.403313:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260331648:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065185.403331:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.403925:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881262993664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3407us (3630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.403937:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7371 00000100:00100000:0.0:1746065185.406514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.406615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.406667:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262994048 00000100:00100000:2.0:1746065185.406668:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262994176 00000100:00100000:2.0:1746065185.406674:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262994176 00000100:00100000:1.0:1746065185.406674:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262994048 00002000:00100000:2.0:1746065185.406708:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009fa75880 x1830881262994176/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.406708:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fa75500 x1830881262994048/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.406717:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75880 with x1830881262994176 ext(3145728->4194303) 00002000:00100000:1.0:1746065185.406717:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75500 with x1830881262994048 ext(3145728->4194303) 00002000:00010000:2.0:1746065185.406721:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75880 00002000:00010000:1.0:1746065185.406721:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa75500 00000100:00100000:2.0:1746065185.407227:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8111 00000100:00100000:2.0:1746065185.407239:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881262994176:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065185.407242:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8112 00000100:00100000:1.0:1746065185.407247:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881262994048:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065185.414344:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881262994176:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 7098us (7719us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.414358:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8111 00002000:00100000:2.0:1746065185.414370:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009fa75880 x1830881262994176/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.414379:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75880 with x1830881262994176 ext(3145728->4194303) 00002000:00010000:2.0:1746065185.414384:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75880 00000100:00100000:2.0:1746065185.416013:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881262994048:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8759us (9498us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.416022:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8112 00002000:00100000:2.0:1746065185.416029:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fa75500 x1830881262994048/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.416037:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75500 with x1830881262994048 ext(3145728->4194303) 00002000:00010000:2.0:1746065185.416042:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa75500 00000100:00100000:0.0:1746065185.426567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.427504:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262994432 00000100:00100000:2.0:1746065185.427514:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262994432 00002000:00100000:2.0:1746065185.427547:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fa75c00 x1830881262994432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.427557:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75c00 with x1830881262994432 ext(4194304->5013503) 00002000:00010000:2.0:1746065185.427561:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75c00 00000100:00100000:2.0:1746065185.427587:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8113 00000100:00100000:2.0:1746065185.427593:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262994432:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.433972:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262994432:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6370us (7408us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065185.433983:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8113 00002000:00100000:3.0:1746065185.433995:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fa75c00 x1830881262994432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.434003:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75c00 with x1830881262994432 ext(4194304->5013503) 00002000:00010000:3.0:1746065185.434009:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75c00 00000100:00100000:0.0:1746065185.514765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.515335:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262994688 00000100:00100000:3.0:1746065185.515343:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262994688 00000100:00100000:3.0:1746065185.515394:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9931 00000100:00100000:3.0:1746065185.515402:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:31698:x1830881262994688:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065185.515423:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.515436:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c000/0x14b4f8542d4fc7b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60735 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.515523:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515533:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515542:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515552:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515557:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515561:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515640:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515648:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515654:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065185.515661:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065185.515726:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515732:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515737:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515742:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25d600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.515745:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515751:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515760:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065185.515762:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065185.515766:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515770:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d600/0x14b4f8542d4fc7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515800:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515809:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515828:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515833:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25de00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.515835:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515839:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515845:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:3.0:1746065185.515847:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065185.515849:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515854:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25de00/0x14b4f8542d4fc7c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065185.515883:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c000/0x14b4f8542d4fc7b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 283 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.515893:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 282 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.515899:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.515901:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065185.515903:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25d000, rc 0) 00000100:00100000:3.0:1746065185.515954:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:31698:x1830881262994688:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 553us (1196us total) trans 8589944156 rc 0/0 00000100:00100000:3.0:1746065185.515960:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9931 00000100:00100000:0.0:1746065185.526029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.526092:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262994816 00000100:00100000:2.0:1746065185.526101:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262994816 00000100:00100000:2.0:1746065185.526149:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14442 00000100:00100000:2.0:1746065185.526157:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:31698:x1830881262994816:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065185.526173:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.526187:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6073c expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.526212:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.526220:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.526226:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6a00/0x14b4f8542d4fc54a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60598 expref: 19 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.526231:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.526234:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.526236:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [716800->917503] (req 716800->917503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.526261:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6a00/0x14b4f8542d4fc54a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60598 expref: 19 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.526276:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6a00/0x14b4f8542d4fc54a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60598 expref: 19 pid: 2462 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065185.526287:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260331776:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.526377:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.526385:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 7 pid: 9716 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065185.526391:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260331904:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.526458:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.526466:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 9 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.526474:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260332032:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.526489:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.528674:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260331776:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.528682:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260331904:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.529445:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260332032:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.529474:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [716800->917503] (req 716800->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.529487:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38bc00, rc 0) 00000100:00100000:2.0:1746065185.529522:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:31698:x1830881262994816:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3365us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.529530:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14442 00000100:00100000:0.0:1746065185.531765:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.531803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.531856:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.531890:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262994944 00000100:00100000:0.0:1746065185.531897:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262994944 00000100:00100000:3.0:1746065185.531909:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262995072 00000100:00100000:3.0:1746065185.531913:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262995072 00010000:00010000:0.0:1746065185.531924:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 8 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746065185.531928:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6a00/0x14b4f8542d4fc54a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60598 expref: 19 pid: 2462 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746065185.531954:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262995200 00000100:00100000:3.0:1746065185.531957:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262995200 00010000:00010000:3.0:1746065185.531965:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 10 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065185.532417:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7372 00000100:00100000:3.0:1746065185.532424:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881262995072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.532436:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065185.532449:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7373 00002000:00010000:3.0:1746065185.532452:0:7078:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1957 -> 1961 00000100:00100000:0.0:1746065185.532456:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881262994944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.532458:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6a00/0x14b4f8542d4fc54a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60598 expref: 19 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746065185.532463:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065185.532467:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6a00/0x14b4f8542d4fc54a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60598 expref: 19 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746065185.532497:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 8 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746065185.532506:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 8 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746065185.532524:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7b3000/0x14b4f8542d4fc5c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605de expref: 8 pid: 9716 timeout: 884 lvb_type: 1 00010000:00010000:0.0:1746065185.532539:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.532571:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881262994944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 116us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.532577:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7373 00000100:00100000:1.0:1746065185.532586:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7374 00000100:00100000:1.0:1746065185.532596:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881262995200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.532604:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.532614:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 10 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.532623:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 10 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.532634:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c400/0x14b4f8542d4fc512 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6057c expref: 10 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.532642:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.532658:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881262995200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.532663:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7374 00010000:00010000:3.0:1746065185.533266:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7d6a00/0x14b4f8542d4fc54a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60598 expref: 19 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:3.0:1746065185.533280:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.533282:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.533288:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.533296:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.533321:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.533330:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260332160:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065185.533371:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.535355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.535430:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262995456 00000100:00100000:2.0:1746065185.535437:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262995456 00002000:00100000:2.0:1746065185.535470:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (716800->720895) req@ffff88008fc5aa00 x1830881262995456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.535479:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5aa00 with x1830881262995456 ext(716800->720895) 00002000:00010000:2.0:1746065185.535483:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5aa00 00000100:00100000:2.0:1746065185.535498:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8114 00000100:00100000:2.0:1746065185.535504:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881262995456:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065185.535639:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881262995456:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 135us (288us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065185.535646:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8114 00002000:00100000:2.0:1746065185.535651:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (716800->720895) req@ffff88008fc5aa00 x1830881262995456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.535657:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5aa00 with x1830881262995456 ext(716800->720895) 00002000:00010000:2.0:1746065185.535660:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5aa00 00000100:00100000:3.0:1746065185.535896:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260332160:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065185.535910:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.535942:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881262995072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3518us (4138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.535949:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7372 00000100:00100000:0.0:1746065185.540666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.540745:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262995712 00000100:00100000:2.0:1746065185.540753:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262995712 00002000:00100000:2.0:1746065185.540797:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (913408->917503) req@ffff88009fa77100 x1830881262995712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.540807:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa77100 with x1830881262995712 ext(913408->917503) 00002000:00010000:2.0:1746065185.540811:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa77100 00000100:00100000:2.0:1746065185.540850:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8115 00000100:00100000:2.0:1746065185.540856:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881262995712:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065185.541013:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881262995712:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 156us (353us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065185.541022:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8115 00002000:00100000:2.0:1746065185.541028:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (913408->917503) req@ffff88009fa77100 x1830881262995712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.541034:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa77100 with x1830881262995712 ext(913408->917503) 00002000:00010000:2.0:1746065185.541037:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa77100 00000100:00100000:0.0:1746065185.543215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.543589:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262995968 00000100:00100000:2.0:1746065185.543596:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262995968 00000100:00100000:2.0:1746065185.543744:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4238 00000100:00100000:2.0:1746065185.543751:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090023450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:31698:x1830881262995968:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065185.544912:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090023450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:31698:x1830881262995968:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1158us (1699us total) trans 8589944157 rc 0/0 00000100:00100000:2.0:1746065185.544919:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4238 00000100:00100000:0.0:1746065185.568445:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.568503:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996096 00000100:00100000:2.0:1746065185.568511:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996096 00000100:00100000:2.0:1746065185.568559:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14443 00000100:00100000:2.0:1746065185.568566:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881262996096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.568589:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.568604:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc7dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60743 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.568644:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260332288:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065185.568728:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00002000:00010000:2.0:1746065185.572353:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime: 1746065185 -> 1746065186 00002000:00010000:2.0:1746065185.572359:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime: 1746065185 -> 1746065186 00002000:00010000:2.0:1746065185.572362:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime: 1746065185 -> 1746065186 00000100:00100000:2.0:1746065185.572383:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260332288:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065185.572414:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc7dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60743 expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.572427:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc7dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60743 expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.572453:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38ba00, rc 0) 00000100:00100000:2.0:1746065185.573220:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881262996096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4651us (4778us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065185.573227:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14443 00000100:00100000:0.0:1746065185.578241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.578568:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996224 00000100:00100000:2.0:1746065185.578577:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996224 00000100:00100000:2.0:1746065185.578613:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14444 00000100:00100000:2.0:1746065185.578620:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:31702:x1830881262996224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.578636:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.578651:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6074a expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.578676:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.578683:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.578685:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.578687:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.578716:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.578726:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 17 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.578738:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260332416:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.578854:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.581346:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260332416:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.581373:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.581386:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38b800, rc 0) 00000100:00100000:2.0:1746065185.581418:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:31702:x1830881262996224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2798us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.581424:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14444 00000100:00100000:0.0:1746065185.582102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.582878:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996352 00000100:00100000:2.0:1746065185.582885:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996352 00002000:00100000:2.0:1746065185.582917:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (716800->917503) req@ffff88009fa77b80 x1830881262996352/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.582927:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa77b80 with x1830881262996352 ext(716800->917503) 00010000:00010000:2.0:1746065185.582933:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 18 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.582949:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 18 pid: 25185 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065185.582955:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa77b80 00000100:00100000:2.0:1746065185.582971:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2473 00000100:00100000:2.0:1746065185.582977:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881262996352:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065185.587364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.587431:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996608 00000100:00100000:3.0:1746065185.587439:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996608 00000100:00100000:3.0:1746065185.587487:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9932 00000100:00100000:3.0:1746065185.587495:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+38:31704:x1830881262996608:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065185.587515:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.587530:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc7ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60751 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.587607:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.587625:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 282 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.587631:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.587659:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 282 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.587667:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 282 pid: 14644 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065185.587677:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260332544:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.587750:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.588677:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881262996352:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5697us (6573us total) trans 21474840860 rc 0/0 00000100:00100000:0.0:1746065185.588686:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2473 00002000:00100000:0.0:1746065185.588693:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (716800->917503) req@ffff88009fa77b80 x1830881262996352/t21474840860(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065185.588700:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa77b80 with x1830881262996352 ext(716800->917503) 00010000:00010000:0.0:1746065185.588708:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 20 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:0.0:1746065185.588717:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 20 pid: 25185 timeout: 884 lvb_type: 0 00002000:00010000:0.0:1746065185.588722:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa77b80 00000100:00100000:3.0:1746065185.591047:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260332544:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.591071:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065185.592105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.592586:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.592672:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996736 00000100:00100000:3.0:1746065185.592678:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996736 00010000:00010000:3.0:1746065185.592707:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 20 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.595329:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262996864 00000100:00100000:3.0:1746065185.595340:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7375 00000100:00100000:2.0:1746065185.595341:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262996864 00000100:00100000:3.0:1746065185.595353:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881262996736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.595366:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.595367:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 283 pid: 14644 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.595387:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 20 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.595395:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7376 00000100:00100000:2.0:1746065185.595401:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:1961:x1830881262996864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.595403:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 20 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.595409:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.595414:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 283 pid: 14644 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.595422:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 283 pid: 14644 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.595423:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a38bc00/0x14b4f8542d4fc7d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->917503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6073c expref: 20 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.595435:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fc7c7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60735 expref: 283 pid: 14644 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.595440:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.595442:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.595447:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 9 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.595448:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065185.595453:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.595455:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 9 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.595460:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.595465:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.595481:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065185.595483:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 9 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.595495:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260332672:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.595526:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:1961:x1830881262996864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 125us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.595532:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7376 00000100:00100000:3.0:1746065185.595544:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d000c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065185.595560:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.595566:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065185.595584:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065185.595701:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc7ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 41 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.595713:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 40 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.595718:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.595720:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065185.595722:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25d200, rc 0) 00000100:00100000:3.0:1746065185.595745:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+40:31704:x1830881262996608:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8252us (8390us total) trans 8589944158 rc 0/0 00000100:00100000:3.0:1746065185.595751:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9932 00000100:00100000:3.0:1746065185.600167:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260332672:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065185.600187:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.600236:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881262996736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4886us (8132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.600246:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7375 00000100:00100000:0.0:1746065185.602258:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.602312:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.602434:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262997376 00000100:00100000:2.0:1746065185.602442:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262997376 00002000:00100000:2.0:1746065185.602479:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009fa74e00 x1830881262997376/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 504/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.602488:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74e00 with x1830881262997376 ext(1048576->2097151) 00002000:00010000:2.0:1746065185.602493:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa74e00 00000100:00100000:2.0:1746065185.602507:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262997248 00000100:00100000:2.0:1746065185.602509:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262997248 00002000:00100000:2.0:1746065185.602519:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009fa75180 x1830881262997248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.602525:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75180 with x1830881262997248 ext(0->1048575) 00002000:00010000:2.0:1746065185.602528:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75180 00000100:00100000:2.0:1746065185.603306:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8116 00000100:00100000:2.0:1746065185.603314:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881262997376:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065185.603727:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8117 00000100:00100000:1.0:1746065185.603740:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262997248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065185.617250:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262997248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13505us (14926us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065185.617262:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8117 00002000:00100000:1.0:1746065185.617273:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009fa75180 x1830881262997248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.617282:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75180 with x1830881262997248 ext(0->1048575) 00002000:00010000:1.0:1746065185.617287:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75180 00000100:00100000:3.0:1746065185.617955:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881262997376:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14640us (15701us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746065185.617962:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8116 00002000:00100000:3.0:1746065185.617968:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009fa74e00 x1830881262997376/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 504/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.617975:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74e00 with x1830881262997376 ext(1048576->2097151) 00002000:00010000:3.0:1746065185.617978:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa74e00 00000100:00100000:0.0:1746065185.624753:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.624853:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262997632 00000100:00100000:3.0:1746065185.624861:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262997632 00000100:00100000:3.0:1746065185.624912:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9933 00000100:00100000:3.0:1746065185.624921:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:31707:x1830881262997632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.624938:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.624955:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4fc7ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60758 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.625041:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625051:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625059:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625069:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625073:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625077:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625162:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fc814 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625170:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fc814 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625176:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fc814 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065185.625183:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065185.625250:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625257:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625262:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625267:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25cc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.625270:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625276:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625285:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065185.625287:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065185.625290:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625295:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25cc00/0x14b4f8542d4fc806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625321:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625326:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625331:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625335:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25c600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.625337:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625345:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625350:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205100) 00010000:00010000:3.0:1746065185.625352:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065185.625354:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625358:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fc80d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.625388:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25dc00/0x14b4f8542d4fc7ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60758 expref: 285 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.625398:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fc814 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60758 expref: 284 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.625403:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.625405:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065185.625407:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25d800, rc 0) 00000100:00100000:3.0:1746065185.625456:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:31707:x1830881262997632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 536us (710us total) trans 8589944159 rc 0/0 00000100:00100000:3.0:1746065185.625462:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9933 00000100:00100000:0.0:1746065185.628413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.628453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.628482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.628517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.628538:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262997888 00000100:00100000:1.0:1746065185.628545:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262997888 00000100:00100000:1.0:1746065185.628572:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262998016 00000100:00100000:1.0:1746065185.628573:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262998016 00000100:00100000:1.0:1746065185.628579:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262998144 00000100:00100000:1.0:1746065185.628580:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262998144 00000100:00100000:1.0:1746065185.628588:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14445 00000100:00100000:1.0:1746065185.628593:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881262997888:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065185.628594:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14446 00000100:00100000:2.0:1746065185.628602:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262998016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065185.628604:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.628609:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.628617:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6075f expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.628618:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a38ac00/0x14b4f8542d4fc829 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60766 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.628631:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.628632:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.628637:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 21 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.628646:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 21 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.628651:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec33200, rc 0) 00000100:00100000:2.0:1746065185.628652:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260332800:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065185.628676:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262997888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.628680:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14445 00000100:00100000:1.0:1746065185.628690:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14447 00000100:00100000:1.0:1746065185.628692:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881262998144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065185.628695:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.628699:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6076d expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.628704:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.628705:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.628707:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 21 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.628709:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065185.628712:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 21 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.628716:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec33600, rc 0) 00000100:00100000:1.0:1746065185.628723:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881262998144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 31us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.628726:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14447 00000100:00100000:3.0:1746065185.628854:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262997760 00000100:00100000:3.0:1746065185.628858:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262997760 00000100:00100000:3.0:1746065185.631230:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 747 00000100:00100000:3.0:1746065185.631243:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:1960:x1830881262997760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.631258:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065185.631279:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d800/0x14b4f8542d4fc814 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60758 expref: 284 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.631293:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.631297:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.631330:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:1960:x1830881262997760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (2923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.631335:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 747 00000100:00100000:0.0:1746065185.636094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.636395:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260332800:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065185.636428:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a38ac00/0x14b4f8542d4fc829 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60766 expref: 23 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.636442:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a38ac00/0x14b4f8542d4fc829 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60766 expref: 23 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.636452:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38ac00, rc 0) 00000100:00100000:3.0:1746065185.636492:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262998016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7890us (8008us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065185.636499:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14446 00000100:00100000:3.0:1746065185.636522:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262998272 00000100:00100000:3.0:1746065185.636526:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262998272 00000100:00100000:3.0:1746065185.637736:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14448 00000100:00100000:3.0:1746065185.637745:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+10:31704:x1830881262998272:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065185.637758:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.637771:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60774 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.637808:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.637827:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.637833:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.637835:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.637838:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [868352->1048575] (req 868352->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.637862:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.637871:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 20 pid: 4545 timeout: 884 lvb_type: 1 00000100:00100000:3.0:1746065185.637881:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260332928:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.637929:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.637935:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 11 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:3.0:1746065185.637942:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260333056:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.637957:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.640704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.641040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.641344:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262998528 00000100:00100000:1.0:1746065185.641351:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262998528 00000100:00100000:3.0:1746065185.641540:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260332928:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.641549:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260333056:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.641574:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [868352->1048575] (req 868352->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.641589:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25c200, rc 0) 00000100:00100000:3.0:1746065185.641623:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:31704:x1830881262998272:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3880us (5538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.641628:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14448 00000100:00100000:3.0:1746065185.641644:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14449 00000100:00100000:3.0:1746065185.641648:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31707:x1830881262998528:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.641659:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.641668:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6077b expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.641682:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.641686:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [868352->1048575] (req 868352->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.641691:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065185.641693:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.641713:0:2462:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [868352->1048575] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.641724:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.641730:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c25da00, rc 0) 00000100:00100000:3.0:1746065185.641742:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31707:x1830881262998528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 94us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.641746:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14449 00000100:00100000:2.0:1746065185.641842:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262998400 00000100:00100000:2.0:1746065185.641846:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262998400 00010000:00010000:2.0:1746065185.641862:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 22 pid: 4545 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065185.641890:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7377 00000100:00100000:2.0:1746065185.641896:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262998400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.641906:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.641924:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 22 pid: 4545 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.641933:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 22 pid: 4545 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.641947:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec33200/0x14b4f8542d4fc822 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6075f expref: 22 pid: 4545 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.641959:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.641977:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881262998400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.641986:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7377 00000100:00100000:0.0:1746065185.642723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.642796:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262998656 00000100:00100000:2.0:1746065185.642799:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262998656 00010000:00010000:2.0:1746065185.642832:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 11 pid: 25185 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.642849:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7378 00000100:00100000:2.0:1746065185.642855:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262998656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.642861:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.642870:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 11 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.642879:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 11 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.642890:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a38b800/0x14b4f8542d4fc7e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6074a expref: 11 pid: 25185 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.642899:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.642900:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.642905:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.642912:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.642931:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.642940:0:7078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 10 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.642951:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260333312:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.643014:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.647212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.647282:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262998912 00000100:00100000:3.0:1746065185.647289:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262998912 00002000:00100000:3.0:1746065185.647327:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (868352->872447) req@ffff88008ec2d500 x1830881262998912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.647337:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2d500 with x1830881262998912 ext(868352->872447) 00010000:00010000:3.0:1746065185.647346:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 11 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.647359:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 11 pid: 2462 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065185.647365:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec2d500 00000100:00100000:3.0:1746065185.647394:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2474 00000100:00100000:3.0:1746065185.647401:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262998912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.647552:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262998912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 151us (348us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065185.647558:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2474 00002000:00100000:3.0:1746065185.647564:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (868352->872447) req@ffff88008ec2d500 x1830881262998912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.647571:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2d500 with x1830881262998912 ext(868352->872447) 00010000:00010000:3.0:1746065185.647575:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 11 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.647583:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 11 pid: 2462 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065185.647589:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec2d500 00000100:00100000:2.0:1746065185.647930:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260333312:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065185.647944:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.648195:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881262998656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5339us (5472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.648202:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7378 00000100:00100000:0.0:1746065185.651013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.651062:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.651139:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262999168 00000100:00100000:1.0:1746065185.651146:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262999168 00000100:00100000:1.0:1746065185.651182:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14450 00000100:00100000:2.0:1746065185.651184:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262999296 00000100:00100000:2.0:1746065185.651189:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262999296 00000100:00100000:1.0:1746065185.651189:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:31704:x1830881262999168:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065185.651204:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746065185.651214:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (868352->1048575) req@ffff88008ec2dc00 x1830881262999296/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065185.651216:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60782 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065185.651222:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2dc00 with x1830881262999296 ext(868352->1048575) 00010000:00010000:2.0:1746065185.651230:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 10 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.651241:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 10 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.651244:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065185.651246:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec2dc00 00010000:00010000:1.0:1746065185.651252:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 6 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.651258:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 11 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.651259:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2475 00010000:00010000:1.0:1746065185.651263:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065185.651264:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881262999296:12345-192.168.202.46@tcp:4:cat.0 00010000:00010000:1.0:1746065185.651265:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.651269:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->1269759] (req 1048576->1269759) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.651295:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 11 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.651303:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 11 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746065185.651314:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260333440:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.651374:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 6 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.651381:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 6 pid: 2462 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746065185.651389:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260333568:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.651410:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.651417:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 21 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746065185.651423:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260333696:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.651436:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.655378:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260333440:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.655419:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260333568:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.655430:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260333696:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.655458:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1048576->1269759] (req 1048576->1269759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.655471:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec33200, rc 0) 00000100:00100000:1.0:1746065185.655473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.655506:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:31704:x1830881262999168:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4317us (4499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.655513:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14450 00000100:00100000:2.0:1746065185.655566:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262999424 00000100:00100000:2.0:1746065185.655573:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262999424 00010000:00010000:2.0:1746065185.655597:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 7 pid: 2462 timeout: 884 lvb_type: 1 00000100:00100000:2.0:1746065185.655628:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7379 00000100:00100000:2.0:1746065185.655635:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881262999424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.655643:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.655658:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 7 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.655667:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 7 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.655683:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800953fa000/0x14b4f8542d4fc6d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60686 expref: 7 pid: 2462 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.655696:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.655715:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881262999424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.655720:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7379 00000100:00100000:3.0:1746065185.656485:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881262999296:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5219us (5421us total) trans 21474840861 rc 0/0 00000100:00100000:3.0:1746065185.656493:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2475 00002000:00100000:3.0:1746065185.656500:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (868352->1048575) req@ffff88008ec2dc00 x1830881262999296/t21474840861(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.656508:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2dc00 with x1830881262999296 ext(868352->1048575) 00010000:00010000:3.0:1746065185.656516:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 12 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.656525:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 12 pid: 2462 timeout: 884 lvb_type: 0 00002000:00010000:3.0:1746065185.656531:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec2dc00 00000100:00100000:0.0:1746065185.657076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.657359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.657449:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262999552 00000100:00100000:2.0:1746065185.657454:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262999552 00010000:00010000:2.0:1746065185.657471:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 11 pid: 25185 timeout: 884 lvb_type: 1 00000100:00100000:1.0:1746065185.657594:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262999680 00000100:00100000:1.0:1746065185.657597:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262999680 00010000:00010000:1.0:1746065185.657611:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 22 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:1.0:1746065185.657641:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7380 00000100:00100000:1.0:1746065185.657647:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881262999680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.657655:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.657670:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 22 pid: 9716 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.657720:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7381 00000100:00100000:2.0:1746065185.657726:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881262999552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.657731:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.657738:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 11 pid: 25185 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.657754:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 11 pid: 25185 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.657772:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fba5400/0x14b4f8542d4fc6cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60671 expref: 11 pid: 25185 timeout: 884 lvb_type: 1 00010000:00010000:2.0:1746065185.657794:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065185.657887:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 22 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.657903:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9fc8000/0x14b4f8542d4fc6a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60663 expref: 22 pid: 9716 timeout: 884 lvb_type: 0 00010000:00010000:1.0:1746065185.657939:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.657940:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.657946:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.657953:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.657978:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.657988:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260333824:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.658048:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881262999552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 321us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.658054:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7381 00000100:00100000:1.0:1746065185.658234:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.662387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.662448:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260333824:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065185.662649:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.662684:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881262999680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5037us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.662693:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7380 00000100:00100000:2.0:1746065185.663151:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881262999808 00000100:00100000:2.0:1746065185.663157:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881262999808 00010000:00010000:2.0:1746065185.663180:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 12 pid: 2462 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.663197:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7382 00000100:00100000:2.0:1746065185.663203:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881262999808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.663212:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.663229:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 12 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.663244:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 12 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.663262:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c25c200/0x14b4f8542d4fc837 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60774 expref: 12 pid: 2462 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.663273:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.663274:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.663279:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.663286:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.663309:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.663374:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260333952:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.663770:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.665193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.665600:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263000064 00000100:00100000:3.0:1746065185.665607:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263000064 00002000:00100000:3.0:1746065185.665640:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1265664->1269759) req@ffff88008ec2e680 x1830881263000064/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.665650:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2e680 with x1830881263000064 ext(1265664->1269759) 00002000:00010000:3.0:1746065185.665654:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2e680 00000100:00100000:3.0:1746065185.665684:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8118 00000100:00100000:3.0:1746065185.665691:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263000064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.665850:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263000064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 159us (660us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065185.665857:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8118 00002000:00100000:3.0:1746065185.665862:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1265664->1269759) req@ffff88008ec2e680 x1830881263000064/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.665869:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2e680 with x1830881263000064 ext(1265664->1269759) 00002000:00010000:3.0:1746065185.665871:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2e680 00000100:00100000:2.0:1746065185.666107:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260333952:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065185.666123:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.666144:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881262999808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2941us (3763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.666150:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7382 00000100:00100000:3.0:1746065185.668329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.668663:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263000320 00000100:00100000:2.0:1746065185.668670:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263000320 00002000:00100000:2.0:1746065185.668701:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009b9fc700 x1830881263000320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.668709:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fc700 with x1830881263000320 ext(0->1048575) 00002000:00010000:2.0:1746065185.668714:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fc700 00000100:00100000:2.0:1746065185.668740:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8119 00000100:00100000:2.0:1746065185.668746:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263000320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065185.686765:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263000320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18007us (18429us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.686777:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8119 00002000:00100000:2.0:1746065185.686802:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009b9fc700 x1830881263000320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.686811:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fc700 with x1830881263000320 ext(0->1048575) 00002000:00010000:2.0:1746065185.690167:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fc700 00000100:00100000:0.0:1746065185.698380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.698497:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263000448 00000100:00100000:2.0:1746065185.698507:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263000448 00000100:00100000:2.0:1746065185.698573:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14451 00000100:00100000:2.0:1746065185.698583:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31707:x1830881263000448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.698600:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.698616:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60789 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.698645:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.698657:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.698658:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.698662:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.698689:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.698701:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 9 pid: 8851 timeout: 884 lvb_type: 0 00000100:00100000:2.0:1746065185.698713:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260334080:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.699362:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.702480:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260334080:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.702515:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.702531:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38ae00, rc 0) 00000100:00100000:2.0:1746065185.702580:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31707:x1830881263000448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3999us (4209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.702588:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14451 00000100:00100000:0.0:1746065185.703593:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.704100:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263000576 00000100:00100000:2.0:1746065185.704108:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263000576 00002000:00100000:2.0:1746065185.704151:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1269759) req@ffff88008ec2ed80 x1830881263000576/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.704166:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ed80 with x1830881263000576 ext(1048576->1269759) 00010000:00010000:2.0:1746065185.704174:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 10 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:2.0:1746065185.704188:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 10 pid: 8851 timeout: 884 lvb_type: 0 00002000:00010000:2.0:1746065185.704195:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec2ed80 00000100:00100000:3.0:1746065185.705629:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2476 00000100:00100000:3.0:1746065185.705642:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263000576:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065185.710711:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263000576:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5066us (7112us total) trans 17179873590 rc 0/0 00000100:00100000:3.0:1746065185.710722:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2476 00002000:00100000:3.0:1746065185.710732:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1269759) req@ffff88008ec2ed80 x1830881263000576/t17179873590(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.710739:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ed80 with x1830881263000576 ext(1048576->1269759) 00010000:00010000:3.0:1746065185.710747:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 12 pid: 8851 timeout: 884 lvb_type: 0 00010000:00010000:3.0:1746065185.710764:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 12 pid: 8851 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065185.710770:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec2ed80 00000100:00100000:0.0:1746065185.716098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.716162:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263000704 00000100:00100000:2.0:1746065185.716169:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263000704 00010000:00010000:2.0:1746065185.716196:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 12 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.717399:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7383 00000100:00100000:1.0:1746065185.717412:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263000704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.717425:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065185.717442:0:8444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065185 -> 1746065186 00002000:00010000:1.0:1746065185.717445:0:8444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065185 -> 1746065186 00010000:00010000:1.0:1746065185.717451:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 12 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.717464:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 12 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.717483:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec33200/0x14b4f8542d4fc845 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1269759) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60782 expref: 12 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.717511:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.717513:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.717519:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.717527:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.717553:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.717562:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260334208:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065185.717628:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.723190:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.723281:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263000960 00000100:00100000:3.0:1746065185.723289:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263000960 00002000:00100000:3.0:1746065185.723327:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a5883100 x1830881263000960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.723335:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883100 with x1830881263000960 ext(1048576->2097151) 00002000:00010000:3.0:1746065185.723339:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5883100 00000100:00100000:0.0:1746065185.723502:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260334208:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065185.723520:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.723567:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263000704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6159us (7475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.723575:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7383 00000100:00100000:3.0:1746065185.724052:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8120 00000100:00100000:3.0:1746065185.724059:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263000960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.731356:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263000960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7289us (8165us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065185.731366:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8120 00002000:00100000:3.0:1746065185.731376:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a5883100 x1830881263000960/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.731385:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883100 with x1830881263000960 ext(1048576->2097151) 00002000:00010000:3.0:1746065185.731390:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5883100 00000100:00100000:0.0:1746065185.743005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.743068:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001088 00000100:00100000:2.0:1746065185.743076:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001088 00000100:00100000:2.0:1746065185.743120:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14452 00000100:00100000:2.0:1746065185.743127:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31707:x1830881263001088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.743141:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.743154:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60790 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.743176:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.743182:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.743184:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.743187:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.743210:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 10 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.743220:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 10 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.743231:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260334336:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.743304:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.745718:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260334336:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.745744:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.745758:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38b000, rc 0) 00000100:00100000:2.0:1746065185.745812:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31707:x1830881263001088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2684us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.745837:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14452 00000100:00100000:0.0:1746065185.746733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.747286:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001216 00000100:00100000:3.0:1746065185.747293:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001216 00002000:00100000:3.0:1746065185.747328:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1409024->1798143) req@ffff88008ec2f800 x1830881263001216/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.747343:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f800 with x1830881263001216 ext(1409024->1798143) 00010000:00010000:3.0:1746065185.747350:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 11 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.747362:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 11 pid: 2462 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065185.747368:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec2f800 00000100:00100000:3.0:1746065185.747384:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2477 00000100:00100000:3.0:1746065185.747390:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263001216:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065185.754157:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263001216:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6759us (7419us total) trans 17179873591 rc 0/0 00000100:00100000:3.0:1746065185.754167:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2477 00002000:00100000:3.0:1746065185.754177:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1409024->1798143) req@ffff88008ec2f800 x1830881263001216/t17179873591(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.754186:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f800 with x1830881263001216 ext(1409024->1798143) 00010000:00010000:3.0:1746065185.754195:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.754207:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065185.754214:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec2f800 00000100:00100000:0.0:1746065185.762316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.762404:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001344 00000100:00100000:2.0:1746065185.762411:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001344 00010000:00010000:2.0:1746065185.762440:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.762472:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7384 00000100:00100000:2.0:1746065185.762478:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263001344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.762492:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.762509:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.762518:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.762537:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fc773 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1798143) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606f6 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.762563:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.762566:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.762572:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.762579:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.762604:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.762614:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260334464:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.762684:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.764507:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.764536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.764548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.764566:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001472 00000100:00100000:1.0:1746065185.764571:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001472 00000100:00100000:1.0:1746065185.764595:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001728 00000100:00100000:1.0:1746065185.764597:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001728 00000100:00100000:1.0:1746065185.764604:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001600 00000100:00100000:1.0:1746065185.764605:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001600 00000100:00100000:1.0:1746065185.764614:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14453 00000100:00100000:1.0:1746065185.764619:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263001472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065185.764632:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.764643:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60797 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.764657:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.764659:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.764664:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 12 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.764676:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 12 pid: 2462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.764798:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14454 00000100:00100000:2.0:1746065185.764805:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263001728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.764812:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.764837:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607a5 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.764847:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.764848:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.764852:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.764860:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.764867:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38ba00, rc 0) 00000100:00100000:2.0:1746065185.764892:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263001728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 88us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.764898:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14454 00000100:00100000:2.0:1746065185.764911:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14455 00000100:00100000:2.0:1746065185.764915:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263001600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.764921:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.764926:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6079e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.764934:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.764935:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.764939:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.764946:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.764957:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a38a600, rc 0) 00000100:00100000:2.0:1746065185.764968:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263001600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 53us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.764973:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14455 00010000:00010000:1.0:1746065185.765425:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8c00, rc 0) 00000100:00100000:1.0:1746065185.765441:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263001472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 821us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.765446:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14453 00000100:00100000:0.0:1746065185.767248:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260334464:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065185.767268:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.767304:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263001344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4825us (4995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.767313:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7384 00000100:00100000:0.0:1746065185.779985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.780026:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.780517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.782437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.782715:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263001984 00000100:00100000:3.0:1746065185.782725:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263001984 00000100:00100000:3.0:1746065185.782743:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263002368 00000100:00100000:3.0:1746065185.782745:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263002368 00002000:00100000:3.0:1746065185.782788:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88008ec2c000 x1830881263002368/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.782797:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c000 with x1830881263002368 ext(0->1048575) 00002000:00010000:3.0:1746065185.782801:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2c000 00000100:00100000:3.0:1746065185.782831:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263002624 00000100:00100000:3.0:1746065185.782834:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263002624 00002000:00100000:3.0:1746065185.782847:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2c700 x1830881263002624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.782853:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c700 with x1830881263002624 ext(1048576->2097151) 00002000:00010000:3.0:1746065185.782856:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2c700 00000100:00100000:3.0:1746065185.782868:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8121 00000100:00100000:3.0:1746065185.782874:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263002368:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065185.783309:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8122 00000100:00100000:2.0:1746065185.783318:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263002624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065185.783491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.783510:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263003008 00000100:00100000:1.0:1746065185.783513:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263003008 00000100:00100000:0.0:1746065185.783835:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263002496 00000100:00100000:0.0:1746065185.783839:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263002496 00002000:00100000:0.0:1746065185.783855:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008ec2ca80 x1830881263002496/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065185.783863:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ca80 with x1830881263002496 ext(1048576->2097151) 00002000:00010000:0.0:1746065185.783867:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2ca80 00000100:00100000:1.0:1746065185.783912:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9934 00000100:00100000:1.0:1746065185.783920:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:31714:x1830881263003008:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065185.783935:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.783954:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fc86f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607ac expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.784028:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784039:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784050:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784061:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784065:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784070:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784155:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc884 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784164:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc884 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784169:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc884 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065185.784175:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065185.784240:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784249:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784254:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784258:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d8800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065185.784261:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784267:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784276:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065185.784279:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065185.784282:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784287:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784306:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784311:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784315:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784319:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065185.784320:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784328:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784333:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6fe00) 00010000:00010000:1.0:1746065185.784335:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065185.784336:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784340:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fc87d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.784369:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fc86f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ac expref: 286 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.784379:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc884 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ac expref: 285 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.784384:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065185.784385:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065185.784387:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9800, rc 0) 00000100:00100000:1.0:1746065185.784423:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+285:31714:x1830881263003008:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 505us (932us total) trans 8589944160 rc 0/0 00000100:00100000:1.0:1746065185.784429:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9934 00000100:00100000:0.0:1746065185.788242:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8123 00000100:00100000:0.0:1746065185.788257:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263002496:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065185.790849:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2c380 x1830881263001984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.790862:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c380 with x1830881263001984 ext(1048576->2097151) 00002000:00010000:3.0:1746065185.790868:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2c380 00000100:00100000:3.0:1746065185.790902:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8124 00000100:00100000:3.0:1746065185.790912:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263001984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065185.791669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.792057:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263003136 00000100:00100000:3.0:1746065185.792063:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263003136 00000100:00100000:3.0:1746065185.792097:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 748 00000100:00100000:3.0:1746065185.792103:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+285:1960:x1830881263003136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.792114:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065185.792136:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc884 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ac expref: 285 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.792164:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.792168:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.792188:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:1960:x1830881263003136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.792193:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 748 00000100:00100000:3.0:1746065185.792245:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.792262:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263003264 00000100:00100000:3.0:1746065185.792265:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263003264 00000100:00100000:3.0:1746065185.792285:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14456 00000100:00100000:3.0:1746065185.792289:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31714:x1830881263003264:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065185.792300:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.792311:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607b3 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.792330:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 13 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.792338:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 22 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.792344:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.792345:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.792348:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3194880->3317759] (req 3194880->3317759) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.792373:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 22 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.792383:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 22 pid: 4545 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746065185.792395:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260334592:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.797307:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 13 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.797322:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.797333:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260334720:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.797385:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.804480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.807225:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263002624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23903us (26702us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.807239:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8122 00002000:00100000:2.0:1746065185.807248:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2c700 x1830881263002624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.807257:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c700 with x1830881263002624 ext(1048576->2097151) 00002000:00010000:2.0:1746065185.807262:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2c700 00000100:00100000:3.0:1746065185.807622:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260334592:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.807632:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260334720:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.807660:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3194880->3317759] (req 3194880->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.807674:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418b800, rc 0) 00000100:00100000:3.0:1746065185.807698:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31714:x1830881263003264:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 15407us (15453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.807707:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14456 00000100:00100000:1.0:1746065185.807767:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263003392 00000100:00100000:1.0:1746065185.807773:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263003392 00000100:00100000:1.0:1746065185.807831:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9935 00000100:00100000:1.0:1746065185.807838:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:31715:x1830881263003392:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065185.807854:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.807868:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fc899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607ba expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.807914:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.807924:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.807932:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.807942:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.807946:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.807951:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.808037:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.808046:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 39 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.808051:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065185.808075:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 39 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.808085:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 39 pid: 14645 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.808096:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260334848:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.809296:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.813035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.813072:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.813187:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263003520 00000100:00100000:2.0:1746065185.813194:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263003520 00010000:00010000:2.0:1746065185.813221:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 22 pid: 4545 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.813240:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263003648 00000100:00100000:2.0:1746065185.813242:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263003648 00010000:00010000:2.0:1746065185.813249:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 14 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.813272:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7385 00000100:00100000:2.0:1746065185.813277:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263003520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.813288:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.813303:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 22 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.813312:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 22 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.813329:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec33600/0x14b4f8542d4fc830 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6076d expref: 22 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.813344:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.813386:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263003520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 108us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.813391:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7385 00000100:00100000:2.0:1746065185.813407:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7386 00000100:00100000:2.0:1746065185.813411:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263003648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.813416:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.813422:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 14 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.813428:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 14 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.813442:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fc78f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60712 expref: 14 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.813449:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.813450:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.813456:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.813462:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.813486:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.813496:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260334976:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065185.813546:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ade40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065185.813627:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263002368:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30752us (33600us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065185.813635:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8121 00002000:00100000:3.0:1746065185.813642:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88008ec2c000 x1830881263002368/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.813650:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c000 with x1830881263002368 ext(0->1048575) 00002000:00010000:3.0:1746065185.813653:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2c000 00000100:00100000:1.0:1746065185.816127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.816334:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260334848:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.816357:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065185.816378:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263003904 00000100:00100000:3.0:1746065185.816384:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263003904 00000100:00100000:3.0:1746065185.816422:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4239 00000100:00100000:3.0:1746065185.816428:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+40:15426:x1830881263003904:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065185.816603:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+41:15426:x1830881263003904:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 174us (483us total) trans 8589944161 rc 0/0 00000100:00100000:3.0:1746065185.816608:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4239 00000100:00100000:3.0:1746065185.817022:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263001984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26112us (37043us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065185.817029:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8124 00002000:00100000:3.0:1746065185.817037:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2c380 x1830881263001984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.817044:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c380 with x1830881263001984 ext(1048576->2097151) 00002000:00010000:3.0:1746065185.817049:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2c380 00000100:00100000:2.0:1746065185.818460:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260334976:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065185.818474:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.818497:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263003648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5085us (5425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.818504:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7386 00000100:00100000:0.0:1746065185.823438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.824153:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263002496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 35899us (41719us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065185.824164:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8123 00002000:00100000:1.0:1746065185.824174:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008ec2ca80 x1830881263002496/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.824184:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ca80 with x1830881263002496 ext(1048576->2097151) 00002000:00010000:1.0:1746065185.824189:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2ca80 00000100:00100000:1.0:1746065185.824211:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263004160 00000100:00100000:1.0:1746065185.824217:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263004160 00002000:00100000:1.0:1746065185.824243:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3194880->3198975) req@ffff88008ec2ce00 x1830881263004160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.824250:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ce00 with x1830881263004160 ext(3194880->3198975) 00002000:00010000:1.0:1746065185.824253:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2ce00 00000100:00100000:1.0:1746065185.824281:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8125 00000100:00100000:1.0:1746065185.824287:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263004160:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065185.824396:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263004160:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 109us (967us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065185.824401:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8125 00002000:00100000:1.0:1746065185.824405:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3194880->3198975) req@ffff88008ec2ce00 x1830881263004160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.824416:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ce00 with x1830881263004160 ext(3194880->3198975) 00002000:00010000:1.0:1746065185.824418:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2ce00 00000100:00100000:0.0:1746065185.824548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.824619:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263004288 00000100:00100000:2.0:1746065185.824623:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263004288 00010000:00010000:2.0:1746065185.824642:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 41 pid: 14645 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.824661:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7387 00000100:00100000:2.0:1746065185.824665:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+41:1958:x1830881263004288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.824675:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.824680:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 41 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.824690:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 41 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.824708:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d200/0x14b4f8542d4fc7f1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60751 expref: 41 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.824722:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065185.824731:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824740:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824747:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824765:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.824787:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+40:1958:x1830881263004288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.824796:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7387 00010000:00010000:2.0:1746065185.824859:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824866:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:2.0:1746065185.824900:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065185.824904:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065185.824916:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824924:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824931:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824936:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824942:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824946:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065185.824949:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824955:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824961:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065185.824963:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065185.824967:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824972:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc8a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824980:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824984:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824989:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824993:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065185.824994:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.824999:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.825003:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6ff00) 00010000:00010000:2.0:1746065185.825005:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065185.825007:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.825011:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fc8a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.825036:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fc899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 17 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.825045:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 16 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.825052:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065185.825054:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065185.825056:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9800, rc 0) 00000100:00100000:2.0:1746065185.825682:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:31715:x1830881263003392:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 17842us (21207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.825688:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9935 00000100:00100000:0.0:1746065185.829523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.829837:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263004416 00000100:00100000:2.0:1746065185.829845:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263004416 00000100:00100000:2.0:1746065185.829894:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14457 00000100:00100000:2.0:1746065185.829902:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263004416:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065185.829917:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.829931:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607c1 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.829949:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.829951:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.829958:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.829972:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.829982:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a60a00, rc 0) 00000100:00100000:2.0:1746065185.830020:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263004416:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 120us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.830026:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14457 00000100:00100000:0.0:1746065185.830143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.830314:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263004544 00000100:00100000:1.0:1746065185.830319:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263004544 00000100:00100000:2.0:1746065185.830485:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14458 00000100:00100000:2.0:1746065185.830491:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263004544:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065185.830498:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.830506:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607c8 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.830516:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.830518:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.830522:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 7 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.830531:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 7 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.830539:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a60400, rc 0) 00000100:00100000:2.0:1746065185.830571:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263004544:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 80us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.830576:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14458 00000100:00100000:0.0:1746065185.833021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.833059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.833097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.833156:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263004672 00000100:00100000:2.0:1746065185.833162:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263004672 00000100:00100000:2.0:1746065185.833195:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14459 00000100:00100000:2.0:1746065185.833201:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263004672:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065185.833215:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.833228:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607cf expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.833276:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263004928 00000100:00100000:3.0:1746065185.833280:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263004928 00002000:00100000:3.0:1746065185.833304:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3313664->3317759) req@ffff88008ec2f100 x1830881263004928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.833313:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f100 with x1830881263004928 ext(3313664->3317759) 00002000:00010000:3.0:1746065185.833316:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2f100 00000100:00100000:3.0:1746065185.833339:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263005184 00000100:00100000:3.0:1746065185.833342:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263005184 00002000:00100000:3.0:1746065185.833352:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008ec2fb80 x1830881263005184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.833358:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2fb80 with x1830881263005184 ext(2097152->3145727) 00002000:00010000:3.0:1746065185.833361:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2fb80 00000100:00100000:3.0:1746065185.833372:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8126 00000100:00100000:3.0:1746065185.833376:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263004928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.833498:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263004928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 120us (438us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065185.833504:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8126 00002000:00100000:3.0:1746065185.833508:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3313664->3317759) req@ffff88008ec2f100 x1830881263004928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.833515:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f100 with x1830881263004928 ext(3313664->3317759) 00002000:00010000:3.0:1746065185.833518:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2f100 00000100:00100000:3.0:1746065185.833529:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8127 00000100:00100000:3.0:1746065185.833533:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263005184:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065185.833794:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.833797:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.833804:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.833844:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.833853:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a61200, rc 0) 00000100:00100000:2.0:1746065185.833874:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263004672:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 674us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.833879:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14459 00000100:00100000:1.0:1746065185.838761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.838801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.838834:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263005312 00000100:00100000:1.0:1746065185.838840:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263005312 00000100:00100000:1.0:1746065185.838874:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263005440 00000100:00100000:1.0:1746065185.838876:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263005440 00000100:00100000:1.0:1746065185.838890:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14460 00000100:00100000:1.0:1746065185.838897:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263005312:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065185.838910:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.838924:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fc8ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607d6 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.838948:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fc8ca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607d6 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.838957:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fc8ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607d6 expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.838969:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5a000, rc 0) 00000100:00100000:1.0:1746065185.839000:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263005312:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 104us (247us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065185.839006:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14460 00000100:00100000:1.0:1746065185.839023:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14461 00000100:00100000:1.0:1746065185.839027:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263005440:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065185.839033:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.839041:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607dd expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.839050:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.839052:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.839058:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.839069:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.839076:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5b400, rc 0) 00000100:00100000:1.0:1746065185.839090:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263005440:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.839094:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14461 00000100:00100000:1.0:1746065185.839160:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.839180:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263005696 00000100:00100000:1.0:1746065185.839182:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263005696 00000100:00100000:1.0:1746065185.839201:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4240 00000100:00100000:1.0:1746065185.839205:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:31714:x1830881263005696:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065185.839337:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+285:31714:x1830881263005696:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 130us (176us total) trans 8589944162 rc 0/0 00000100:00100000:1.0:1746065185.839342:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4240 00000100:00100000:0.0:1746065185.843541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.843647:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263005824 00000100:00100000:2.0:1746065185.843655:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263005824 00000100:00100000:2.0:1746065185.844530:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14462 00000100:00100000:2.0:1746065185.844539:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:31712:x1830881263005824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.844555:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.844574:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607e4 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.844599:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.844606:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.844607:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065185.844610:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.844636:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.844646:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 20 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.844656:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260335104:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.845275:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065185.845809:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263005184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12273us (12710us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065185.845834:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8127 00002000:00100000:3.0:1746065185.845844:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008ec2fb80 x1830881263005184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.845963:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2fb80 with x1830881263005184 ext(2097152->3145727) 00002000:00010000:3.0:1746065185.845970:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2fb80 00000100:00100000:0.0:1746065185.847127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.847262:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263006080 00000100:00100000:2.0:1746065185.847269:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263006080 00000100:00100000:2.0:1746065185.847442:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9936 00000100:00100000:2.0:1746065185.847449:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:31715:x1830881263006080:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065185.847464:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.847479:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc8df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607eb expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.847561:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.847575:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 17 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.847582:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065185.847608:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 17 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.847618:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 17 pid: 14645 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.847634:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260335232:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.848949:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.853111:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.853160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.853235:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260335104:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.853263:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.853278:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a60e00, rc 0) 00000100:00100000:3.0:1746065185.853308:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263006336 00000100:00100000:3.0:1746065185.853315:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263006336 00000100:00100000:3.0:1746065185.853348:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14463 00000100:00100000:3.0:1746065185.853639:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31707:x1830881263006336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.853652:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.853664:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607f2 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.853681:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065185.853686:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.853695:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.853701:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14e200, rc 0) 00000100:00100000:3.0:1746065185.853740:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31707:x1830881263006336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 386us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.853742:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+12:31712:x1830881263005824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9203us (10207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.853746:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14463 00000100:00100000:3.0:1746065185.853770:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263006208 00000100:00100000:3.0:1746065185.853773:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263006208 00002000:00100000:3.0:1746065185.853802:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3194880->3317759) req@ffff88009ba3f800 x1830881263006208/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.853811:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f800 with x1830881263006208 ext(3194880->3317759) 00010000:00010000:3.0:1746065185.853837:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 22 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.853846:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 22 pid: 2462 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065185.853852:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3f800 00000100:00100000:3.0:1746065185.853875:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2478 00000100:00100000:3.0:1746065185.853881:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263006208:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065185.854038:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14462 00000100:00100000:2.0:1746065185.856005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.856084:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260335232:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.856106:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065185.856292:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263006464 00000100:00100000:0.0:1746065185.856297:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263006464 00010000:00010000:0.0:1746065185.856318:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 18 pid: 14645 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.856337:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7388 00000100:00100000:0.0:1746065185.856343:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:1961:x1830881263006464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.856351:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065185.856356:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 18 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.856365:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 18 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.856382:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fc8ae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607ba expref: 18 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.856412:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065185.856416:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.856423:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.856432:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065185.856448:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.856470:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1961:x1830881263006464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 126us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.856475:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7388 00000100:00100000:3.0:1746065185.857849:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263006208:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3963us (4742us total) trans 21474840862 rc 0/0 00000100:00100000:3.0:1746065185.857858:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2478 00002000:00100000:3.0:1746065185.857866:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3194880->3317759) req@ffff88009ba3f800 x1830881263006208/t21474840862(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/448 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.857874:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f800 with x1830881263006208 ext(3194880->3317759) 00010000:00010000:3.0:1746065185.857882:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.857898:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065185.857904:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3f800 00010000:00010000:3.0:1746065185.857925:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.857931:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065185.857943:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065185.858027:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a61600/0x14b4f8542d4fc8df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607eb expref: 18 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.859076:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607eb expref: 17 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.859085:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.859088:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065185.859090:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a60200, rc 0) 00000100:00100000:3.0:1746065185.859419:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:31715:x1830881263006080:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 11969us (12293us total) trans 8589944163 rc 0/0 00000100:00100000:3.0:1746065185.859426:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9936 00000100:00100000:0.0:1746065185.861711:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.861797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.861890:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263006592 00000100:00100000:3.0:1746065185.861897:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263006592 00010000:00010000:3.0:1746065185.861921:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.861947:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7389 00000100:00100000:3.0:1746065185.861952:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263006592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.861962:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065185.861978:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.861988:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.862006:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009418b800/0x14b4f8542d4fc892 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3194880->4194303] (req 3194880->3317759) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607b3 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.862018:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.862020:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.862025:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.862033:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.862040:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.862041:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.862043:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.862049:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.862071:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.862082:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260335360:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065185.862146:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.862154:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260335488:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065185.862167:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065185.862180:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263006848 00000100:00100000:3.0:1746065185.862183:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263006848 00000100:00100000:3.0:1746065185.862203:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9937 00000100:00100000:3.0:1746065185.862207:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:31715:x1830881263006848:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065185.862222:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.862223:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065185.862235:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a60200/0x14b4f8542d4fc8e6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607eb expref: 17 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.862245:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.862248:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065185.862258:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5dc00/0x14b4f8542d4fc8fb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e607f9 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.862314:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.862327:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.862333:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065185.862341:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065185.862414:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5dc00/0x14b4f8542d4fc8fb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 19 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.862424:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 18 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.862430:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.862432:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065185.862434:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c5de00, rc 0) 00000100:00100000:3.0:1746065185.862453:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:31715:x1830881263006848:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 246us (657us total) trans 8589944164 rc 0/0 00000100:00100000:3.0:1746065185.862459:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9937 00000100:00100000:0.0:1746065185.864485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.864512:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.864534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.864546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.864565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.864607:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260335488:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065185.864640:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260335360:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065185.864659:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.864682:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263006592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2730us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.864690:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7389 00000100:00100000:1.0:1746065185.864810:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263006976 00000100:00100000:1.0:1746065185.864836:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263006976 00000100:00100000:1.0:1746065185.864858:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263007104 00000100:00100000:1.0:1746065185.864860:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263007104 00000100:00100000:1.0:1746065185.864870:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14464 00000100:00100000:1.0:1746065185.864879:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263006976:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065185.864902:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263007232 00000100:00100000:2.0:1746065185.864906:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263007232 00010000:00010000:1.0:1746065185.864907:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.864920:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.864927:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.864928:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263007360 00000100:00100000:2.0:1746065185.864930:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263007360 00010000:00010000:1.0:1746065185.864934:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 11 pid: 2462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.864939:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263007488 00010000:00010000:1.0:1746065185.864939:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065185.864941:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263007488 00010000:00010000:1.0:1746065185.864941:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.864943:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.864951:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14465 00000100:00100000:2.0:1746065185.864956:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263007104:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065185.864962:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 11 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.864972:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 11 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.864973:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.864983:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.864987:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260335616:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.864993:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.864999:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.865003:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.865004:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.865005:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.865018:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.865024:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 13 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065185.865031:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.865038:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 10 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.865043:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260335744:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.865045:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260335872:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.865063:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.865070:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 22 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.865071:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065185.865077:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260336000:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.865078:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 10 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.865085:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260336128:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.865088:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e729c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.865101:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14466 00010000:00010000:2.0:1746065185.865104:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.865105:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263007232:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065185.865111:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.865117:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260336256:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.865119:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.865127:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065185.865127:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.865139:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.865140:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14467 00000100:00100000:2.0:1746065185.865144:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263007360:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065185.865145:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.865150:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.865151:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.865153:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.865156:0:2463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.865164:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc55f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ad expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.865164:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.865170:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.865171:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 13 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.865175:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.865178:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260336384:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.865179:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.865180:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.865182:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.865196:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.865202:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 10 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746065185.865209:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260336512:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.865224:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.865230:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.865236:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260336640:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.865245:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065185.865292:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.865301:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.865308:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260336768:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.865343:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.865350:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 10 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.865358:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260336896:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.865367:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14468 00000100:00100000:3.0:1746065185.865373:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263007488:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065185.865387:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.865388:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc55f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ad expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865397:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.865400:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc55f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ad expref: 11 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.865403:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.865407:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260337024:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.865411:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865417:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.865421:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065185.865423:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865428:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746065185.865429:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746065185.865431:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 8/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865443:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865450:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 22 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.865457:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337152:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.865482:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865494:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 11 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.865502:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337280:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.865518:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865524:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.865531:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337408:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.865544:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865550:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.865557:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337536:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065185.865570:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 11 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.865577:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 11 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.865583:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337664:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.865594:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.865750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.865830:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263007616 00000100:00100000:0.0:1746065185.865833:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263007616 00000100:00100000:0.0:1746065185.865879:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14469 00000100:00100000:0.0:1746065185.865884:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263007616:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065185.865897:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.865911:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 13 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.865918:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.865924:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.865929:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.865930:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.865932:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.865945:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 22 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.865952:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 22 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.865959:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260337792:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.865986:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.865993:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 11 pid: 4545 timeout: 885 lvb_type: 1 00000100:00100000:0.0:1746065185.866005:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260337920:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.866020:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 13 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.866027:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.866033:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260338048:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.866043:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065185.867057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.867120:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263007872 00000100:00100000:3.0:1746065185.867124:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263007872 00002000:00100000:3.0:1746065185.867144:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880095351180 x1830881263007872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.867152:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351180 with x1830881263007872 ext(3145728->4194303) 00010000:00010000:3.0:1746065185.867157:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 23 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065185.867166:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 23 pid: 8851 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065185.867172:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095351180 00000100:00100000:3.0:1746065185.867193:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2479 00000100:00100000:3.0:1746065185.867198:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263007872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065185.870348:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260335616:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.872298:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260335744:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.872552:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260336000:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.876381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.876403:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260336128:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.876404:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263008128 00000100:00100000:0.0:1746065185.876410:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263008128 00010000:00010000:0.0:1746065185.876438:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 14 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:0.0:1746065185.876473:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7390 00000100:00100000:0.0:1746065185.876479:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263008128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.876489:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065185.876507:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 14 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746065185.876516:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 14 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746065185.876533:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a38a600/0x14b4f8542d4fc868 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6079e expref: 14 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746065185.876539:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260335872:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065185.876550:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065185.876561:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065185.876578:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263008128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.876582:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7390 00000100:00100000:1.0:1746065185.876840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.876847:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263008384 00000100:00100000:2.0:1746065185.876850:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263008384 00000100:00100000:1.0:1746065185.876855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065185.876865:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 11 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746065185.876866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.877237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.877652:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263008000 00000100:00100000:2.0:1746065185.877656:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263008000 00010000:00010000:2.0:1746065185.877669:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 25 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.877690:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263008256 00000100:00100000:2.0:1746065185.877693:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263008256 00010000:00010000:2.0:1746065185.877703:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 12 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.877712:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263008512 00000100:00100000:2.0:1746065185.877713:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263008512 00010000:00010000:2.0:1746065185.877721:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 12 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.877730:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7391 00000100:00100000:2.0:1746065185.877735:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263008384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.877741:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.877753:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 11 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.877761:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 11 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.877774:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a60a00/0x14b4f8542d4fc8b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c1 expref: 11 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.877800:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.877835:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263008384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 100us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.877840:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7391 00000100:00100000:2.0:1746065185.877852:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7392 00000100:00100000:2.0:1746065185.877857:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263008000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.877863:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.877870:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 25 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.877877:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 25 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.877887:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c25da00/0x14b4f8542d4fc83e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6077b expref: 25 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.877894:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.877907:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263008000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.877912:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7392 00000100:00100000:2.0:1746065185.877920:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7393 00000100:00100000:2.0:1746065185.877924:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263008256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.877931:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.877938:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 12 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.877945:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 12 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.877955:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a60400/0x14b4f8542d4fc8bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607c8 expref: 12 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065185.877963:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.877973:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263008256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.877978:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7393 00000100:00100000:3.0:1746065185.878959:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7394 00000100:00100000:3.0:1746065185.878997:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263008512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.879005:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065185.879017:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 12 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:0.0:1746065185.879071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.879090:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263008768 00000100:00100000:0.0:1746065185.879094:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263008768 00002000:00100000:0.0:1746065185.879116:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009c3fa680 x1830881263008768/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065185.879123:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881263008768 ext(3145728->4194303) 00010000:00010000:0.0:1746065185.879129:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.879137:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 13 pid: 2462 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746065185.879143:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3fa680 00000100:00100000:0.0:1746065185.879153:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2480 00000100:00100000:0.0:1746065185.879157:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263008768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065185.880103:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260336384:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065185.880249:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260336256:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065185.880275:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.880451:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 14 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746065185.880470:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fc85a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60797 expref: 14 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746065185.880497:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.880499:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.880503:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.880510:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.880530:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065185.880551:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263008512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1584us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.880557:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7394 00010000:00010000:1.0:1746065185.880645:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.880656:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.880675:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.880682:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.880688:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.880693:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5be00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065185.880697:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.880703:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.880717:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.880723:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fc910 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.880765:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263006976:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 15890us (16286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.880772:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14464 00000100:00100000:2.0:1746065185.882195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.883020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.883054:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263008896 00000100:00100000:1.0:1746065185.883062:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263008896 00000100:00100000:2.0:1746065185.883075:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260336768:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.883085:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 13 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.883106:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260336896:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.883107:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009024 00000100:00100000:3.0:1746065185.883111:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009024 00000100:00100000:1.0:1746065185.883118:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7395 00000100:00100000:1.0:1746065185.883125:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263008896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.883126:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 11 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.883131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065185.883135:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065185.883140:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009152 00000100:00100000:3.0:1746065185.883142:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009152 00010000:00010000:3.0:1746065185.883151:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 23 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.883151:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 13 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.883152:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260337024:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.883160:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 13 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746065185.883163:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7396 00000100:00100000:3.0:1746065185.883167:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263009024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065185.883173:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.883174:0:2463:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.883177:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a38ba00/0x14b4f8542d4fc861 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607a5 expref: 13 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746065185.883181:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 11 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:3.0:1746065185.883189:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 11 pid: 2462 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065185.883190:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7397 00000100:00100000:2.0:1746065185.883195:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263009152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.883198:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065185.883200:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065185.883212:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.883225:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263008896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 100us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.883230:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263009024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.883231:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7395 00000100:00100000:3.0:1746065185.883236:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7396 00000100:00100000:1.0:1746065185.883460:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260337792:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.883491:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260337920:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.883503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.883512:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009664 00000100:00100000:1.0:1746065185.883514:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009664 00010000:00010000:1.0:1746065185.883526:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.883544:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7398 00000100:00100000:1.0:1746065185.883550:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263009664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.883556:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.883566:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.883573:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 24 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.883586:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.883599:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263009664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.883604:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7398 00000100:00100000:1.0:1746065185.883628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.883638:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263010048 00000100:00100000:1.0:1746065185.883641:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263010048 00010000:00010000:1.0:1746065185.883650:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 24 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.883661:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7399 00000100:00100000:1.0:1746065185.883665:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263010048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.883667:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a61200/0x14b4f8542d4fc8c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607cf expref: 10 pid: 2462 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065185.883670:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.883676:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 24 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.883685:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260336512:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.883688:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 24 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.883694:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260336640:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.883697:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065185.883709:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.883710:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263010048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 45us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.883715:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7399 00010000:00010000:3.0:1746065185.883724:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fba5e00/0x14b4f8542d4fc61c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60624 expref: 23 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.883735:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337152:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065185.883744:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337280:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.883749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065185.883751:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9fc9200/0x14b4f8542d4fc703 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606a2 expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.883758:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337408:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.883763:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009536 00000100:00100000:3.0:1746065185.883764:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337536:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.883765:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009536 00000100:00100000:3.0:1746065185.883770:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260337664:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.883773:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.883805:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7400 00010000:00010000:3.0:1746065185.883806:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.883809:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263009536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065185.883841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.883850:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009280 00000100:00100000:0.0:1746065185.883853:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009280 00010000:00010000:0.0:1746065185.883865:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 24 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.883880:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7401 00000100:00100000:0.0:1746065185.883928:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263009280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.883938:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065185.883947:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263007872:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16748us (16892us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1746065185.883947:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 24 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.883954:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 24 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065185.883958:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2479 00010000:00010000:0.0:1746065185.883965:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a38b000/0x14b4f8542d4fc853 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60790 expref: 24 pid: 8851 timeout: 885 lvb_type: 0 00002000:00100000:3.0:1746065185.883967:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880095351180 x1830881263007872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.883975:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351180 with x1830881263007872 ext(3145728->4194303) 00010000:00010000:0.0:1746065185.883978:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.883979:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.883981:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 21 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.883982:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.883989:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 21 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.883989:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065185.883995:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095351180 00010000:00010000:0.0:1746065185.884004:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.884019:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263009280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 134us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.884024:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7401 00010000:00010000:1.0:1746065185.884044:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065185.884052:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.884056:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.884058:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.884063:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.884074:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73d400/0x14b4f8542d4fc56d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605bb expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.884076:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.884082:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065185.884082:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.884089:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.884097:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881263009536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 287us (349us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065185.884099:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a596d400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065185.884101:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.884103:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7400 00010000:00010000:0.0:1746065185.884107:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.884115:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.884120:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a596d400/0x14b4f8542d4fc91e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.884131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.884141:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009792 00000100:00100000:1.0:1746065185.884143:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009792 00010000:00010000:1.0:1746065185.884152:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 13 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.884163:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263007232:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 19057us (19627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.884169:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14466 00000100:00100000:1.0:1746065185.884177:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7402 00000100:00100000:1.0:1746065185.884182:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263009792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.884187:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.884194:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 13 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.884198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065185.884201:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 13 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.884208:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009920 00000100:00100000:0.0:1746065185.884210:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009920 00010000:00010000:1.0:1746065185.884212:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953d3600/0x14b4f8542d4fc75e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606e1 expref: 13 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.884219:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065185.884219:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc55f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ad expref: 13 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065185.884232:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7403 00000100:00100000:1.0:1746065185.884233:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263009792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.884236:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263009920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065185.884237:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7402 00010000:00010000:0.0:1746065185.884242:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065185.884250:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc55f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ad expref: 12 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.884257:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc55f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ad expref: 12 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.884267:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3d9600/0x14b4f8542d4fc55f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605ad expref: 12 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.884272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065185.884274:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.884282:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263010176 00000100:00100000:1.0:1746065185.884285:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263010176 00000100:00100000:0.0:1746065185.884289:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263009920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.884293:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7403 00010000:00010000:1.0:1746065185.884295:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 9 pid: 4545 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746065185.884308:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7404 00000100:00100000:1.0:1746065185.884312:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263010176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.884318:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.884326:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 9 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065185.884333:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 9 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065185.884342:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5b400/0x14b4f8542d4fc8d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607dd expref: 9 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065185.884349:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.884363:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263010176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.884368:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7404 00000100:00100000:0.0:1746065185.884415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.884425:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263009408 00000100:00100000:0.0:1746065185.884428:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263009408 00010000:00010000:0.0:1746065185.884438:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 9 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:0.0:1746065185.884451:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7405 00000100:00100000:1.0:1746065185.884453:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260338048:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065185.884455:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263009408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065185.884461:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.884468:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.884469:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 9 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746065185.884475:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 9 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:0.0:1746065185.884489:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fba4600/0x14b4f8542d4fc5d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e605f3 expref: 9 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746065185.884497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065185.884497:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.884498:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.884500:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.884506:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263010304 00010000:00010000:0.0:1746065185.884506:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.884508:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263010304 00010000:00010000:1.0:1746065185.884516:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 23 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065185.884520:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.884528:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7406 00000100:00100000:1.0:1746065185.884531:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263010304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.884536:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.884542:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 23 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.884548:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 23 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.884557:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129b54600/0x14b4f8542d4fc77a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606fd expref: 23 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.884563:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065185.884802:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263009408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 345us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.884807:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7405 00010000:00010000:2.0:1746065185.884896:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.884904:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.884915:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a38ae00/0x14b4f8542d4fc84c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60789 expref: 22 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.884922:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.884923:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.884926:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.884932:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.884945:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065185.884953:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.884959:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.884972:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.884978:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.884983:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.884991:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a60c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065185.884994:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.885000:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.885007:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.885011:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fc917 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.885566:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263010304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1031us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.885571:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7406 00000100:00100000:0.0:1746065185.885653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.885662:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263009152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2465us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.885669:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7397 00000100:00100000:1.0:1746065185.885690:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263010432 00000100:00100000:1.0:1746065185.885693:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263010432 00010000:00010000:1.0:1746065185.885705:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 12 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.885716:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7407 00000100:00100000:1.0:1746065185.885720:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263010432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.885725:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.885732:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 12 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.885739:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 12 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.885748:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129b55200/0x14b4f8542d4fc76c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606ef expref: 12 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.885754:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.885756:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.885758:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885765:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885775:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.885798:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263010432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.885802:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7407 00010000:00010000:1.0:1746065185.885827:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885833:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885843:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885850:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885855:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885859:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065185.885861:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885866:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885873:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.885877:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9200/0x14b4f8542d4fc933 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.885906:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263007616:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 20023us (20157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.885911:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14469 00010000:00010000:2.0:1746065185.885924:0:2463:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.885931:0:2463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.885949:0:2463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.885960:0:2463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.885966:0:2463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.885970:0:2463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d75d400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065185.885972:0:2463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.885977:0:2463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.885986:0:2463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.885992:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d75d400/0x14b4f8542d4fc925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.886036:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263007360:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 20891us (21489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.886042:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14467 00000100:00100000:3.0:1746065185.886137:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263007104:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 21179us (21622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.886143:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14465 00000100:00100000:0.0:1746065185.889409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.889603:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263010688 00000100:00100000:1.0:1746065185.889610:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263010688 00000100:00100000:1.0:1746065185.889654:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9938 00000100:00100000:1.0:1746065185.889660:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+40:31718:x1830881263010688:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065185.889679:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.889693:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fe600/0x14b4f8542d4fc93a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60800 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.889776:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065185.889800:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 17 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.889806:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065185.889862:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 17 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.889872:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 17 pid: 14645 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.889882:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa74700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260338176:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065185.889943:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065185.893115:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263008768:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13945us (14033us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.893126:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2480 00002000:00100000:2.0:1746065185.893568:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009c3fa680 x1830881263008768/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.893577:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881263008768 ext(3145728->4194303) 00010000:00010000:2.0:1746065185.893587:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 9 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.893598:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 9 pid: 2462 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746065185.893605:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3fa680 00000100:00100000:1.0:1746065185.896693:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa74700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260338176:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065185.896720:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065185.900302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.900402:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.900654:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263010816 00000100:00100000:3.0:1746065185.900664:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263010816 00000100:00100000:2.0:1746065185.900772:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263010944 00000100:00100000:2.0:1746065185.900775:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263010944 00010000:00010000:2.0:1746065185.900805:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 18 pid: 14645 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065185.900857:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7408 00000100:00100000:2.0:1746065185.900864:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:1959:x1830881263010944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065185.900874:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065185.900879:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 18 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.900893:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 18 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.900911:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c5de00/0x14b4f8542d4fc902 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f9 expref: 18 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065185.900940:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065185.900945:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065185.900952:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065185.900957:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065185.900976:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.901010:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:1959:x1830881263010944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 147us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.901016:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7408 00010000:00010000:1.0:1746065185.901298:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065185.901305:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065185.901325:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065185.901443:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fe600/0x14b4f8542d4fc93a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 43 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.901467:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 42 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.901473:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065185.901475:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065185.901477:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58fec00, rc 0) 00000100:00100000:1.0:1746065185.901501:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+42:31718:x1830881263010688:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11840us (12097us total) trans 8589944165 rc 0/0 00000100:00100000:1.0:1746065185.901506:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9938 00000100:00100000:3.0:1746065185.901540:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14470 00000100:00100000:3.0:1746065185.901548:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:31707:x1830881263010816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.901559:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.901570:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60807 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065185.901589:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d721, atime: 0x6812d722, ctime: 0x6812d721, blocks: 0x1029 00010000:00010000:3.0:1746065185.901603:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.901605:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.901610:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.901620:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.901627:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211200, rc 0) 00000100:00100000:3.0:1746065185.901648:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31707:x1830881263010816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 102us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.901653:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14470 00000100:00100000:0.0:1746065185.902486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.902525:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.902743:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263011072 00000100:00100000:2.0:1746065185.902749:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263011072 00000100:00100000:2.0:1746065185.902795:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14471 00000100:00100000:2.0:1746065185.902801:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+11:31712:x1830881263011072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.902810:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.902849:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6080e expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.902869:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.902870:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.902875:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 12 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.902889:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 12 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.902896:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b0400, rc 0) 00000100:00100000:2.0:1746065185.902919:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:31712:x1830881263011072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 118us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.902925:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14471 00000100:00100000:1.0:1746065185.902961:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263011200 00000100:00100000:1.0:1746065185.902966:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263011200 00010000:00010000:1.0:1746065185.902986:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 19 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.903009:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7409 00000100:00100000:1.0:1746065185.903015:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881263011200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.903023:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.903039:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 19 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.903047:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 19 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.903066:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e200/0x14b4f8542d4fc8ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607f2 expref: 19 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.903076:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.903092:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881263011200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.903097:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7409 00000100:00100000:3.0:1746065185.903247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.904233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.904318:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263011456 00000100:00100000:2.0:1746065185.904323:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263011456 00000100:00100000:2.0:1746065185.904346:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14472 00000100:00100000:2.0:1746065185.904351:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:31718:x1830881263011456:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065185.904362:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.904374:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60815 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065185.904392:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d722, atime: 0x6812d722, ctime: 0x6812d722, blocks: 0x821 00010000:00010000:2.0:1746065185.904404:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.904405:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.904411:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.904425:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.904432:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418b800, rc 0) 00000100:00100000:1.0:1746065185.904456:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263011328 00000100:00100000:1.0:1746065185.904460:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263011328 00010000:00010000:1.0:1746065185.904474:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 9 pid: 2462 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065185.904491:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7410 00000100:00100000:1.0:1746065185.904496:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263011328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065185.904503:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.904515:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 9 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.904523:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 9 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.904536:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fc8d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e607e4 expref: 9 pid: 2462 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065185.904546:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.904548:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.904551:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.904557:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.904582:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065185.904600:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:31718:x1830881263011456:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 247us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.904600:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263011328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.904605:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14472 00000100:00100000:1.0:1746065185.904605:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7410 00010000:00010000:3.0:1746065185.904658:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.904665:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.904683:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.904689:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.904695:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.904705:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f14e600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065185.904708:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.904715:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.904724:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.904774:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e600/0x14b4f8542d4fc92c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.904913:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263007488:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 39540us (40346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.904919:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14468 00000100:00100000:0.0:1746065185.906113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.906157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.906211:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263011968 00000100:00100000:2.0:1746065185.906216:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263011968 00002000:00100000:2.0:1746065185.906242:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1921024->1925119) req@ffff88009ba1d180 x1830881263011968/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.906251:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d180 with x1830881263011968 ext(1921024->1925119) 00002000:00010000:2.0:1746065185.906255:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d180 00000100:00100000:2.0:1746065185.906267:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263011840 00000100:00100000:2.0:1746065185.906270:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263011840 00002000:00100000:2.0:1746065185.906280:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012bd3d500 x1830881263011840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.906286:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d500 with x1830881263011840 ext(3145728->4194303) 00002000:00010000:2.0:1746065185.906289:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3d500 00000100:00100000:3.0:1746065185.906300:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8128 00000100:00100000:3.0:1746065185.906307:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263011968:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065185.906312:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8129 00000100:00100000:2.0:1746065185.906317:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263011840:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.906706:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263011968:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 399us (594us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065185.906712:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8128 00002000:00100000:3.0:1746065185.906718:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1921024->1925119) req@ffff88009ba1d180 x1830881263011968/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.906725:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d180 with x1830881263011968 ext(1921024->1925119) 00002000:00010000:3.0:1746065185.906728:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d180 00000100:00100000:0.0:1746065185.907009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.907028:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263012224 00000100:00100000:1.0:1746065185.907032:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263012224 00000100:00100000:1.0:1746065185.907066:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9939 00000100:00100000:1.0:1746065185.907071:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:31715:x1830881263012224:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:1.0:1746065185.907101:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065185.907122:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe13a00/0x14b4f8542d4fc749 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e606d3 expref: 17 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.907134:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065185.907138:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065185.907176:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:31715:x1830881263012224:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 105us (167us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746065185.907181:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9939 00000100:00100000:0.0:1746065185.907944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.908671:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263012480 00000100:00100000:3.0:1746065185.908678:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263012480 00002000:00100000:3.0:1746065185.908707:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009f2c5180 x1830881263012480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.908715:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5180 with x1830881263012480 ext(3145728->4194303) 00002000:00010000:3.0:1746065185.908719:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c5180 00000100:00100000:3.0:1746065185.908747:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8130 00000100:00100000:3.0:1746065185.908754:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263012480:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065185.911247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.911287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.911357:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263012736 00000100:00100000:1.0:1746065185.911365:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263012736 00002000:00100000:1.0:1746065185.911398:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1941504->1945599) req@ffff88009f2c6680 x1830881263012736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.911412:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6680 with x1830881263012736 ext(1941504->1945599) 00002000:00010000:1.0:1746065185.911415:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c6680 00000100:00100000:1.0:1746065185.911430:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8131 00000100:00100000:1.0:1746065185.911437:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263012736:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065185.911572:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263012736:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 134us (329us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065185.911579:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8131 00002000:00100000:1.0:1746065185.911584:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1941504->1945599) req@ffff88009f2c6680 x1830881263012736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/4536 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065185.911590:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6680 with x1830881263012736 ext(1941504->1945599) 00002000:00010000:1.0:1746065185.911593:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c6680 00000100:00100000:3.0:1746065185.911673:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263012992 00000100:00100000:3.0:1746065185.911678:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263012992 00000100:00100000:3.0:1746065185.911700:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4241 00000100:00100000:3.0:1746065185.911704:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:31715:x1830881263012992:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065185.911864:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:31715:x1830881263012992:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 158us (576us total) trans 8589944166 rc 0/0 00000100:00100000:3.0:1746065185.911869:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4241 00000100:00100000:2.0:1746065185.916413:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263011840:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10087us (10247us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.916426:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8129 00002000:00100000:2.0:1746065185.916435:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012bd3d500 x1830881263011840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.916444:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d500 with x1830881263011840 ext(3145728->4194303) 00002000:00010000:2.0:1746065185.916448:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3d500 00000100:00100000:0.0:1746065185.917309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.917453:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263013248 00000100:00100000:1.0:1746065185.917461:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263013248 00000100:00100000:1.0:1746065185.917505:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4242 00000100:00100000:1.0:1746065185.917512:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:31715:x1830881263013248:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065185.917668:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:31715:x1830881263013248:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 157us (362us total) trans 8589944167 rc 0/0 00000100:00100000:1.0:1746065185.917673:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4242 00000100:00100000:2.0:1746065185.919271:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263012480:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10512us (11325us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065185.919280:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8130 00002000:00100000:2.0:1746065185.919289:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009f2c5180 x1830881263012480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.919297:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5180 with x1830881263012480 ext(3145728->4194303) 00002000:00010000:2.0:1746065185.919302:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c5180 00000100:00100000:0.0:1746065185.920648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.920721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.920974:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263013376 00000100:00100000:3.0:1746065185.920983:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263013376 00000100:00100000:2.0:1746065185.920999:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263013504 00000100:00100000:2.0:1746065185.921003:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263013504 00000100:00100000:3.0:1746065185.921017:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14473 00000100:00100000:1.0:1746065185.921061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.921117:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881263013376:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065185.921198:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263013632 00000100:00100000:2.0:1746065185.921202:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263013632 00000100:00100000:2.0:1746065185.921226:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14474 00000100:00100000:2.0:1746065185.921231:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263013504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.921241:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.921258:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60823 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065185.921279:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d722, atime: 0x6812d721, ctime: 0x6812d722, blocks: 0x821 00010000:00010000:2.0:1746065185.921294:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.921296:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.921303:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 23 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.921316:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 23 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.921325:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501e00, rc 0) 00000100:00100000:2.0:1746065185.921354:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263013504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 123us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.921359:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14474 00000100:00100000:2.0:1746065185.921372:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14475 00000100:00100000:2.0:1746065185.921376:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263013632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.921381:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.921387:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4fc96b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6082a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065185.921415:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260338304:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065185.921434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065185.921542:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.921554:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6081c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065185.921569:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d722, atime: 0x6812d722, ctime: 0x6812d722, blocks: 0x7a9 00000100:00100000:0.0:1746065185.921577:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263013760 00010000:00010000:3.0:1746065185.921580:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065185.921581:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263013760 00010000:00010000:3.0:1746065185.921582:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065185.921587:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.921596:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 20 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.921603:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210a00, rc 0) 00000100:00100000:0.0:1746065185.921603:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14476 00000100:00100000:0.0:1746065185.921608:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263013760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065185.921614:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.921623:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60831 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065185.921642:0:25185:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d721, atime: 0x6812d720, ctime: 0x6812d721, blocks: 0x821 00010000:00010000:0.0:1746065185.921649:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.921650:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.921655:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 21 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.921664:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 21 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.921671:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596d200, rc 0) 00000100:00100000:1.0:1746065185.921687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.921688:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263013760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.921693:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14476 00000100:00100000:1.0:1746065185.921700:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263013888 00000100:00100000:1.0:1746065185.921703:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263013888 00000100:00100000:1.0:1746065185.921721:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14477 00000100:00100000:1.0:1746065185.921725:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263013888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065185.921732:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.921739:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60838 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065185.921749:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d722, atime: 0x6812d722, ctime: 0x6812d722, blocks: 0x168b 00010000:00010000:1.0:1746065185.921756:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.921757:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.921761:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 22 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.921769:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 22 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.921775:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8800, rc 0) 00000100:00100000:2.0:1746065185.921802:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065185.921802:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263013888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 76us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065185.921807:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14477 00000100:00100000:3.0:1746065185.922923:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263013376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1898us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065185.922929:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14473 00000100:00100000:0.0:1746065185.926011:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.926044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.926257:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263014016 00000100:00100000:2.0:1746065185.926266:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263014016 00000100:00100000:0.0:1746065185.926267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.926643:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263014144 00000100:00100000:2.0:1746065185.926647:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263014144 00000100:00100000:0.0:1746065185.926666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065185.926671:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263014272 00000100:00100000:2.0:1746065185.926674:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263014272 00000100:00100000:0.0:1746065185.926681:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263014400 00000100:00100000:0.0:1746065185.926684:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263014400 00000100:00100000:2.0:1746065185.926691:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14478 00000100:00100000:2.0:1746065185.926698:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263014016:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065185.926704:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14479 00000100:00100000:0.0:1746065185.926709:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263014144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.926713:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065185.926717:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065185.926727:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6083f expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065185.926727:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60846 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065185.926747:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.926748:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.926755:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.926768:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065185.926785:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14480 00010000:00010000:2.0:1746065185.926789:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500e00, rc 0) 00000100:00100000:1.0:1746065185.926793:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263014272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065185.926799:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065185.926806:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6084d expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065185.926837:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.926838:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065185.926844:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065185.926845:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263014016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 147us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.926850:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14478 00010000:00010000:1.0:1746065185.926853:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065185.926860:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9400, rc 0) 00000100:00100000:2.0:1746065185.926863:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14481 00000100:00100000:2.0:1746065185.926867:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263014400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065185.926873:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065185.926878:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263014272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 87us (612us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065185.926879:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60854 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065185.926883:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14480 00010000:00010000:2.0:1746065185.926888:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.926889:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065185.926892:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.926899:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.926909:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501600, rc 0) 00000100:00100000:2.0:1746065185.926922:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263014400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065185.926926:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14481 00000100:00100000:2.0:1746065185.926976:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260338304:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065185.926998:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4fc96b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6082a expref: 23 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.927005:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d500c00/0x14b4f8542d4fc96b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6082a expref: 23 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065185.927016:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500c00, rc 0) 00000100:00100000:2.0:1746065185.927033:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263013632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5656us (5972us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065185.927038:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14475 00010000:00010000:0.0:1746065185.928521:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.928524:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065185.928532:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 14 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.928544:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 14 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065185.928553:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596c600, rc 0) 00000100:00100000:0.0:1746065185.928588:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263014144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1878us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065185.928593:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14479 00000100:00100000:0.0:1746065185.932502:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065185.932547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.933420:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263014912 00000100:00100000:2.0:1746065185.933420:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263014784 00000100:00100000:3.0:1746065185.933428:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263014912 00000100:00100000:2.0:1746065185.933428:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263014784 00002000:00100000:2.0:1746065185.933468:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880133265f80 x1830881263014784/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.933477:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133265f80 with x1830881263014784 ext(4194304->5013503) 00002000:00010000:2.0:1746065185.933481:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133265f80 00002000:00100000:3.0:1746065185.933485:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880133266300 x1830881263014912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/0 e 0 to 0 dl 1746065196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.933491:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133266300 with x1830881263014912 ext(4194304->5013503) 00002000:00010000:3.0:1746065185.933493:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133266300 00000100:00100000:2.0:1746065185.933497:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8132 00000100:00100000:2.0:1746065185.933503:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263014784:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.933574:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8133 00000100:00100000:3.0:1746065185.933579:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263014912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065185.941070:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263014912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7480us (8511us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065185.941081:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8133 00002000:00100000:3.0:1746065185.941092:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880133266300 x1830881263014912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065185.941106:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133266300 with x1830881263014912 ext(4194304->5013503) 00002000:00010000:3.0:1746065185.941111:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133266300 00000100:00100000:2.0:1746065185.943297:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263014784:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9788us (10798us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065185.943305:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8132 00002000:00100000:2.0:1746065185.943313:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880133265f80 x1830881263014784/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:101/0 lens 488/440 e 0 to 0 dl 1746065196 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065185.943322:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133265f80 with x1830881263014784 ext(4194304->5013503) 00002000:00010000:2.0:1746065185.943326:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133265f80 00000100:00100000:0.0:1746065185.947652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.948956:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015040 00000100:00100000:3.0:1746065185.948966:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015040 00000100:00100000:3.0:1746065185.949007:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14482 00000100:00100000:3.0:1746065185.949015:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263015040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.949036:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.949051:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a211400/0x14b4f8542d4fc9a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6085b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.949093:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260338432:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065185.949172:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065185.952441:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260338432:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065185.952472:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a211400/0x14b4f8542d4fc9a3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6085b expref: 23 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.952483:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a211400/0x14b4f8542d4fc9a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6085b expref: 23 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.952508:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211400, rc 0) 00000100:00100000:3.0:1746065185.954382:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263015040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5358us (6727us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065185.954390:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14482 00000100:00100000:0.0:1746065185.962447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.962536:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015168 00000100:00100000:3.0:1746065185.962544:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015168 00000100:00100000:3.0:1746065185.962582:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14483 00000100:00100000:3.0:1746065185.962589:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263015168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065185.962841:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.962858:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a211a00/0x14b4f8542d4fc9aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60862 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065185.962906:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260338560:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065185.962994:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065185.970371:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260338560:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065185.970409:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a211a00/0x14b4f8542d4fc9aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60862 expref: 23 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.970422:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a211a00/0x14b4f8542d4fc9aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60862 expref: 23 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065185.970446:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211a00, rc 0) 00000100:00100000:3.0:1746065185.970484:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263015168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7894us (8044us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065185.970491:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14483 00000100:00100000:0.0:1746065185.976494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065185.979677:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015424 00000100:00100000:1.0:1746065185.979688:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015424 00000100:00100000:1.0:1746065185.979745:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4243 00000100:00100000:1.0:1746065185.979752:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+285:31707:x1830881263015424:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065185.979975:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+286:31707:x1830881263015424:12345-192.168.202.46@tcp:35:cat.0 Request processed in 223us (3488us total) trans 8589944168 rc 0/0 00000100:00100000:1.0:1746065185.979982:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4243 00000100:00100000:1.0:1746065185.981276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065185.990736:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015680 00000100:00100000:3.0:1746065185.990747:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015680 00000100:00100000:3.0:1746065185.990834:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9940 00000100:00100000:3.0:1746065185.990843:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+286:31723:x1830881263015680:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065185.990862:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065185.990880:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fc9b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60869 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.990968:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.990979:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.990989:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.990999:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991004:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991009:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991089:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210400/0x14b4f8542d4fc9c6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991096:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210400/0x14b4f8542d4fc9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991101:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210400/0x14b4f8542d4fc9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065185.991108:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065185.991174:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991180:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991189:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991194:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a210800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.991198:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991203:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991211:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065185.991213:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065185.991216:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991220:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fc9b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991245:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991249:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991253:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991257:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a210600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065185.991259:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991263:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991271:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205100) 00010000:00010000:3.0:1746065185.991273:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065185.991275:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991279:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210600/0x14b4f8542d4fc9bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065185.991310:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fc9b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60869 expref: 289 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.991320:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210400/0x14b4f8542d4fc9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60869 expref: 288 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065185.991325:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065185.991327:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065185.991328:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210400, rc 0) 00000100:00100000:3.0:1746065185.991391:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:31723:x1830881263015680:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 549us (10118us total) trans 8589944169 rc 0/0 00000100:00100000:3.0:1746065185.991397:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9940 00000100:00100000:0.0:1746065186.000367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.000437:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015808 00000100:00100000:2.0:1746065186.000446:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015808 00000100:00100000:2.0:1746065186.000497:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 749 00000100:00100000:2.0:1746065186.000505:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:1961:x1830881263015808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.000516:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.000534:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210400/0x14b4f8542d4fc9c6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60869 expref: 288 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.000552:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.000556:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.000590:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+287:1961:x1830881263015808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.000596:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 749 00010000:00010000:3.0:1746065186.003410:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065186.070393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.070485:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263015936 00000100:00100000:3.0:1746065186.070492:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263015936 00000100:00100000:3.0:1746065186.070541:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14484 00000100:00100000:3.0:1746065186.070549:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:31726:x1830881263015936:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065186.070565:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.070580:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60870 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.070609:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.070616:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 15 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.070621:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.070622:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.070626:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1056768->1400831] (req 1056768->1400831) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.070651:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 15 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.070660:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 15 pid: 8427 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746065186.070670:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260338688:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.070763:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.070771:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 21 pid: 21998 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746065186.070809:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260338816:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065186.070867:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.076322:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260338688:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.076472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.076508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.076525:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016064 00000100:00100000:2.0:1746065186.076530:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016064 00010000:00010000:2.0:1746065186.076556:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 16 pid: 8427 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065186.076577:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016192 00000100:00100000:2.0:1746065186.076579:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016192 00010000:00010000:2.0:1746065186.076590:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 22 pid: 21998 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065186.076601:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7411 00000100:00100000:2.0:1746065186.076606:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263016064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.076616:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.076631:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 16 pid: 8427 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.076639:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 16 pid: 8427 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.076657:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fc98e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60846 expref: 16 pid: 8427 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.076670:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.076711:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263016064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.076716:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7411 00000100:00100000:2.0:1746065186.076726:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7412 00000100:00100000:2.0:1746065186.076730:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263016192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.076734:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.076740:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 22 pid: 21998 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.076747:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 22 pid: 21998 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.076756:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.076757:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.076762:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 14 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.076769:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 14 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.076802:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 14 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.076811:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260338944:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065186.076868:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad840 going to sleep for 11 seconds 00000100:00080000:2.0:1746065186.076879:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065186.077311:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fc964 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60823 expref: 22 pid: 21998 timeout: 885 lvb_type: 1 00000100:00100000:3.0:1746065186.077323:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260338816:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.077339:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 14 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.077347:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211e00, rc 0) 00000100:00100000:3.0:1746065186.078222:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:31726:x1830881263015936:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7672us (7834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.078229:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14484 00000100:00100000:2.0:1746065186.080168:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260338944:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065186.080175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065186.080185:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.080302:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263016192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3480us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.080311:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7412 00000100:00100000:3.0:1746065186.080379:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016448 00000100:00100000:3.0:1746065186.080385:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016448 00002000:00100000:3.0:1746065186.080415:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1056768->1060863) req@ffff88009fa76300 x1830881263016448/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.080423:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa76300 with x1830881263016448 ext(1056768->1060863) 00002000:00010000:3.0:1746065186.080427:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa76300 00000100:00100000:3.0:1746065186.080442:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8134 00000100:00100000:3.0:1746065186.080448:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263016448:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065186.080575:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263016448:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 127us (399us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065186.080581:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8134 00002000:00100000:3.0:1746065186.080586:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1056768->1060863) req@ffff88009fa76300 x1830881263016448/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.080592:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa76300 with x1830881263016448 ext(1056768->1060863) 00002000:00010000:3.0:1746065186.080595:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa76300 00000100:00100000:0.0:1746065186.084486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.084727:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016704 00000100:00100000:2.0:1746065186.084735:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016704 00002000:00100000:2.0:1746065186.084768:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1396736->1400831) req@ffff880133265c00 x1830881263016704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.084787:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133265c00 with x1830881263016704 ext(1396736->1400831) 00002000:00010000:2.0:1746065186.084791:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133265c00 00000100:00100000:2.0:1746065186.084840:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8135 00000100:00100000:2.0:1746065186.084847:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263016704:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065186.084991:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263016704:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 144us (510us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065186.084997:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8135 00002000:00100000:2.0:1746065186.085002:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1396736->1400831) req@ffff880133265c00 x1830881263016704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.085008:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133265c00 with x1830881263016704 ext(1396736->1400831) 00002000:00010000:2.0:1746065186.085011:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133265c00 00000100:00100000:0.0:1746065186.089057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.089398:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016832 00000100:00100000:3.0:1746065186.089406:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016832 00000100:00100000:3.0:1746065186.089450:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14485 00000100:00100000:3.0:1746065186.089456:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31723:x1830881263016832:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065186.089471:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.089484:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60877 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.089505:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.089512:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 13 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.089517:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.089518:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.089521:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3371008->4018175] (req 3371008->4018175) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.089542:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 13 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.089551:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 13 pid: 2463 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.089561:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260339072:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.092177:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.092193:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 22 pid: 21998 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.092204:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260339200:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.092479:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.096225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.096268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.096450:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263016960 00000100:00100000:3.0:1746065186.096458:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263016960 00010000:00010000:3.0:1746065186.096488:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 23 pid: 21998 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.096511:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263017088 00000100:00100000:3.0:1746065186.096513:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263017088 00010000:00010000:3.0:1746065186.096522:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 14 pid: 2463 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.096534:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7413 00000100:00100000:3.0:1746065186.096540:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263016960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.096549:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.096567:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 23 pid: 21998 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.096576:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 23 pid: 21998 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.096595:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.096625:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263016960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.096630:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7413 00000100:00100000:3.0:1746065186.096642:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7414 00000100:00100000:3.0:1746065186.096647:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263017088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.096652:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.096659:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 14 pid: 2463 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.096667:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 14 pid: 2463 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.096677:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.096679:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.096684:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.096692:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.096715:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.096725:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260339328:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.096768:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00540 going to sleep for 11 seconds 00010000:00010000:2.0:1746065186.096941:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fc956 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6080e expref: 14 pid: 2463 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.096955:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260339072:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.096964:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a211200/0x14b4f8542d4fc94f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60807 expref: 22 pid: 21998 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.096970:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260339200:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.096990:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.096998:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210800, rc 0) 00000100:00100000:2.0:1746065186.097019:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31723:x1830881263016832:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7563us (7968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.097025:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14485 00000100:00100000:3.0:1746065186.098266:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260339328:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.098277:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.098296:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263017088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1649us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.098303:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7414 00000100:00100000:0.0:1746065186.100733:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.100847:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263017344 00000100:00100000:3.0:1746065186.100855:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263017344 00002000:00100000:3.0:1746065186.100888:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3371008->3375103) req@ffff8800a90afb80 x1830881263017344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.100897:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90afb80 with x1830881263017344 ext(3371008->3375103) 00002000:00010000:3.0:1746065186.100901:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90afb80 00000100:00100000:3.0:1746065186.101046:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8136 00000100:00100000:3.0:1746065186.101052:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263017344:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065186.101298:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263017344:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 244us (569us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065186.101305:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8136 00002000:00100000:3.0:1746065186.101310:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3371008->3375103) req@ffff8800a90afb80 x1830881263017344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.101318:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90afb80 with x1830881263017344 ext(3371008->3375103) 00002000:00010000:3.0:1746065186.101320:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90afb80 00000100:00100000:1.0:1746065186.105076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.105161:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263017600 00000100:00100000:2.0:1746065186.105170:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263017600 00000100:00100000:2.0:1746065186.105206:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9941 00000100:00100000:2.0:1746065186.105213:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+287:31731:x1830881263017600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.105231:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.105245:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500600/0x14b4f8542d4fc9e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6087e expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.105334:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105344:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105353:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105367:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105371:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105376:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105456:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501400/0x14b4f8542d4fc9f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105463:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501400/0x14b4f8542d4fc9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105469:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501400/0x14b4f8542d4fc9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:2.0:1746065186.105475:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065186.105539:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105544:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105550:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105555:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d501000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065186.105558:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105563:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105572:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065186.105575:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065186.105578:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105582:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501000/0x14b4f8542d4fc9e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105590:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105595:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105599:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105602:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d500c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065186.105604:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105608:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105613:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fae00) 00010000:00010000:2.0:1746065186.105615:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065186.105617:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105620:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500c00/0x14b4f8542d4fc9f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.105648:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d500600/0x14b4f8542d4fc9e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6087e expref: 290 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.105658:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501400/0x14b4f8542d4fc9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6087e expref: 289 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.105663:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.105665:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065186.105667:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501400, rc 0) 00000100:00100000:2.0:1746065186.105703:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:31731:x1830881263017600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 491us (635us total) trans 8589944170 rc 0/0 00000100:00100000:2.0:1746065186.105709:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9941 00000100:00100000:0.0:1746065186.107374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.108338:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263017728 00000100:00100000:3.0:1746065186.108346:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263017728 00000100:00100000:3.0:1746065186.108384:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 750 00000100:00100000:3.0:1746065186.108391:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:1958:x1830881263017728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.108406:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.108428:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d501400/0x14b4f8542d4fc9f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6087e expref: 289 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.108456:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.108460:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.108598:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:1958:x1830881263017728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 206us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.108605:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 750 00000100:00100000:2.0:1746065186.109034:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.109059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.109189:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263017856 00000100:00100000:0.0:1746065186.109193:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263017856 00000100:00100000:0.0:1746065186.109212:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263017984 00000100:00100000:0.0:1746065186.109214:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263017984 00000100:00100000:0.0:1746065186.109225:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14486 00000100:00100000:0.0:1746065186.109229:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263017856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065186.109241:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.109251:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941cac00/0x14b4f8542d4fca05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60885 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065186.109288:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260339456:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065186.109335:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.109363:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14487 00000100:00100000:2.0:1746065186.109369:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263017984:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.109376:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.109382:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fca0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6088c expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065186.109426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.109471:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263018240 00000100:00100000:1.0:1746065186.109474:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263018240 00002000:00100000:1.0:1746065186.109497:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (4014080->4018175) req@ffff88009fa74000 x1830881263018240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065186.109505:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260339584:192.168.202.46@tcp:106: 00002000:00100000:1.0:1746065186.109505:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74000 with x1830881263018240 ext(4014080->4018175) 00002000:00010000:1.0:1746065186.109508:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa74000 00000100:00100000:1.0:1746065186.109522:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8137 00000100:00100000:2.0:1746065186.109528:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.109533:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263018240:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065186.109651:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263018240:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 124us (225us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065186.109657:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8137 00002000:00100000:1.0:1746065186.109662:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (4014080->4018175) req@ffff88009fa74000 x1830881263018240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.109668:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74000 with x1830881263018240 ext(4014080->4018175) 00002000:00010000:1.0:1746065186.109671:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa74000 00002000:00010000:2.0:1746065186.110758:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime: 1746065186 -> 1746065187 00002000:00010000:2.0:1746065186.110762:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065185 -> 1746065186 00002000:00010000:2.0:1746065186.110763:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime: 1746065186 -> 1746065187 00000100:00100000:2.0:1746065186.110791:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260339456:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.110811:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941cac00/0x14b4f8542d4fca05 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60885 expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.110844:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941cac00/0x14b4f8542d4fca05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60885 expref: 24 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.111480:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941cac00, rc 0) 00000100:00100000:2.0:1746065186.111520:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263017856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2288us (2485us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.111526:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14486 00000100:00100000:1.0:1746065186.112138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:3.0:1746065186.112228:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime: 1746065186 -> 1746065187 00002000:00010000:3.0:1746065186.112231:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime: 1746065186 -> 1746065187 00000100:00100000:3.0:1746065186.112241:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260339584:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065186.112260:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fca0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6088c expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.112269:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fca0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6088c expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.112357:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501e00, rc 0) 00000100:00100000:3.0:1746065186.112438:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263017984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3069us (3377us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065186.112443:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14487 00000100:00100000:3.0:1746065186.112462:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263018496 00000100:00100000:3.0:1746065186.112466:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263018496 00000100:00100000:1.0:1746065186.112595:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4244 00000100:00100000:1.0:1746065186.112602:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:31723:x1830881263018496:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065186.112833:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:31723:x1830881263018496:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 214us (679us total) trans 8589944171 rc 0/0 00000100:00100000:1.0:1746065186.112839:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4244 00000100:00100000:0.0:1746065186.115380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.115486:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263018752 00000100:00100000:2.0:1746065186.115493:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263018752 00002000:00100000:2.0:1746065186.115532:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88008fd71180 x1830881263018752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.115540:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71180 with x1830881263018752 ext(0->1048575) 00002000:00010000:2.0:1746065186.115544:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71180 00000100:00100000:2.0:1746065186.115571:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8138 00000100:00100000:2.0:1746065186.115577:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263018752:12345-192.168.202.46@tcp:3:cat.0 00000100:00080000:0.0:1746065186.116977:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065186.122948:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263018752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7362us (7565us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.122959:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8138 00002000:00100000:2.0:1746065186.122970:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88008fd71180 x1830881263018752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.122979:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71180 with x1830881263018752 ext(0->1048575) 00002000:00010000:2.0:1746065186.122985:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71180 00000100:00100000:0.0:1746065186.129809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.130002:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263018880 00000100:00100000:3.0:1746065186.130009:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263018880 00000100:00100000:3.0:1746065186.130056:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14488 00000100:00100000:3.0:1746065186.130062:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31731:x1830881263018880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.130077:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.130090:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60893 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.130115:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.130122:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065186.130124:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065186.130127:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.130150:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.130160:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 12 pid: 8429 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.130171:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260339712:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065186.130236:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.133560:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260339712:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.133590:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.133606:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210000, rc 0) 00000100:00100000:3.0:1746065186.133643:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31731:x1830881263018880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3580us (3841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.133651:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14488 00000100:00100000:0.0:1746065186.134031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.134461:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263019008 00000100:00100000:2.0:1746065186.134467:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263019008 00002000:00100000:2.0:1746065186.134496:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1056768->1400831) req@ffff88008fd72300 x1830881263019008/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.134504:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72300 with x1830881263019008 ext(1056768->1400831) 00010000:00010000:2.0:1746065186.134510:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 13 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.134521:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 13 pid: 8429 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746065186.134528:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd72300 00000100:00100000:2.0:1746065186.134550:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2481 00000100:00100000:2.0:1746065186.134555:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263019008:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065186.142580:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263019008:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 8017us (8542us total) trans 17179873592 rc 0/0 00000100:00100000:2.0:1746065186.142591:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2481 00002000:00100000:2.0:1746065186.142601:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1056768->1400831) req@ffff88008fd72300 x1830881263019008/t17179873592(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.142610:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72300 with x1830881263019008 ext(1056768->1400831) 00010000:00010000:2.0:1746065186.142618:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 15 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.142631:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 15 pid: 8429 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746065186.142637:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd72300 00000100:00100000:0.0:1746065186.146000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.146353:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263019136 00000100:00100000:2.0:1746065186.146361:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263019136 00010000:00010000:2.0:1746065186.146390:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 15 pid: 8429 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.146413:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7415 00000100:00100000:2.0:1746065186.146419:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881263019136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.146430:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.146448:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 15 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.146459:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 15 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.146477:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a211e00/0x14b4f8542d4fc9d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->1400831) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60870 expref: 15 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.146505:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.146507:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.146513:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.146521:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.146555:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 21 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.146566:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260339840:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065186.146637:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.148203:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260339840:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065186.148219:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.148517:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263019136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2096us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.148526:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7415 00000100:00100000:0.0:1746065186.150921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.151157:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263019392 00000100:00100000:2.0:1746065186.151165:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263019392 00002000:00100000:2.0:1746065186.151201:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008fd72a00 x1830881263019392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.151210:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72a00 with x1830881263019392 ext(1048576->2097151) 00002000:00010000:2.0:1746065186.151215:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd72a00 00000100:00100000:2.0:1746065186.151663:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8139 00000100:00100000:2.0:1746065186.151671:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263019392:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.159557:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263019392:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7877us (8732us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.159567:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8139 00002000:00100000:2.0:1746065186.159582:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008fd72a00 x1830881263019392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.159596:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72a00 with x1830881263019392 ext(1048576->2097151) 00002000:00010000:2.0:1746065186.159601:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd72a00 00000100:00100000:0.0:1746065186.163646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.163764:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263019520 00000100:00100000:3.0:1746065186.163772:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263019520 00000100:00100000:3.0:1746065186.163854:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14489 00000100:00100000:3.0:1746065186.163862:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31731:x1830881263019520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.163876:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.163889:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6089a expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.163916:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.163924:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065186.163925:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065186.163928:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 23 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.163953:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.163963:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 13 pid: 21998 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.163973:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260339968:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065186.164044:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.167755:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.167952:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260339968:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.167974:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 23 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.167986:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211c00, rc 0) 00000100:00100000:3.0:1746065186.168038:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31731:x1830881263019520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4176us (4399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.168044:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14489 00000100:00100000:2.0:1746065186.168363:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263019648 00000100:00100000:2.0:1746065186.168371:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263019648 00002000:00100000:2.0:1746065186.168397:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1921024->1945599) req@ffff8800900c0700 x1830881263019648/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.168405:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0700 with x1830881263019648 ext(1921024->1945599) 00010000:00010000:2.0:1746065186.168410:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 14 pid: 21998 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.168420:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 14 pid: 21998 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746065186.168426:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900c0700 00000100:00100000:2.0:1746065186.168445:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2482 00000100:00100000:2.0:1746065186.168451:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263019648:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065186.171467:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263019648:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 3009us (3711us total) trans 17179873593 rc 0/0 00000100:00100000:2.0:1746065186.171476:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2482 00002000:00100000:2.0:1746065186.171485:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1921024->1945599) req@ffff8800900c0700 x1830881263019648/t17179873593(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.171494:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0700 with x1830881263019648 ext(1921024->1945599) 00010000:00010000:2.0:1746065186.171502:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 16 pid: 21998 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.171514:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 16 pid: 21998 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746065186.171520:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900c0700 00000100:00100000:0.0:1746065186.175759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.175900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.175949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.175991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.176039:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263020032 00000100:00100000:0.0:1746065186.176049:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263020032 00000100:00100000:0.0:1746065186.176092:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263019904 00000100:00100000:0.0:1746065186.176095:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263019904 00000100:00100000:0.0:1746065186.176105:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263020160 00000100:00100000:0.0:1746065186.176107:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263020160 00000100:00100000:0.0:1746065186.176118:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14490 00000100:00100000:0.0:1746065186.176124:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263020032:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065186.176126:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14491 00000100:00100000:1.0:1746065186.176133:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263019904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065186.176138:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.176138:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.176151:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608a1 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.176151:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d75da00/0x14b4f8542d4fca28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608a8 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.176167:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.176169:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.176175:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065186.176187:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260340096:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065186.176190:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 20 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.176198:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9e00, rc 0) 00000100:00100000:2.0:1746065186.176269:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263019776 00000100:00100000:2.0:1746065186.176272:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263019776 00000100:00100000:1.0:1746065186.176276:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263019904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.176281:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14491 00010000:00010000:2.0:1746065186.176286:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 21 pid: 21998 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065186.176296:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14492 00000100:00100000:2.0:1746065186.176301:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7416 00000100:00100000:1.0:1746065186.176301:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263020160:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065186.176305:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263019776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065186.176306:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.176311:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065186.176312:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fca2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608af expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.176326:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 21 pid: 21998 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065186.176331:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260340224:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.176335:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 21 pid: 21998 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.176353:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.176354:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.176358:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.176365:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.176386:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 22 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.176395:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260340352:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065186.177600:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.178669:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.178948:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065186.183187:0:4544:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88012e8b7b80 x1830881260340096) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 21 pid: 21998 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.183219:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009418b800/0x14b4f8542d4fc95d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->1945599) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60815 expref: 21 pid: 21998 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.183250:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260340096:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.183276:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d75da00/0x14b4f8542d4fca28 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a8 expref: 20 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.183287:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d75da00/0x14b4f8542d4fca28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a8 expref: 20 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.183294:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d75da00, rc 0) 00000100:00100000:2.0:1746065186.183338:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263020032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7213us (7438us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.183345:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14490 00002000:00010000:1.0:1746065186.183646:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime: 1746065185 -> 1746065187 00002000:00010000:1.0:1746065186.183650:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065186 -> 1746065187 00002000:00010000:1.0:1746065186.183652:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime: 1746065185 -> 1746065187 00000100:00100000:1.0:1746065186.183661:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260340224:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065186.183678:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fca2f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608af expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.183686:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fca2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608af expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.183710:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9800, rc 0) 00000100:00100000:1.0:1746065186.183738:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263020160:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7437us (7748us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065186.183743:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14492 00000100:00100000:0.0:1746065186.186372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.186440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.186564:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263020544 00000100:00100000:1.0:1746065186.186570:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263020544 00002000:00100000:1.0:1746065186.186604:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012e8b7100 x1830881263020544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.186612:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7100 with x1830881263020544 ext(1048576->2097151) 00002000:00010000:1.0:1746065186.186617:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b7100 00000100:00100000:1.0:1746065186.186630:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263020672 00000100:00100000:1.0:1746065186.186633:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263020672 00002000:00100000:1.0:1746065186.186644:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012e8b5c00 x1830881263020672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.186650:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5c00 with x1830881263020672 ext(1048576->2097151) 00002000:00010000:1.0:1746065186.186652:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b5c00 00000100:00100000:1.0:1746065186.186662:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8140 00000100:00100000:1.0:1746065186.186667:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263020544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065186.188548:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8141 00000100:00100000:3.0:1746065186.188560:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263020672:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.193309:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260340352:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065186.193332:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.193379:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263019776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 17071us (17629us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.193388:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7416 00000100:00100000:2.0:1746065186.193448:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.193473:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263020928 00000100:00100000:2.0:1746065186.193478:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263020928 00002000:00100000:2.0:1746065186.193506:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f46b800 x1830881263020928/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.193515:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b800 with x1830881263020928 ext(0->1048575) 00002000:00010000:2.0:1746065186.193519:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46b800 00000100:00100000:2.0:1746065186.193536:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8142 00000100:00100000:2.0:1746065186.193541:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263020928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065186.193637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.193652:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263021184 00000100:00100000:3.0:1746065186.193655:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263021184 00002000:00100000:3.0:1746065186.193669:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880094a13480 x1830881263021184/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.193676:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13480 with x1830881263021184 ext(1048576->2097151) 00002000:00010000:3.0:1746065186.193832:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13480 00000100:00100000:3.0:1746065186.193849:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8143 00000100:00100000:3.0:1746065186.193854:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263021184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.200673:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263020544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13995us (14296us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065186.200684:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8140 00002000:00100000:1.0:1746065186.200695:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012e8b7100 x1830881263020544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.200710:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7100 with x1830881263020544 ext(1048576->2097151) 00002000:00010000:1.0:1746065186.200715:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b7100 00000100:00100000:3.0:1746065186.209197:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263021184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15334us (15550us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.209207:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8143 00002000:00100000:3.0:1746065186.209216:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880094a13480 x1830881263021184/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.209224:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13480 with x1830881263021184 ext(1048576->2097151) 00002000:00010000:3.0:1746065186.209229:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13480 00000100:00100000:2.0:1746065186.212607:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263020928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19054us (19147us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.212616:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8142 00002000:00100000:2.0:1746065186.212625:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f46b800 x1830881263020928/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.212633:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b800 with x1830881263020928 ext(0->1048575) 00002000:00010000:2.0:1746065186.212637:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46b800 00000100:00100000:3.0:1746065186.216388:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263020672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27822us (29938us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.216401:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8141 00002000:00100000:3.0:1746065186.216412:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012e8b5c00 x1830881263020672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.216420:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5c00 with x1830881263020672 ext(1048576->2097151) 00002000:00010000:3.0:1746065186.216426:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b5c00 00000100:00100000:0.0:1746065186.225572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.225707:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263021312 00000100:00100000:1.0:1746065186.225714:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263021312 00000100:00100000:1.0:1746065186.225763:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14493 00000100:00100000:1.0:1746065186.225771:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:31735:x1830881263021312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065186.225796:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.225811:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608b6 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.225858:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.225860:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.225866:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.225879:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.225888:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be8ae00, rc 0) 00000100:00100000:1.0:1746065186.225931:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:31735:x1830881263021312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 161us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.225937:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14493 00000100:00100000:0.0:1746065186.231539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.231576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.231601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.231613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.232220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.232505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.232529:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263021568 00000100:00100000:2.0:1746065186.232536:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263021568 00002000:00100000:2.0:1746065186.232573:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012e8b7b80 x1830881263021568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.232582:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7b80 with x1830881263021568 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.232587:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b7b80 00000100:00100000:2.0:1746065186.232600:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263021824 00000100:00100000:2.0:1746065186.232602:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263021824 00002000:00100000:2.0:1746065186.232610:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cdd500 x1830881263021824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.232616:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd500 with x1830881263021824 ext(3145728->4194303) 00002000:00010000:2.0:1746065186.232618:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdd500 00000100:00100000:2.0:1746065186.232629:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263022080 00000100:00100000:2.0:1746065186.232630:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263022080 00002000:00100000:2.0:1746065186.232638:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880135cddf80 x1830881263022080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.232644:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cddf80 with x1830881263022080 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.232646:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cddf80 00000100:00100000:2.0:1746065186.232651:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263022336 00000100:00100000:2.0:1746065186.232653:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263022336 00002000:00100000:2.0:1746065186.232658:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880135cdd880 x1830881263022336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 504/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.232664:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd880 with x1830881263022336 ext(3145728->4194303) 00002000:00010000:2.0:1746065186.232665:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdd880 00000100:00100000:2.0:1746065186.232671:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263022592 00000100:00100000:2.0:1746065186.232672:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263022592 00002000:00100000:2.0:1746065186.232680:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880135cdf480 x1830881263022592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.232686:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf480 with x1830881263022592 ext(1048576->2097151) 00002000:00010000:2.0:1746065186.232688:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf480 00000100:00100000:2.0:1746065186.232697:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8144 00000100:00100000:2.0:1746065186.232703:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263021568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.234331:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8145 00000100:00100000:2.0:1746065186.234340:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263021824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.235230:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8146 00000100:00100000:2.0:1746065186.235237:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263022080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.236319:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8147 00000100:00100000:2.0:1746065186.236326:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263022336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.237684:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8148 00000100:00100000:1.0:1746065186.237694:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263022592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065186.243132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.243165:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023104 00000100:00100000:0.0:1746065186.243172:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023104 00000100:00100000:0.0:1746065186.243205:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9942 00000100:00100000:0.0:1746065186.243213:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:31737:x1830881263023104:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065186.243235:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.243249:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fca3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608bd expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.243339:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243349:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243359:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243369:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243374:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243379:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243454:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0400/0x14b4f8542d4fca52 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243460:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0400/0x14b4f8542d4fca52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243465:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0400/0x14b4f8542d4fca52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065186.243472:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065186.243530:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243535:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243541:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243545:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a60a6200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065186.243548:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243553:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243561:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065186.243564:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065186.243567:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243571:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fca44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243584:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243589:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243593:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243596:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a60a7e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065186.243598:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243603:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243608:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b9a3d00) 00010000:00010000:0.0:1746065186.243610:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065186.243612:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243615:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fca4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.243641:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fca3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608bd expref: 292 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.243650:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0400/0x14b4f8542d4fca52 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608bd expref: 291 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.243656:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065186.243657:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065186.243659:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d0400, rc 0) 00000100:00100000:0.0:1746065186.243687:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+291:31737:x1830881263023104:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 476us (563us total) trans 8589944172 rc 0/0 00000100:00100000:0.0:1746065186.243693:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9942 00000100:00100000:3.0:1746065186.243800:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263022848 00000100:00100000:3.0:1746065186.243804:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263022848 00002000:00100000:3.0:1746065186.243841:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880135cde680 x1830881263022848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.243849:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde680 with x1830881263022848 ext(1048576->2097151) 00002000:00010000:3.0:1746065186.243852:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cde680 00000100:00100000:3.0:1746065186.243870:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8149 00000100:00100000:3.0:1746065186.243875:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263022848:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.248473:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263021568:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15762us (16934us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.248483:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8144 00002000:00100000:2.0:1746065186.248493:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012e8b7b80 x1830881263021568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.248501:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7b80 with x1830881263021568 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.248506:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b7b80 00000100:00100000:3.0:1746065186.260536:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263021824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26187us (28948us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.260547:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8145 00002000:00100000:3.0:1746065186.260560:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cdd500 x1830881263021824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.260873:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd500 with x1830881263021824 ext(3145728->4194303) 00002000:00010000:3.0:1746065186.260880:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdd500 00000100:00100000:3.0:1746065186.262117:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263022336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25788us (30498us total) trans 0 rc 401408/401408 00000100:00100000:3.0:1746065186.262125:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8147 00002000:00100000:3.0:1746065186.262131:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880135cdd880 x1830881263022336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 504/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.262138:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd880 with x1830881263022336 ext(3145728->4194303) 00002000:00010000:3.0:1746065186.262141:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdd880 00000100:00100000:2.0:1746065186.262603:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263022080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27365us (31000us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.262610:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8146 00002000:00100000:2.0:1746065186.262615:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880135cddf80 x1830881263022080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.262625:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cddf80 with x1830881263022080 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.262628:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cddf80 00000100:00100000:0.0:1746065186.268168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.268298:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023232 00000100:00100000:2.0:1746065186.268306:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023232 00000100:00100000:2.0:1746065186.268356:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 751 00000100:00100000:2.0:1746065186.268362:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+291:1961:x1830881263023232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.268373:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.268393:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0400/0x14b4f8542d4fca52 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608bd expref: 291 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.268409:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.268413:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.268447:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+290:1961:x1830881263023232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.268454:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 751 00000100:00100000:1.0:1746065186.268532:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263022592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30840us (36311us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065186.268539:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8148 00002000:00100000:1.0:1746065186.268546:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880135cdf480 x1830881263022592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.268555:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf480 with x1830881263022592 ext(1048576->2097151) 00002000:00010000:1.0:1746065186.268558:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf480 00000100:00100000:0.0:1746065186.271910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.272184:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023360 00000100:00100000:2.0:1746065186.272193:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023360 00000100:00100000:2.0:1746065186.272241:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14494 00000100:00100000:2.0:1746065186.272248:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31737:x1830881263023360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065186.272266:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.272281:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608c4 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.272306:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 22 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.272313:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 12 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.272319:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.272322:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.272324:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1454080->1605631] (req 1454080->1605631) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.272911:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263022848:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29033us (40404us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.272919:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8149 00002000:00100000:3.0:1746065186.272927:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880135cde680 x1830881263022848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.272935:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde680 with x1830881263022848 ext(1048576->2097151) 00010000:00010000:3.0:1746065186.272940:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.272948:0:21481:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746065186.272954:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cde680 00010000:00010000:2.0:1746065186.273311:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.273323:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 10 pid: 4545 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065186.273333:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260340480:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.273990:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 22 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.273999:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 22 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065186.274006:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260340608:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.275990:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.276023:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260340480:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065186.276878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.277132:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023616 00000100:00100000:3.0:1746065186.277138:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023616 00000100:00100000:3.0:1746065186.277176:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4245 00000100:00100000:3.0:1746065186.277183:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+290:31731:x1830881263023616:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065186.277726:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+291:31731:x1830881263023616:12345-192.168.202.46@tcp:35:cat.0 Request processed in 541us (848us total) trans 8589944173 rc 0/0 00000100:00100000:3.0:1746065186.277733:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4245 00000100:00100000:0.0:1746065186.278051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.278346:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023744 00000100:00100000:2.0:1746065186.278350:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023744 00010000:00010000:2.0:1746065186.278370:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 11 pid: 4545 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065186.278388:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7417 00000100:00100000:2.0:1746065186.278393:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263023744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.278402:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.278418:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 11 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.278426:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 11 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.278442:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fc995 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6084d expref: 11 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.278453:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.278481:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263023744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.278487:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7417 00000100:00100000:0.0:1746065186.278921:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260340608:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065186.278946:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1454080->1605631] (req 1454080->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.278954:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c8200, rc 0) 00000100:00100000:0.0:1746065186.279159:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31737:x1830881263023360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6910us (7257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.279165:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14494 00000100:00100000:0.0:1746065186.280234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.280508:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.280593:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263023872 00000100:00100000:2.0:1746065186.280599:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263023872 00010000:00010000:2.0:1746065186.280618:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 22 pid: 25185 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065186.280635:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7418 00000100:00100000:2.0:1746065186.280640:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263023872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.280647:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.280661:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 22 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.280670:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 22 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.280685:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a596d200/0x14b4f8542d4fc979 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60831 expref: 22 pid: 25185 timeout: 885 lvb_type: 1 00010000:00010000:2.0:1746065186.280695:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.280696:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.280701:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.280708:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.280728:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.280737:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260340736:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065186.280792:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.281089:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263024128 00000100:00100000:3.0:1746065186.281093:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263024128 00002000:00100000:3.0:1746065186.281120:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880095356d80 x1830881263024128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.281128:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356d80 with x1830881263024128 ext(2097152->3145727) 00002000:00010000:3.0:1746065186.281132:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095356d80 00000100:00100000:3.0:1746065186.281153:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8150 00000100:00100000:3.0:1746065186.281160:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263024128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065186.282955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.282983:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263024384 00000100:00100000:1.0:1746065186.282989:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263024384 00002000:00100000:1.0:1746065186.283018:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1454080->1458175) req@ffff880095355f80 x1830881263024384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.283025:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355f80 with x1830881263024384 ext(1454080->1458175) 00000100:00100000:2.0:1746065186.283028:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260340736:192.168.202.46@tcp:105: 00002000:00010000:1.0:1746065186.283028:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355f80 00010000:00010000:2.0:1746065186.283043:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065186.283052:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8151 00000100:00100000:1.0:1746065186.283058:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263024384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.283065:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263023872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2425us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.283072:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7418 00000100:00100000:1.0:1746065186.283438:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263024384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 380us (488us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065186.283443:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8151 00002000:00100000:1.0:1746065186.283447:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1454080->1458175) req@ffff880095355f80 x1830881263024384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.283453:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355f80 with x1830881263024384 ext(1454080->1458175) 00002000:00010000:1.0:1746065186.283455:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355f80 00000100:00100000:3.0:1746065186.288136:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263024128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6967us (7618us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.288147:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8150 00002000:00100000:3.0:1746065186.288156:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880095356d80 x1830881263024128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.288164:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356d80 with x1830881263024128 ext(2097152->3145727) 00002000:00010000:3.0:1746065186.288169:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095356d80 00000100:00100000:1.0:1746065186.288740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.288837:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263024640 00000100:00100000:3.0:1746065186.288843:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263024640 00002000:00100000:3.0:1746065186.288873:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1601536->1605631) req@ffff88009fa76d80 x1830881263024640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.288880:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa76d80 with x1830881263024640 ext(1601536->1605631) 00002000:00010000:3.0:1746065186.288883:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa76d80 00000100:00100000:3.0:1746065186.288896:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8152 00000100:00100000:3.0:1746065186.288902:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263024640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065186.289017:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263024640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 114us (278us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065186.289021:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8152 00002000:00100000:3.0:1746065186.289026:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1601536->1605631) req@ffff88009fa76d80 x1830881263024640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.289032:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa76d80 with x1830881263024640 ext(1601536->1605631) 00002000:00010000:3.0:1746065186.289034:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa76d80 00000100:00100000:0.0:1746065186.291168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.291212:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263025024 00000100:00100000:2.0:1746065186.291219:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263025024 00000100:00100000:2.0:1746065186.291262:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14495 00000100:00100000:2.0:1746065186.291269:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+17:31735:x1830881263025024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.291286:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.291299:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608cb expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.291325:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.291331:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065186.291332:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065186.291335:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065186.291342:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.291386:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263024896 00000100:00100000:3.0:1746065186.291389:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263024896 00010000:00010000:2.0:1746065186.291391:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.291401:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 22 pid: 8429 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.291412:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260340864:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065186.291418:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4246 00000100:00100000:3.0:1746065186.291422:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+291:31737:x1830881263024896:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065186.291482:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.291631:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+292:31737:x1830881263024896:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 207us (289us total) trans 8589944174 rc 0/0 00000100:00100000:3.0:1746065186.291637:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4246 00000100:00100000:2.0:1746065186.293053:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260340864:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.293074:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.293086:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c9800, rc 0) 00000100:00100000:2.0:1746065186.293110:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:31735:x1830881263025024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1841us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.293116:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14495 00000100:00100000:2.0:1746065186.295025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.295100:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263025152 00000100:00100000:1.0:1746065186.295106:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263025152 00002000:00100000:1.0:1746065186.295140:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3371008->4018175) req@ffff88009f468380 x1830881263025152/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.295149:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468380 with x1830881263025152 ext(3371008->4018175) 00010000:00010000:1.0:1746065186.295158:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 23 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065186.295171:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 23 pid: 8429 timeout: 885 lvb_type: 0 00002000:00010000:1.0:1746065186.295178:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f468380 00000100:00100000:1.0:1746065186.295350:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2483 00000100:00100000:1.0:1746065186.295357:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263025152:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065186.306111:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263025152:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10744us (11081us total) trans 17179873594 rc 0/0 00000100:00100000:1.0:1746065186.306122:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2483 00002000:00100000:1.0:1746065186.306133:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3371008->4018175) req@ffff88009f468380 x1830881263025152/t17179873594(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.306142:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468380 with x1830881263025152 ext(3371008->4018175) 00010000:00010000:1.0:1746065186.306152:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 25 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065186.306167:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 25 pid: 8429 timeout: 885 lvb_type: 0 00002000:00010000:1.0:1746065186.306174:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f468380 00000100:00100000:0.0:1746065186.311471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.311672:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263025280 00000100:00100000:2.0:1746065186.311680:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263025280 00010000:00010000:2.0:1746065186.311810:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 25 pid: 8429 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.311863:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7419 00000100:00100000:2.0:1746065186.311871:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263025280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.311884:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.311907:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 25 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.311917:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 25 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.311936:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a210800/0x14b4f8542d4fc9db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3371008->4018175) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60877 expref: 25 pid: 8429 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.311963:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.311965:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.311972:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 17 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.311978:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 17 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.312011:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 17 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.312023:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260340992:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065186.312102:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.313599:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260340992:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065186.313615:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.313656:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263025280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1786us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.313664:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7419 00000100:00100000:0.0:1746065186.325598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.325636:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.326165:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263025664 00000100:00100000:1.0:1746065186.326174:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263025664 00002000:00100000:1.0:1746065186.326213:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880095357b80 x1830881263025664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.326222:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095357b80 with x1830881263025664 ext(3145728->4194303) 00002000:00010000:1.0:1746065186.326226:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095357b80 00000100:00100000:1.0:1746065186.326255:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263025792 00000100:00100000:1.0:1746065186.326258:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263025792 00002000:00100000:1.0:1746065186.326268:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880095354a80 x1830881263025792/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.326273:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354a80 with x1830881263025792 ext(2097152->3145727) 00002000:00010000:1.0:1746065186.326275:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354a80 00000100:00100000:1.0:1746065186.326284:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8153 00000100:00100000:1.0:1746065186.326289:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263025664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.326337:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8154 00000100:00100000:2.0:1746065186.326345:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263025792:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065186.326523:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.326582:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263025920 00000100:00100000:3.0:1746065186.326585:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263025920 00002000:00100000:3.0:1746065186.326603:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880095356680 x1830881263025920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.326610:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356680 with x1830881263025920 ext(3145728->4194303) 00002000:00010000:3.0:1746065186.326612:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356680 00000100:00100000:3.0:1746065186.326622:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8155 00000100:00100000:3.0:1746065186.326627:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263025920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.362285:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263025664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 35984us (36683us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065186.362298:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8153 00002000:00100000:1.0:1746065186.362309:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880095357b80 x1830881263025664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.362319:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095357b80 with x1830881263025664 ext(3145728->4194303) 00002000:00010000:1.0:1746065186.362324:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095357b80 00000100:00100000:2.0:1746065186.363026:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263025792:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36681us (37388us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.363034:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8154 00002000:00100000:2.0:1746065186.363039:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880095354a80 x1830881263025792/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.363046:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354a80 with x1830881263025792 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.363049:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354a80 00000100:00100000:2.0:1746065186.365058:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263025920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 38425us (38530us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.365068:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8155 00002000:00100000:2.0:1746065186.365076:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880095356680 x1830881263025920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.365083:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356680 with x1830881263025920 ext(3145728->4194303) 00002000:00010000:2.0:1746065186.365088:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356680 00000100:00100000:0.0:1746065186.376265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.376379:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263026176 00000100:00100000:2.0:1746065186.376387:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263026176 00000100:00100000:2.0:1746065186.376439:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14496 00000100:00100000:2.0:1746065186.376446:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:31741:x1830881263026176:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065186.376462:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.376476:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608d2 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.376499:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.376507:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.376512:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.376513:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.376516:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 11 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.376539:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.376549:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 11 pid: 2463 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065186.376559:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260341120:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.378506:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.378520:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 20 pid: 4545 timeout: 885 lvb_type: 1 00000100:00100000:2.0:1746065186.378530:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260341248:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.378657:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.379236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.379294:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263026304 00000100:00100000:1.0:1746065186.379300:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263026304 00000100:00100000:1.0:1746065186.379341:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14497 00000100:00100000:1.0:1746065186.379347:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263026304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065186.379358:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.379370:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a601a200/0x14b4f8542d4fca75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608d9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065186.379403:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260341376:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065186.379732:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.380086:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260341120:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.380379:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260341248:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.380400:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.380411:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c9a00, rc 0) 00000100:00100000:2.0:1746065186.380435:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:31741:x1830881263026176:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3990us (4179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.380441:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14496 00000100:00100000:0.0:1746065186.382947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.382992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.383093:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263026432 00000100:00100000:1.0:1746065186.383100:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263026432 00010000:00010000:1.0:1746065186.383129:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 13 pid: 2463 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746065186.383149:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263026560 00000100:00100000:1.0:1746065186.383152:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263026560 00010000:00010000:1.0:1746065186.383160:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 21 pid: 4545 timeout: 885 lvb_type: 1 00000100:00100000:1.0:1746065186.383955:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7420 00000100:00100000:1.0:1746065186.383963:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263026432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065186.383975:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065186.383994:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 13 pid: 2463 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065186.384004:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 13 pid: 2463 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065186.384022:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d501600/0x14b4f8542d4fc99c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60854 expref: 13 pid: 2463 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065186.384050:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065186.384083:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263026432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 121us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.384089:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7420 00000100:00100000:1.0:1746065186.384103:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7421 00000100:00100000:1.0:1746065186.384107:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263026560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065186.384114:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065186.384120:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 21 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065186.384127:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 21 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065186.384136:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fc980 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60838 expref: 21 pid: 4545 timeout: 885 lvb_type: 1 00010000:00010000:1.0:1746065186.384143:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.384145:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.384149:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 11 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.384156:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 11 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.384179:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 11 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065186.384190:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260341504:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065186.384227:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.385810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:2.0:1746065186.385916:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065185 -> 1746065187 00002000:00010000:2.0:1746065186.385920:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065184 -> 1746065187 00002000:00010000:2.0:1746065186.385922:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065185 -> 1746065187 00000100:00100000:2.0:1746065186.385935:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260341376:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.385958:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a601a200/0x14b4f8542d4fca75 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d9 expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.385969:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a601a200/0x14b4f8542d4fca75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d9 expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.385981:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a601a200, rc 0) 00000100:00100000:2.0:1746065186.386010:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263026304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6663us (6776us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.386016:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14497 00000100:00100000:3.0:1746065186.386086:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263026816 00000100:00100000:3.0:1746065186.386091:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263026816 00002000:00100000:3.0:1746065186.386119:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2732032->2736127) req@ffff88009f2c6a00 x1830881263026816/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.386126:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6a00 with x1830881263026816 ext(2732032->2736127) 00002000:00010000:3.0:1746065186.386129:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c6a00 00000100:00100000:3.0:1746065186.386141:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8156 00000100:00100000:3.0:1746065186.386146:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263026816:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065186.386254:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263026816:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 106us (446us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065186.386259:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8156 00002000:00100000:3.0:1746065186.386263:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2732032->2736127) req@ffff88009f2c6a00 x1830881263026816/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.386270:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6a00 with x1830881263026816 ext(2732032->2736127) 00002000:00010000:3.0:1746065186.386272:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c6a00 00000100:00100000:0.0:1746065186.386533:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260341504:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065186.386545:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065186.386565:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263026560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2457us (3572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.386571:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7421 00000100:00100000:0.0:1746065186.391575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.392208:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027072 00000100:00100000:2.0:1746065186.392217:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027072 00002000:00100000:2.0:1746065186.392251:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009f144700 x1830881263027072/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.392259:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f144700 with x1830881263027072 ext(4194304->5013503) 00002000:00010000:2.0:1746065186.392263:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f144700 00000100:00100000:2.0:1746065186.392289:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8157 00000100:00100000:2.0:1746065186.392294:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263027072:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.394011:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.394703:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027200 00000100:00100000:2.0:1746065186.394709:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027200 00000100:00100000:2.0:1746065186.394753:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14498 00000100:00100000:2.0:1746065186.394760:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:31741:x1830881263027200:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065186.394872:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.394887:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608e0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.394909:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.394916:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.394917:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.394919:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->2310143] (req 2097152->2310143) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.394939:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.394945:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 19 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.394953:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260341632:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.395011:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.397467:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260341632:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.397496:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->2310143] (req 2097152->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.397508:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c8c00, rc 0) 00000100:00100000:3.0:1746065186.397554:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:31741:x1830881263027200:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2793us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.397562:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14498 00000100:00100000:3.0:1746065186.398406:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263027072:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6110us (6838us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065186.398414:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8157 00002000:00100000:3.0:1746065186.398421:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009f144700 x1830881263027072/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.398429:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f144700 with x1830881263027072 ext(4194304->5013503) 00002000:00010000:3.0:1746065186.398433:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f144700 00000100:00100000:0.0:1746065186.401724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.402038:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027328 00000100:00100000:2.0:1746065186.402046:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027328 00010000:00010000:2.0:1746065186.402146:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 19 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.402184:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7422 00000100:00100000:2.0:1746065186.402191:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263027328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.402201:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.402220:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 19 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.402231:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 19 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.402249:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c9800/0x14b4f8542d4fca67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608cb expref: 19 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.402276:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.402278:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.402284:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.402296:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.402324:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.402334:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260341760:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065186.402402:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.406918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.407005:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.408217:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027840 00000100:00100000:0.0:1746065186.408225:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027840 00000100:00100000:0.0:1746065186.408273:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9943 00000100:00100000:0.0:1746065186.408279:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+292:31744:x1830881263027840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065186.408296:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.408310:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fca83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608f5 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.408582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.408880:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260341760:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065186.408903:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.408946:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263027328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6755us (7229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.408954:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7422 00000100:00100000:3.0:1746065186.409093:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027456 00000100:00100000:3.0:1746065186.409097:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027456 00000100:00100000:3.0:1746065186.409123:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263027584 00000100:00100000:3.0:1746065186.409125:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263027584 00000100:00100000:3.0:1746065186.409138:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14499 00000100:00100000:3.0:1746065186.409142:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263027456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.409149:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.409158:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a211600/0x14b4f8542d4fca8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608e7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.409191:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260341888:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065186.409238:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.409253:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14500 00000100:00100000:3.0:1746065186.409258:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263027584:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.409264:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.409272:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a210600/0x14b4f8542d4fca91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608ee expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.409292:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260342016:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065186.409309:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.409511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065186.409788:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.409800:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.409809:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.409835:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.409841:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.409846:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.409934:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fcaa6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.409942:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fcaa6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.409947:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fcaa6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065186.409954:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065186.410021:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410027:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410031:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410036:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a211e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065186.410038:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410043:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410051:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065186.410053:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065186.410056:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410064:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211e00/0x14b4f8542d4fca98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065186.410419:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028096 00000100:00100000:0.0:1746065186.410424:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028096 00002000:00100000:0.0:1746065186.410449:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2306048->2310143) req@ffff88009f469c00 x1830881263028096/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065186.410457:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469c00 with x1830881263028096 ext(2306048->2310143) 00002000:00010000:0.0:1746065186.410460:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469c00 00000100:00100000:0.0:1746065186.410474:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8158 00000100:00100000:0.0:1746065186.410479:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263028096:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065186.410926:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410933:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410937:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410941:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a210e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065186.410944:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410948:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410956:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205100) 00010000:00010000:3.0:1746065186.410958:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065186.410960:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.410965:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fca9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.411001:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fca83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608f5 expref: 295 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.411010:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fcaa6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608f5 expref: 294 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.411021:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.411022:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065186.411025:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210800, rc 0) 00000100:00100000:0.0:1746065186.411994:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263028096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1510us (2478us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065186.412002:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8158 00002000:00100000:0.0:1746065186.412008:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2306048->2310143) req@ffff88009f469c00 x1830881263028096/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065186.412016:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469c00 with x1830881263028096 ext(2306048->2310143) 00002000:00010000:0.0:1746065186.412019:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469c00 00000100:00100000:3.0:1746065186.412144:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+294:31744:x1830881263027840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3863us (5139us total) trans 8589944175 rc 0/0 00000100:00100000:3.0:1746065186.412150:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9943 00000100:00100000:3.0:1746065186.416502:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260341888:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065186.416739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.416856:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260342016:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.416873:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a210600/0x14b4f8542d4fca91 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608ee expref: 19 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.416874:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a211600/0x14b4f8542d4fca8a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e7 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.416887:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a211600/0x14b4f8542d4fca8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e7 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.416887:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a210600/0x14b4f8542d4fca91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608ee expref: 19 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065186.416911:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028224 00010000:00010000:2.0:1746065186.416917:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210600, rc 0) 00000100:00100000:0.0:1746065186.416917:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028224 00000100:00100000:0.0:1746065186.416958:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 752 00000100:00100000:0.0:1746065186.416965:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+294:1960:x1830881263028224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065186.416966:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263027584:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7706us (8383us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.416972:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14500 00010000:00010000:0.0:1746065186.416976:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065186.416993:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210800/0x14b4f8542d4fcaa6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608f5 expref: 294 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.417016:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065186.417020:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065186.417036:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+293:1960:x1830881263028224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.417042:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 752 00010000:00010000:3.0:1746065186.417216:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211600, rc 0) 00000100:00100000:3.0:1746065186.417243:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263027456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8099us (10330us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065186.417248:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14499 00000100:00100000:0.0:1746065186.418710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.418746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.418766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.419002:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028608 00000100:00100000:2.0:1746065186.419008:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028608 00000100:00100000:3.0:1746065186.419084:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028480 00000100:00100000:3.0:1746065186.419088:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028480 00000100:00100000:3.0:1746065186.419145:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9944 00000100:00100000:3.0:1746065186.419151:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+293:31746:x1830881263028480:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065186.419166:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.419179:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210400/0x14b4f8542d4fcab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60903 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.419367:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028736 00000100:00100000:2.0:1746065186.419370:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028736 00000100:00100000:2.0:1746065186.419389:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14501 00000100:00100000:2.0:1746065186.419394:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263028608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.419402:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.419412:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8600/0x14b4f8542d4fcabb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e608fc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.419449:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260342144:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065186.419491:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.419501:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00000100:00100000:2.0:1746065186.419507:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00010000:00010000:3.0:1746065186.419509:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.419519:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.419523:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.419528:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065186.419602:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14502 00000100:00100000:0.0:1746065186.419608:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263028736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065186.419615:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.419623:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcad0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6090a expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065186.419645:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260342272:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065186.419668:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746065186.420547:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210c00/0x14b4f8542d4fcad7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420558:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210c00/0x14b4f8542d4fcad7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420565:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210c00/0x14b4f8542d4fcad7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065186.420573:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065186.420647:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420653:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420662:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420667:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a211800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065186.420670:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420676:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420686:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065186.420688:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065186.420691:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420696:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420705:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420709:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420713:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420716:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a210200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065186.420717:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420721:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420729:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:3.0:1746065186.420731:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065186.420733:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.420738:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210200/0x14b4f8542d4fcac9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00002000:00010000:2.0:1746065186.421080:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime: 1746065186 -> 1746065187 00002000:00010000:2.0:1746065186.421083:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065186 -> 1746065187 00002000:00010000:2.0:1746065186.421085:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime: 1746065186 -> 1746065187 00000100:00100000:2.0:1746065186.421099:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260342144:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.421120:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8600/0x14b4f8542d4fcabb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608fc expref: 21 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.421130:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8600/0x14b4f8542d4fcabb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608fc expref: 21 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.421137:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c8600, rc 0) 00000100:00100000:2.0:1746065186.421161:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263028608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1767us (2415us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.421167:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14501 00000100:00100000:1.0:1746065186.421176:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260342272:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065186.421191:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcad0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6090a expref: 25 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.421205:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcad0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6090a expref: 25 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.421218:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfce00, rc 0) 00000100:00100000:1.0:1746065186.421243:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263028736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1635us (2476us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065186.421248:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14502 00010000:00010000:3.0:1746065186.421344:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210400/0x14b4f8542d4fcab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60903 expref: 296 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.421357:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210c00/0x14b4f8542d4fcad7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60903 expref: 295 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.421362:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.421364:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065186.421366:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210c00, rc 0) 00000100:00100000:3.0:1746065186.421490:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:31746:x1830881263028480:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2338us (2782us total) trans 8589944176 rc 0/0 00000100:00100000:3.0:1746065186.421495:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9944 00000100:00100000:2.0:1746065186.423118:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.423781:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028864 00000100:00100000:0.0:1746065186.423789:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028864 00000100:00100000:0.0:1746065186.423860:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14503 00000100:00100000:0.0:1746065186.423868:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263028864:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065186.423881:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.423894:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fcae5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60911 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065186.423937:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260342400:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065186.424254:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.430186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.430487:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263028992 00000100:00100000:3.0:1746065186.430496:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263028992 00000100:00100000:3.0:1746065186.430542:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 753 00000100:00100000:3.0:1746065186.430549:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:1960:x1830881263028992:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.430561:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.430583:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210c00/0x14b4f8542d4fcad7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60903 expref: 295 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.430602:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.430606:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065186.430671:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260342400:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065186.430692:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fcae5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60911 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065186.430703:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fcae5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60911 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065186.430714:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc800, rc 0) 00000100:00100000:3.0:1746065186.432464:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+294:1960:x1830881263028992:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1905us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.432474:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 753 00000100:00100000:0.0:1746065186.432639:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263028864:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8770us (9524us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065186.432646:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14503 00000100:00100000:0.0:1746065186.439495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.439760:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029248 00000100:00100000:2.0:1746065186.439769:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029248 00002000:00100000:2.0:1746065186.439844:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f145f80 x1830881263029248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 504/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.439853:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f145f80 with x1830881263029248 ext(1048576->2097151) 00002000:00010000:2.0:1746065186.439862:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f145f80 00000100:00100000:2.0:1746065186.439880:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8159 00000100:00100000:2.0:1746065186.439886:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263029248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.450065:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263029248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10169us (10570us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746065186.450077:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8159 00002000:00100000:2.0:1746065186.450087:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f145f80 x1830881263029248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 504/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.450095:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f145f80 with x1830881263029248 ext(1048576->2097151) 00002000:00010000:2.0:1746065186.450101:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f145f80 00000100:00100000:0.0:1746065186.463868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.463909:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.464001:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029504 00000100:00100000:1.0:1746065186.464009:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029504 00000100:00100000:1.0:1746065186.464161:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029376 00000100:00100000:1.0:1746065186.464165:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029376 00000100:00100000:1.0:1746065186.464185:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14504 00000100:00100000:1.0:1746065186.464192:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263029504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065186.464207:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.464225:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094897800/0x14b4f8542d4fcaec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6091f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065186.464273:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260342528:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065186.464588:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14505 00000100:00100000:3.0:1746065186.464596:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263029376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.464603:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.464613:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a211200/0x14b4f8542d4fcaf3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60918 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.464635:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260342656:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065186.465092:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.465296:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.466715:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260342528:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065186.466737:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094897800/0x14b4f8542d4fcaec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6091f expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.466747:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094897800/0x14b4f8542d4fcaec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6091f expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.466760:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094897800, rc 0) 00000100:00100000:1.0:1746065186.466800:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263029504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2609us (2941us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065186.466806:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14504 00000100:00100000:3.0:1746065186.467277:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260342656:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065186.467294:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a211200/0x14b4f8542d4fcaf3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60918 expref: 21 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.467302:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a211200/0x14b4f8542d4fcaf3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60918 expref: 21 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.467312:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211200, rc 0) 00000100:00100000:3.0:1746065186.467329:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263029376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2735us (3420us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065186.467334:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14505 00000100:00100000:0.0:1746065186.470660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.470768:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029632 00000100:00100000:3.0:1746065186.470786:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029632 00000100:00100000:3.0:1746065186.471548:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14506 00000100:00100000:3.0:1746065186.471557:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:31744:x1830881263029632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.471569:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.471583:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60926 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.471606:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 9 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.471613:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065186.471615:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065186.471618:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.471642:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 9 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.473102:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 9 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.473119:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260342784:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065186.473201:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.479672:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260342784:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.479702:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.479723:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210e00, rc 0) 00000100:00100000:3.0:1746065186.479783:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31744:x1830881263029632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8216us (9118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.479792:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14506 00000100:00100000:2.0:1746065186.480661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.481094:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029760 00000100:00100000:0.0:1746065186.481103:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029760 00002000:00100000:0.0:1746065186.481139:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2732032->3145727) req@ffff88009f46b480 x1830881263029760/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065186.481153:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b480 with x1830881263029760 ext(2732032->3145727) 00010000:00010000:0.0:1746065186.481161:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 10 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065186.481174:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 10 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:0.0:1746065186.481181:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f46b480 00000100:00100000:0.0:1746065186.481220:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2484 00000100:00100000:0.0:1746065186.481229:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263029760:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065186.496633:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263029760:12345-192.168.202.46@tcp:4:cat.0 Request processed in 15395us (15962us total) trans 21474840863 rc 0/0 00000100:00100000:2.0:1746065186.496645:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2484 00002000:00100000:2.0:1746065186.496657:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2732032->3145727) req@ffff88009f46b480 x1830881263029760/t21474840863(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.496666:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b480 with x1830881263029760 ext(2732032->3145727) 00010000:00010000:2.0:1746065186.496676:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 12 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.496690:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 12 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746065186.496696:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f46b480 00000100:00100000:0.0:1746065186.501801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.501912:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263029888 00000100:00100000:3.0:1746065186.501920:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263029888 00010000:00010000:3.0:1746065186.501950:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 12 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.501988:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7423 00000100:00100000:3.0:1746065186.501994:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263029888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.502004:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.502023:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 12 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.502033:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 12 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.502052:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c9a00/0x14b4f8542d4fca6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608d2 expref: 12 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.502077:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.502079:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.502085:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.502096:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.502126:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.502141:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260342912:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.502214:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.503598:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260342912:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.503613:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.503683:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263029888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1687us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.503690:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7423 00000100:00100000:0.0:1746065186.507257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.507377:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263030144 00000100:00100000:2.0:1746065186.507385:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263030144 00002000:00100000:2.0:1746065186.507419:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009f147100 x1830881263030144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.507427:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f147100 with x1830881263030144 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.507432:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f147100 00000100:00100000:2.0:1746065186.507447:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8160 00000100:00100000:2.0:1746065186.507453:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263030144:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065186.513274:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263030144:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 5813us (6016us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.513288:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8160 00002000:00100000:2.0:1746065186.513298:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009f147100 x1830881263030144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.513307:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f147100 with x1830881263030144 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.513311:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f147100 00000100:00100000:0.0:1746065186.517363:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.517408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.517667:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263030272 00000100:00100000:3.0:1746065186.517676:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263030272 00000100:00100000:3.0:1746065186.517717:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263030400 00000100:00100000:3.0:1746065186.517720:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263030400 00000100:00100000:3.0:1746065186.517735:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14507 00000100:00100000:3.0:1746065186.517741:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31746:x1830881263030272:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065186.517756:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.517769:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6092d expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.517809:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.517848:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.517850:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.517853:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->2334719] (req 2097152->2334719) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.517877:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.517888:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 22 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.517898:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14508 00000100:00100000:3.0:1746065186.517901:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260343040:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.517907:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:31744:x1830881263030400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.517914:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.517923:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60934 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.517940:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.517946:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065186.517947:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065186.517950:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.517953:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305840 going to sleep for 11 seconds 00010000:00010000:2.0:1746065186.517964:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.517971:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 17 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.517984:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260343168:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.518006:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.519569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.519677:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260343168:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.519697:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.519709:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012daa3200, rc 0) 00000100:00100000:2.0:1746065186.519737:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31744:x1830881263030400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1832us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.519743:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14508 00000100:00100000:2.0:1746065186.519768:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263030528 00000100:00100000:2.0:1746065186.519782:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263030528 00002000:00100000:2.0:1746065186.519805:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2310143) req@ffff88009f147b80 x1830881263030528/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.519833:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f147b80 with x1830881263030528 ext(2097152->2310143) 00010000:00010000:2.0:1746065186.519839:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 18 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.519848:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 18 pid: 8851 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746065186.519854:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f147b80 00000100:00100000:2.0:1746065186.519989:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2485 00000100:00100000:2.0:1746065186.519996:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263030528:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065186.520292:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260343040:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.520306:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->2334719] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.520315:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211800, rc 0) 00000100:00100000:3.0:1746065186.520347:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31746:x1830881263030272:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2606us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.520353:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14507 00000100:00100000:0.0:1746065186.520471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.520531:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263030656 00000100:00100000:3.0:1746065186.520535:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263030656 00010000:00010000:3.0:1746065186.520601:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 22 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.520624:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7424 00000100:00100000:3.0:1746065186.520629:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263030656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.520637:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.520651:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 22 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.520658:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 22 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.520674:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a210e00/0x14b4f8542d4fcafa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60926 expref: 22 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.520694:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.520695:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.520700:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.520706:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.520723:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.521065:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260343296:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.521152:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.524071:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260343296:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.524089:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.524135:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263030656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3505us (3664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.524144:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7424 00000100:00100000:2.0:1746065186.524160:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263030528:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4162us (4592us total) trans 17179873595 rc 0/0 00000100:00100000:2.0:1746065186.524168:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2485 00002000:00100000:2.0:1746065186.524177:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2310143) req@ffff88009f147b80 x1830881263030528/t17179873595(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.524186:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f147b80 with x1830881263030528 ext(2097152->2310143) 00010000:00010000:2.0:1746065186.524194:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:2.0:1746065186.524206:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00002000:00010000:2.0:1746065186.524212:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f147b80 00000100:00100000:0.0:1746065186.525931:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.526215:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263030912 00000100:00100000:2.0:1746065186.526222:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263030912 00002000:00100000:2.0:1746065186.526251:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2330624->2334719) req@ffff88009f144000 x1830881263030912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.526259:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f144000 with x1830881263030912 ext(2330624->2334719) 00002000:00010000:2.0:1746065186.526268:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f144000 00000100:00100000:2.0:1746065186.527020:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8161 00000100:00100000:2.0:1746065186.527028:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263030912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065186.527163:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263030912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 135us (1235us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065186.527169:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8161 00002000:00100000:2.0:1746065186.527175:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2330624->2334719) req@ffff88009f144000 x1830881263030912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.527182:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f144000 with x1830881263030912 ext(2330624->2334719) 00002000:00010000:2.0:1746065186.527185:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f144000 00000100:00100000:0.0:1746065186.527431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.527447:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263031040 00000100:00100000:3.0:1746065186.527451:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263031040 00010000:00010000:3.0:1746065186.527467:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.527480:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7425 00000100:00100000:3.0:1746065186.527484:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263031040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.527490:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.527504:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.527513:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.527531:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c8c00/0x14b4f8542d4fca7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608e0 expref: 20 pid: 8851 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.527556:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.527558:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.527564:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.527576:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.527597:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.527605:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260343424:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.527654:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.530090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.530125:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260343424:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.530141:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.530170:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263031040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2685us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.530178:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7425 00000100:00100000:2.0:1746065186.530505:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263031296 00000100:00100000:2.0:1746065186.530512:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263031296 00000100:00100000:2.0:1746065186.530554:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4247 00000100:00100000:2.0:1746065186.530560:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+294:31746:x1830881263031296:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065186.530710:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:31746:x1830881263031296:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 150us (624us total) trans 8589944177 rc 0/0 00000100:00100000:2.0:1746065186.530715:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4247 00000100:00100000:0.0:1746065186.536113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.536207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.536237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.536788:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263031552 00000100:00100000:2.0:1746065186.536796:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263031552 00002000:00100000:2.0:1746065186.536843:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009f144e00 x1830881263031552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.536855:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f144e00 with x1830881263031552 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.536859:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f144e00 00000100:00100000:2.0:1746065186.536885:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263031808 00000100:00100000:2.0:1746065186.536887:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263031808 00002000:00100000:2.0:1746065186.536895:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009f146d80 x1830881263031808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.536900:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f146d80 with x1830881263031808 ext(3145728->4194303) 00002000:00010000:2.0:1746065186.536902:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f146d80 00000100:00100000:2.0:1746065186.536908:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032064 00000100:00100000:2.0:1746065186.536909:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032064 00002000:00100000:2.0:1746065186.536917:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f145c00 x1830881263032064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.536922:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f145c00 with x1830881263032064 ext(3145728->4194303) 00002000:00010000:2.0:1746065186.536925:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f145c00 00000100:00100000:2.0:1746065186.536946:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8162 00000100:00100000:2.0:1746065186.536951:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263031552:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065186.537199:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8163 00000100:00100000:1.0:1746065186.537206:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263031808:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065186.537459:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8164 00000100:00100000:3.0:1746065186.537466:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263032064:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065186.549420:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263031552:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12460us (13306us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.549432:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8162 00002000:00100000:2.0:1746065186.549442:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009f144e00 x1830881263031552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.549450:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f144e00 with x1830881263031552 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.549455:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f144e00 00000100:00100000:1.0:1746065186.554256:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263031808:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 17040us (18039us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065186.554267:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8163 00002000:00100000:1.0:1746065186.554277:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009f146d80 x1830881263031808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.554286:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f146d80 with x1830881263031808 ext(3145728->4194303) 00002000:00010000:1.0:1746065186.554291:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f146d80 00000100:00100000:3.0:1746065186.556460:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263032064:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 18989us (20215us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.556470:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8164 00002000:00100000:3.0:1746065186.556478:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f145c00 x1830881263032064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.556485:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f145c00 with x1830881263032064 ext(3145728->4194303) 00002000:00010000:3.0:1746065186.556489:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f145c00 00000100:00100000:0.0:1746065186.562741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.562889:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032320 00000100:00100000:3.0:1746065186.562897:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032320 00002000:00100000:3.0:1746065186.562931:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb13b80 x1830881263032320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.562939:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881263032320 ext(4194304->5013503) 00002000:00010000:3.0:1746065186.562944:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13b80 00000100:00100000:3.0:1746065186.563015:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8165 00000100:00100000:3.0:1746065186.563022:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263032320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065186.564281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.564302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.564333:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032448 00000100:00100000:2.0:1746065186.564337:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032448 00000100:00100000:2.0:1746065186.564356:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032576 00000100:00100000:2.0:1746065186.564358:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032576 00000100:00100000:2.0:1746065186.564369:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14509 00000100:00100000:2.0:1746065186.564374:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263032448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.564383:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.564397:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4400/0x14b4f8542d4fcb0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6093b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.564434:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260343552:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065186.564484:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14510 00000100:00100000:3.0:1746065186.564491:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263032576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.564498:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065186.564500:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065186.564506:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fcb16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60942 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.564527:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260343680:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065186.564548:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.566246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.566539:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032704 00000100:00100000:3.0:1746065186.566545:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032704 00000100:00100000:3.0:1746065186.566589:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14511 00000100:00100000:3.0:1746065186.566595:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263032704:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.566608:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.566621:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60949 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.566637:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.566638:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.566646:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.566658:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.566667:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c67200, rc 0) 00000100:00100000:3.0:1746065186.566707:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263032704:12345-192.168.202.46@tcp:101:cat.0 Request processed in 112us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.566713:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14511 00000100:00100000:3.0:1746065186.570026:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260343680:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065186.570052:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fcb16 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60942 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.570064:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fcb16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60942 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065186.570094:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c66e00, rc 0) 00000100:00100000:3.0:1746065186.570137:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263032576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5645us (5832us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065186.570144:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14510 00000100:00100000:2.0:1746065186.570448:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260343552:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.570464:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4400/0x14b4f8542d4fcb0f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6093b expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.570473:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a4400/0x14b4f8542d4fcb0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6093b expref: 12 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065186.570627:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263032320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7604us (7893us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065186.570634:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8165 00002000:00100000:3.0:1746065186.570641:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb13b80 x1830881263032320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.570655:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881263032320 ext(4194304->5013503) 00002000:00010000:3.0:1746065186.570659:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13b80 00010000:00010000:2.0:1746065186.570963:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a4400, rc 0) 00000100:00100000:2.0:1746065186.571029:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263032448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6613us (6709us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.571035:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14509 00000100:00100000:0.0:1746065186.577468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.577608:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263032960 00000100:00100000:1.0:1746065186.577616:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263032960 00000100:00100000:1.0:1746065186.577659:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4248 00000100:00100000:1.0:1746065186.577665:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:31744:x1830881263032960:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065186.578128:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+296:31744:x1830881263032960:12345-192.168.202.46@tcp:35:cat.0 Request processed in 461us (668us total) trans 8589944178 rc 0/0 00000100:00100000:1.0:1746065186.578138:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4248 00000100:00100000:2.0:1746065186.581201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.581267:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033088 00000100:00100000:0.0:1746065186.581275:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033088 00000100:00100000:0.0:1746065186.581322:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14512 00000100:00100000:0.0:1746065186.581328:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+11:31754:x1830881263033088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065186.581342:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.581356:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60950 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.581380:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.581387:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065186.581388:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065186.581391:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.581416:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.581426:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 20 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065186.581436:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260343808:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065186.581563:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.581871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.581973:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033216 00000100:00100000:3.0:1746065186.581977:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033216 00000100:00100000:3.0:1746065186.581997:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14513 00000100:00100000:3.0:1746065186.582002:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:31751:x1830881263033216:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065186.582009:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.582015:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60957 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.582026:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065186.582030:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.582035:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065186.582038:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1998848->2097151] (req 1998848->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.582057:0:8851:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.582067:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1998848->2097151] (req 1998848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.582076:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c67600, rc 0) 00000100:00100000:3.0:1746065186.582106:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:31751:x1830881263033216:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.582112:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14513 00000100:00100000:2.0:1746065186.583339:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260343808:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.583356:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.583365:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfce00, rc 0) 00000100:00100000:2.0:1746065186.583400:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:31754:x1830881263033088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2071us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.583406:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14512 00000100:00100000:0.0:1746065186.583912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.584023:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033344 00000100:00100000:3.0:1746065186.584028:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033344 00002000:00100000:3.0:1746065186.584054:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1454080->2097151) req@ffff88009f2c6300 x1830881263033344/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 504/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.584062:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6300 with x1830881263033344 ext(1454080->2097151) 00010000:00010000:3.0:1746065186.584068:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 21 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.584078:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 21 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.584084:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c6300 00000100:00100000:3.0:1746065186.584109:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2486 00000100:00100000:3.0:1746065186.584115:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263033344:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065186.593034:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263033344:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8910us (9114us total) trans 21474840864 rc 0/0 00000100:00100000:3.0:1746065186.593045:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2486 00002000:00100000:3.0:1746065186.593057:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1454080->2097151) req@ffff88009f2c6300 x1830881263033344/t21474840864(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 504/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.593066:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6300 with x1830881263033344 ext(1454080->2097151) 00010000:00010000:3.0:1746065186.593075:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 23 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.593095:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 23 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.593101:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c6300 00000100:00100000:0.0:1746065186.596903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.597242:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033472 00000100:00100000:3.0:1746065186.597358:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033472 00010000:00010000:3.0:1746065186.597483:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 23 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.598095:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7426 00000100:00100000:3.0:1746065186.598102:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263033472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.598113:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.598131:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 23 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.598141:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 23 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.598159:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fca60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->1605631) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608c4 expref: 23 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.598180:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.598182:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.598188:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.598201:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.598228:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 12 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.598237:0:10991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 12 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.598247:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260344064:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.599609:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.602049:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260344064:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.602066:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.602099:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263033472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3997us (5203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.602108:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7426 00000100:00100000:0.0:1746065186.604322:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.604527:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033728 00000100:00100000:3.0:1746065186.604534:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033728 00002000:00100000:3.0:1746065186.604568:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880095355880 x1830881263033728/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.604577:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355880 with x1830881263033728 ext(1048576->2097151) 00010000:00010000:3.0:1746065186.604585:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 13 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.604603:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 13 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.604609:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095355880 00000100:00100000:3.0:1746065186.604674:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2487 00000100:00100000:3.0:1746065186.604682:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263033728:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065186.613325:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263033728:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8635us (8997us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.613336:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2487 00002000:00100000:3.0:1746065186.613350:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880095355880 x1830881263033728/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.613359:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355880 with x1830881263033728 ext(1048576->2097151) 00010000:00010000:3.0:1746065186.613368:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 13 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.613381:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 13 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.613387:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095355880 00000100:00100000:0.0:1746065186.619958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.620263:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033856 00000100:00100000:2.0:1746065186.620271:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033856 00000100:00100000:2.0:1746065186.620313:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14514 00000100:00100000:2.0:1746065186.620320:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:31754:x1830881263033856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.620335:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.620349:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6095e expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.620374:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.620380:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065186.620385:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065186.620389:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.620414:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.620423:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 21 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.620433:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260344192:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065186.620634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.620712:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263033984 00000100:00100000:3.0:1746065186.620716:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263033984 00010000:00010000:3.0:1746065186.620733:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 15 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.620756:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7427 00000100:00100000:3.0:1746065186.620761:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263033984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.620767:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.620794:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 15 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.620804:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 15 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.620804:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065186.621466:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fcb24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60950 expref: 15 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.621484:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.621485:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.621490:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.621498:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.621523:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.621531:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260344320:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.621588:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.622050:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260344192:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065186.622070:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.622079:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54a00, rc 0) 00000100:00100000:0.0:1746065186.622113:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:31754:x1830881263033856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1791us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.622120:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14514 00000100:00100000:3.0:1746065186.622890:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260344320:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.622901:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.622936:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263033984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2173us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.622943:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7427 00000100:00100000:0.0:1746065186.623475:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.623510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.623571:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034112 00000100:00100000:3.0:1746065186.623577:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034112 00002000:00100000:3.0:1746065186.623609:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2334719) req@ffff880095354380 x1830881263034112/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.623618:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354380 with x1830881263034112 ext(2097152->2334719) 00010000:00010000:3.0:1746065186.623626:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 22 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.623641:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 22 pid: 25185 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.623650:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095354380 00000100:00100000:3.0:1746065186.623666:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034368 00000100:00100000:3.0:1746065186.623669:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034368 00002000:00100000:3.0:1746065186.623681:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1998848->2002943) req@ffff88009ba1ed80 x1830881263034368/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.623687:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ed80 with x1830881263034368 ext(1998848->2002943) 00002000:00010000:3.0:1746065186.623690:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1ed80 00000100:00100000:3.0:1746065186.623710:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2488 00000100:00100000:3.0:1746065186.623716:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263034112:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065186.623833:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8166 00000100:00100000:1.0:1746065186.623842:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263034368:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.623964:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263034368:12345-192.168.202.46@tcp:3:cat.0 Request processed in 123us (452us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065186.623969:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8166 00002000:00100000:1.0:1746065186.623974:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1998848->2002943) req@ffff88009ba1ed80 x1830881263034368/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.623981:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ed80 with x1830881263034368 ext(1998848->2002943) 00002000:00010000:1.0:1746065186.623984:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1ed80 00000100:00100000:0.0:1746065186.627931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.628376:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034496 00000100:00100000:1.0:1746065186.628383:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034496 00000100:00100000:1.0:1746065186.628424:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14515 00000100:00100000:1.0:1746065186.628432:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:31751:x1830881263034496:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065186.628450:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.628467:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60965 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.628498:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065186.628503:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.628508:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065186.628512:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2469887] (req 2097152->2469887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.628543:0:4544:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.628553:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2469887] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 14 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.628562:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094897a00, rc 0) 00000100:00100000:1.0:1746065186.630811:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:31751:x1830881263034496:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2368us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.630831:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14515 00000100:00100000:3.0:1746065186.631656:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263034112:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7938us (8181us total) trans 21474840865 rc 0/0 00000100:00100000:3.0:1746065186.631666:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2488 00002000:00100000:3.0:1746065186.631676:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2334719) req@ffff880095354380 x1830881263034112/t21474840865(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.631684:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354380 with x1830881263034112 ext(2097152->2334719) 00010000:00010000:3.0:1746065186.631693:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 24 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.631706:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 24 pid: 25185 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.631712:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095354380 00000100:00100000:0.0:1746065186.635563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.635625:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034624 00000100:00100000:3.0:1746065186.635632:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034624 00010000:00010000:3.0:1746065186.635659:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 24 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.635686:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7428 00000100:00100000:3.0:1746065186.635691:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263034624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.635700:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.635714:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 24 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.635721:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 24 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.635739:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a211800/0x14b4f8542d4fcb01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6092d expref: 24 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.635756:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.635757:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.635761:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.635766:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.635801:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.635809:0:10991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 13 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.636754:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260344576:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.637202:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.637728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.637781:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034752 00000100:00100000:3.0:1746065186.637786:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034752 00000100:00100000:3.0:1746065186.637833:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9945 00000100:00100000:3.0:1746065186.637839:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:31756:x1830881263034752:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065186.637855:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.637867:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fcb40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6096c expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.637908:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.637918:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.637926:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.637935:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.637940:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.637945:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.638037:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.638045:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 41 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.638051:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.638070:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 41 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.638078:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 41 pid: 14644 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.638091:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260344704:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065186.638132:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.638481:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260344576:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.638493:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.639395:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263034624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3700us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.639404:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7428 00000100:00100000:0.0:1746065186.639634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.639687:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260344704:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.639699:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065186.639712:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263034880 00000100:00100000:3.0:1746065186.639715:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263034880 00010000:00010000:3.0:1746065186.639729:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 42 pid: 14644 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.639754:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7429 00000100:00100000:3.0:1746065186.639759:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+42:1961:x1830881263034880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.639766:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.639779:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 42 pid: 14644 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.639788:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 42 pid: 14644 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.639807:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58fec00/0x14b4f8542d4fc941 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60800 expref: 42 pid: 14644 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.639839:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.639842:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639849:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639855:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639867:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.639885:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+41:1961:x1830881263034880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.639890:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7429 00010000:00010000:3.0:1746065186.639901:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639906:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065186.639935:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065186.639938:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065186.639949:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639957:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639966:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639972:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639977:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639981:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065186.639984:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639989:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.639995:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065186.639997:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065186.640000:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640005:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9800/0x14b4f8542d4fcb47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640011:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640015:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640020:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640023:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d8c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065186.640026:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640030:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640035:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:3.0:1746065186.640037:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065186.640039:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640043:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fcb4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.640064:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fcb40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 20 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.640072:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 19 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.640077:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.640079:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065186.640082:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9c00, rc 0) 00000100:00100000:3.0:1746065186.640099:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+19:31756:x1830881263034752:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2260us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.640104:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9945 00000100:00100000:0.0:1746065186.642601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.642686:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035008 00000100:00100000:1.0:1746065186.642692:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035008 00000100:00100000:1.0:1746065186.642724:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14516 00000100:00100000:1.0:1746065186.642730:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263035008:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065186.642743:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.642755:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60973 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.642795:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.642797:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.642803:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 7 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.643235:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 7 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.643252:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094897800, rc 0) 00000100:00100000:1.0:1746065186.643304:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263035008:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 573us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.643309:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14516 00000100:00100000:0.0:1746065186.643531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.643543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.643553:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035136 00000100:00100000:0.0:1746065186.643556:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035136 00000100:00100000:0.0:1746065186.643578:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035264 00000100:00100000:0.0:1746065186.643580:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035264 00000100:00100000:0.0:1746065186.643589:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14517 00000100:00100000:0.0:1746065186.643593:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263035136:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065186.643600:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.643609:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6097a expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.643620:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065186.643621:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065186.643626:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065186.643635:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065186.643642:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211800, rc 0) 00000100:00100000:0.0:1746065186.643654:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263035136:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.643659:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14517 00000100:00100000:0.0:1746065186.643671:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14518 00000100:00100000:0.0:1746065186.643674:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263035264:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065186.643679:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.643684:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60981 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.643691:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065186.643692:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065186.643695:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065186.643703:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065186.643714:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe12e00, rc 0) 00000100:00100000:0.0:1746065186.643723:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263035264:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 48us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.643727:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14518 00000100:00080000:0.0:1746065186.643737:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065186.643761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.643769:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035392 00000100:00100000:0.0:1746065186.643783:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035392 00000100:00100000:0.0:1746065186.643801:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14519 00000100:00100000:0.0:1746065186.643805:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263035392:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065186.643811:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.643831:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fcb71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60988 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065186.643859:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133264380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260344832:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065186.643893:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.645414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.646391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.646564:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133264380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260344832:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065186.646587:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fcb71 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60988 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065186.646599:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c8200/0x14b4f8542d4fcb71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60988 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065186.646658:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035520 00000100:00100000:1.0:1746065186.646663:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035520 00000100:00100000:1.0:1746065186.646688:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035648 00000100:00100000:1.0:1746065186.646690:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035648 00000100:00100000:1.0:1746065186.647055:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14520 00000100:00100000:1.0:1746065186.647061:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263035520:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065186.647073:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.647083:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094897200/0x14b4f8542d4fcb78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6098f expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.647096:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.647102:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094897200/0x14b4f8542d4fcb78 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6098f expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.647109:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094897200/0x14b4f8542d4fcb78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6098f expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.647119:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094897200, rc 0) 00000100:00100000:1.0:1746065186.647150:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263035520:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 89us (1742us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065186.647155:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14520 00000100:00100000:1.0:1746065186.647166:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14521 00000100:00100000:1.0:1746065186.647169:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263035648:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065186.647175:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.647182:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60996 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.647191:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.647192:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.647198:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.647209:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 9 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.647217:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094896200, rc 0) 00000100:00100000:1.0:1746065186.647226:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263035648:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 57us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.647231:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14521 00010000:00010000:0.0:1746065186.647286:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c8200, rc 0) 00000100:00100000:0.0:1746065186.647301:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263035392:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3495us (3540us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065186.647305:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14519 00000100:00100000:1.0:1746065186.647996:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.648031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.648045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.648104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.648377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.648622:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263036544 00000100:00100000:3.0:1746065186.648627:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263036544 00002000:00100000:3.0:1746065186.648652:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009c7ae300 x1830881263036544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.648666:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ae300 with x1830881263036544 ext(3145728->4194303) 00002000:00010000:3.0:1746065186.648670:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ae300 00000100:00100000:3.0:1746065186.648892:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263035904 00000100:00100000:3.0:1746065186.648895:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263035904 00000100:00100000:1.0:1746065186.649019:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263036032 00000100:00100000:1.0:1746065186.649022:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263036032 00002000:00100000:1.0:1746065186.649035:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009c7aea00 x1830881263036032/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.649041:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aea00 with x1830881263036032 ext(3145728->4194303) 00010000:00010000:1.0:1746065186.649046:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 15 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065186.649058:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 15 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:1.0:1746065186.649064:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7aea00 00000100:00100000:1.0:1746065186.649074:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263036416 00000100:00100000:1.0:1746065186.649076:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263036416 00002000:00100000:1.0:1746065186.649085:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009c7ac000 x1830881263036416/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.649091:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac000 with x1830881263036416 ext(2097152->3145727) 00002000:00010000:1.0:1746065186.649094:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac000 00000100:00100000:1.0:1746065186.649109:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2489 00000100:00100000:1.0:1746065186.649114:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881263036032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.650137:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8167 00000100:00100000:1.0:1746065186.650143:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263036544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.651108:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8168 00000100:00100000:2.0:1746065186.651117:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1959:x1830881263036416:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065186.652198:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263036928 00000100:00100000:2.0:1746065186.652205:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263036928 00000100:00100000:2.0:1746065186.652240:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9946 00000100:00100000:2.0:1746065186.652244:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+296:31758:x1830881263036928:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065186.652258:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.652271:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55e00/0x14b4f8542d4fcb86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6099d expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.652347:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.652358:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.652366:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.652375:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.652380:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.652385:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065186.652700:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065186.653449:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009c7ac700 x1830881263035904/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.653462:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac700 with x1830881263035904 ext(2097152->3145727) 00010000:00010000:3.0:1746065186.653471:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.653482:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.653489:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7ac700 00000100:00100000:3.0:1746065186.653518:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2490 00000100:00100000:3.0:1746065186.653526:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881263035904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.654131:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263037184 00000100:00100000:1.0:1746065186.654136:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263037184 00000100:00100000:1.0:1746065186.654163:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9947 00000100:00100000:1.0:1746065186.654169:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+19:31756:x1830881263037184:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065186.654179:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.654190:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f21e00/0x14b4f8542d4fcb9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609a4 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.654250:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065186.654262:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 20 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.654268:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065186.654294:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 20 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.654303:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 20 pid: 14645 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065186.654320:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260344960:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.654376:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e720c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065186.655046:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcba9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655057:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcba9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655066:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcba9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:2.0:1746065186.655075:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065186.655147:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655153:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655162:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655167:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b54200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065186.655170:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655175:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655184:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065186.655187:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065186.655190:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655194:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcb8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655214:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655218:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655223:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655227:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b54000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065186.655229:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655233:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.655242:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fab00) 00010000:00010000:2.0:1746065186.655244:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065186.655246:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.656599:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcb94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.656659:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55e00/0x14b4f8542d4fcb86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6099d expref: 299 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.656671:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcba9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6099d expref: 298 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.656678:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.656681:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065186.656683:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b55600, rc 0) 00000100:00100000:2.0:1746065186.656722:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+298:31758:x1830881263036928:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4476us (8343us total) trans 8589944179 rc 0/0 00000100:00100000:2.0:1746065186.656727:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9946 00000100:00100000:1.0:1746065186.660037:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260344960:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.660058:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065186.660595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.660750:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263037312 00000100:00100000:1.0:1746065186.660755:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263037312 00010000:00010000:1.0:1746065186.660797:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 21 pid: 14645 timeout: 885 lvb_type: 0 00000100:00100000:1.0:1746065186.660850:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7430 00000100:00100000:1.0:1746065186.660857:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+21:1961:x1830881263037312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065186.660869:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065186.660874:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 21 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065186.660883:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 21 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065186.660900:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fcb55 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6096c expref: 21 pid: 14645 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065186.660912:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065186.660917:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065186.660924:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065186.660930:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065186.660955:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065186.660984:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065186.660988:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:1961:x1830881263037312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 131us (395us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065186.660990:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065186.660993:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7430 00000004:00200000:2.0:1746065186.661005:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065186.661118:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f21e00/0x14b4f8542d4fcb9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.661135:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 20 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.661140:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.661142:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065186.661144:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca00000, rc 0) 00000100:00100000:2.0:1746065186.661164:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:31756:x1830881263037184:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6995us (8465us total) trans 8589944180 rc 0/0 00000100:00100000:2.0:1746065186.661169:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9947 00000100:00100000:1.0:1746065186.663396:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881263036032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14274us (15342us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065186.663408:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2489 00002000:00100000:1.0:1746065186.663418:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009c7aea00 x1830881263036032/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.663426:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aea00 with x1830881263036032 ext(3145728->4194303) 00010000:00010000:1.0:1746065186.663433:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:1.0:1746065186.663445:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:1.0:1746065186.663451:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7aea00 00000100:00100000:2.0:1746065186.667668:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1959:x1830881263036416:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16544us (19554us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.667678:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8168 00002000:00100000:2.0:1746065186.667688:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009c7ac000 x1830881263036416/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.667701:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac000 with x1830881263036416 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.667706:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac000 00000100:00100000:1.0:1746065186.668690:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881263036544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18545us (20692us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065186.668697:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8167 00002000:00100000:1.0:1746065186.668703:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009c7ae300 x1830881263036544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.668709:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ae300 with x1830881263036544 ext(3145728->4194303) 00002000:00010000:1.0:1746065186.668712:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ae300 00000100:00100000:3.0:1746065186.670354:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263035904:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16825us (22317us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.670361:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2490 00002000:00100000:3.0:1746065186.670367:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009c7ac700 x1830881263035904/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.670372:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac700 with x1830881263035904 ext(2097152->3145727) 00010000:00010000:3.0:1746065186.670379:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.670393:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.670397:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7ac700 00000100:00100000:0.0:1746065186.670804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.671124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.671177:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263037440 00000100:00100000:1.0:1746065186.671184:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263037440 00000100:00100000:1.0:1746065186.671224:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 754 00000100:00100000:1.0:1746065186.671229:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+298:1960:x1830881263037440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065186.671240:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065186.671259:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcba9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6099d expref: 298 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.671275:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065186.671279:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065186.671299:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+297:1960:x1830881263037440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.671305:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 754 00000100:00100000:2.0:1746065186.671638:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263037568 00000100:00100000:2.0:1746065186.671643:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263037568 00000100:00100000:2.0:1746065186.671674:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9948 00000100:00100000:2.0:1746065186.671685:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:31756:x1830881263037568:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065186.671700:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.671711:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4fcbbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609ab expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.671781:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.671794:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.671800:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.671850:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.671860:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 21 pid: 14644 timeout: 885 lvb_type: 0 00000100:00100000:2.0:1746065186.671870:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260345088:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.671931:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.675179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.675238:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263037696 00000100:00100000:3.0:1746065186.675245:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263037696 00010000:00010000:3.0:1746065186.675273:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.675308:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7431 00000100:00100000:3.0:1746065186.675315:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263037696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.675359:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065186.675366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065186.675379:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065186.675383:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263037824 00000100:00100000:0.0:1746065186.675386:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263037824 00010000:00010000:3.0:1746065186.675389:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065186.675400:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 22 pid: 14644 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.675406:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcb32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6095e expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065186.675417:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7432 00000100:00100000:0.0:1746065186.675421:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+22:1961:x1830881263037824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.675423:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.675425:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065186.675428:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.675431:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.675432:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 22 pid: 14644 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065186.675440:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 22 pid: 14644 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.675442:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.675453:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065186.675457:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065186.675476:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.675486:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260345216:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065186.675517:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.675523:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065186.675535:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.675547:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.675555:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+22:1961:x1830881263037824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 132us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.675561:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7432 00000100:00100000:3.0:1746065186.675575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.675604:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263038080 00000100:00100000:0.0:1746065186.675607:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263038080 00000100:00100000:3.0:1746065186.675612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.675623:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263037952 00000100:00100000:0.0:1746065186.675625:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263037952 00000100:00100000:3.0:1746065186.675628:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14522 00000100:00100000:3.0:1746065186.675634:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31758:x1830881263038080:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:0.0:1746065186.675637:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14523 00000100:00100000:0.0:1746065186.675641:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:31754:x1830881263037952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065186.675646:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.675648:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.675654:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609b2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.675654:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609b9 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.675673:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 15 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.675679:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065186.675680:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065186.675683:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.675694:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065186.675698:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.675703:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065186.675706:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3653632->3887103] (req 3653632->3887103) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.675718:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 15 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.675727:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca00000/0x14b4f8542d4fcba2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609a4 expref: 21 pid: 14644 timeout: 885 lvb_type: 0 00010000:00010000:0.0:1746065186.675728:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 15 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:0.0:1746065186.675736:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260345344:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.675741:0:8429:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.675742:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260345088:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065186.675751:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3653632->3887103] (req 3653632->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065186.675755:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065186.675757:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065186.675758:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8800, rc 0) 00010000:00010000:2.0:1746065186.675764:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.675769:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065186.675787:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:31758:x1830881263038080:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 154us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.675792:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14522 00000004:00200000:2.0:1746065186.675812:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065186.675832:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065186.675845:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.675870:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55a00/0x14b4f8542d4fcbbe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.675880:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 20 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.675886:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.675889:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065186.675891:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54e00, rc 0) 00000100:00100000:2.0:1746065186.675912:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:31756:x1830881263037568:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4232us (4788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.675918:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9948 00000100:00100000:0.0:1746065186.677692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.677743:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263038208 00000100:00100000:2.0:1746065186.677748:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263038208 00000100:00100000:2.0:1746065186.677783:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14524 00000100:00100000:2.0:1746065186.677789:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263038208:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065186.677800:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.677811:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcbda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609c0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.677859:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260345600:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065186.677878:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260345344:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.677895:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.677898:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065186.677906:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5800, rc 0) 00000100:00100000:1.0:1746065186.677925:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:31754:x1830881263037952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2282us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.677931:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14523 00000100:00100000:3.0:1746065186.677974:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260345216:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.677984:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.678003:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263037696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2689us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.678009:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7431 00000100:00100000:0.0:1746065186.678274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.678390:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263038336 00000100:00100000:1.0:1746065186.678394:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263038336 00000100:00100000:1.0:1746065186.678418:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14525 00000100:00100000:1.0:1746065186.678423:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263038336:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065186.678429:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.678435:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be8bc00/0x14b4f8542d4fcbe1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609c7 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065186.678456:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260345728:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065186.678491:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.678795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.678849:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260345600:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.678865:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcbda lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609c0 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.678879:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcbda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609c0 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065186.678886:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263038592 00010000:00010000:2.0:1746065186.678887:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54200, rc 0) 00000100:00100000:3.0:1746065186.678890:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263038592 00000100:00100000:2.0:1746065186.678906:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263038208:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1118us (1219us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.678911:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14524 00002000:00100000:3.0:1746065186.678942:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2465792->2469887) req@ffff88009baa1f80 x1830881263038592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.678950:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1f80 with x1830881263038592 ext(2465792->2469887) 00010000:00010000:3.0:1746065186.678956:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.678967:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.678973:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa1f80 00000100:00100000:3.0:1746065186.678992:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2491 00000100:00100000:3.0:1746065186.678998:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263038592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065186.679141:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263038592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 143us (346us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065186.679146:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2491 00002000:00100000:3.0:1746065186.679151:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2465792->2469887) req@ffff88009baa1f80 x1830881263038592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.679157:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1f80 with x1830881263038592 ext(2465792->2469887) 00010000:00010000:3.0:1746065186.679161:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.679170:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.679175:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa1f80 00000100:00100000:0.0:1746065186.680504:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.680541:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260345728:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065186.680559:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be8bc00/0x14b4f8542d4fcbe1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609c7 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.680569:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be8bc00/0x14b4f8542d4fcbe1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609c7 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.680581:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be8bc00, rc 0) 00000100:00100000:1.0:1746065186.680604:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263038336:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2181us (2330us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065186.680610:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14525 00000100:00100000:2.0:1746065186.680723:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263038976 00000100:00100000:2.0:1746065186.680728:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263038976 00000100:00100000:2.0:1746065186.680751:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4249 00000100:00100000:2.0:1746065186.680756:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+41:31751:x1830881263038976:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065186.680906:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+42:31751:x1830881263038976:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 149us (405us total) trans 8589944181 rc 0/0 00000100:00100000:2.0:1746065186.680912:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4249 00000100:00100000:0.0:1746065186.681632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.681740:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263039104 00000100:00100000:3.0:1746065186.681744:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263039104 00002000:00100000:3.0:1746065186.681765:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2469887) req@ffff88008fc58000 x1830881263039104/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.681783:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58000 with x1830881263039104 ext(2097152->2469887) 00010000:00010000:3.0:1746065186.681789:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.681799:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 14 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.681808:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc58000 00000100:00100000:3.0:1746065186.681849:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2492 00000100:00100000:3.0:1746065186.681855:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263039104:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065186.682529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.682578:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263039360 00000100:00100000:2.0:1746065186.682582:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263039360 00000100:00100000:2.0:1746065186.682603:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9949 00000100:00100000:2.0:1746065186.682607:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:31756:x1830881263039360:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065186.682616:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.682626:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcbe8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609ce expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.682680:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682694:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682703:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682711:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682716:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682721:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682726:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b55200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065186.682729:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682735:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682742:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.682744:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065186.682747:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682751:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcbef lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.682767:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcbe8 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ce expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.682792:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcbe8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ce expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.682798:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54600, rc 0) 00000100:00100000:2.0:1746065186.682842:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:31756:x1830881263039360:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 234us (314us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.682847:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9949 00000100:00100000:0.0:1746065186.687021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.687412:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263039104:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5555us (5778us total) trans 21474840866 rc 0/0 00000100:00100000:3.0:1746065186.687421:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2492 00002000:00100000:3.0:1746065186.687430:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2469887) req@ffff88008fc58000 x1830881263039104/t21474840866(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.687439:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58000 with x1830881263039104 ext(2097152->2469887) 00010000:00010000:3.0:1746065186.687448:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.687462:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.687470:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fc58000 00000100:00100000:2.0:1746065186.687552:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263039616 00000100:00100000:2.0:1746065186.687560:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263039616 00000100:00100000:2.0:1746065186.687587:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4250 00000100:00100000:2.0:1746065186.687593:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:31756:x1830881263039616:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1746065186.687806:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+21:31756:x1830881263039616:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 213us (792us total) trans 8589944182 rc 0/0 00000100:00100000:2.0:1746065186.687813:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4250 00000100:00100000:0.0:1746065186.688982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.689062:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263039744 00000100:00100000:3.0:1746065186.689068:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263039744 00010000:00010000:3.0:1746065186.689092:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.689121:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7433 00000100:00100000:3.0:1746065186.689127:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263039744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.689139:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.689183:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.689196:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.689214:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094897a00/0x14b4f8542d4fcb39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60965 expref: 16 pid: 4544 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.689239:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.689241:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.689247:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.689254:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.689281:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.689291:0:10991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.689302:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260345856:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.689732:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.691811:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260345856:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.691859:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.691897:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263039744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2769us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.691906:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7433 00000100:00100000:0.0:1746065186.693621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.693726:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040000 00000100:00100000:3.0:1746065186.693732:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040000 00002000:00100000:3.0:1746065186.693761:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009a4e8000 x1830881263040000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.693769:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8000 with x1830881263040000 ext(3145728->4194303) 00010000:00010000:3.0:1746065186.693789:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.693801:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.693807:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e8000 00000100:00100000:3.0:1746065186.693907:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2493 00000100:00100000:3.0:1746065186.693914:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263040000:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065186.703673:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263040000:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9744us (10042us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.703686:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2493 00002000:00100000:3.0:1746065186.703699:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009a4e8000 x1830881263040000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.703709:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8000 with x1830881263040000 ext(3145728->4194303) 00010000:00010000:3.0:1746065186.703720:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.703737:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00002000:00010000:3.0:1746065186.703743:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e8000 00000100:00100000:0.0:1746065186.708462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.708647:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040128 00000100:00100000:1.0:1746065186.708658:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040128 00000100:00100000:1.0:1746065186.708718:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14526 00000100:00100000:1.0:1746065186.708727:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263040128:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065186.708748:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.709023:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be8a600/0x14b4f8542d4fcbf6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609d5 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.709152:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.709165:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be8a600/0x14b4f8542d4fcbf6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609d5 expref: 16 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.709175:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be8a600/0x14b4f8542d4fcbf6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609d5 expref: 16 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.709196:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be8a600, rc 0) 00000100:00100000:1.0:1746065186.709251:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263040128:12345-192.168.202.46@tcp:101:cat.0 Request processed in 525us (800us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065186.709258:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14526 00000100:00100000:2.0:1746065186.711170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.714287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.714289:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040256 00000100:00100000:3.0:1746065186.714302:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040256 00010000:00010000:3.0:1746065186.714342:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00000100:00100000:3.0:1746065186.714389:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7434 00000100:00100000:3.0:1746065186.714396:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263040256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.714412:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.714435:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.714447:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.714471:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5800/0x14b4f8542d4fcbd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b9 expref: 15 pid: 25185 timeout: 885 lvb_type: 0 00010000:00010000:3.0:1746065186.714490:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.714491:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.714499:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.714511:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.714546:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.714559:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260345984:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.714652:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.714716:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040384 00000100:00100000:1.0:1746065186.714721:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040384 00000100:00100000:1.0:1746065186.714747:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14527 00000100:00100000:1.0:1746065186.714753:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:31754:x1830881263040384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065186.714767:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.714789:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609dc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.714806:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.714812:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065186.714828:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065186.714831:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.714849:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.714859:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 23 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065186.714867:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260346112:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.714900:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.719065:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260346112:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.719103:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.719122:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be8be00, rc 0) 00000100:00100000:1.0:1746065186.719177:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:31754:x1830881263040384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4422us (4896us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.719192:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14527 00000100:00100000:0.0:1746065186.721151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.721174:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040640 00000100:00100000:2.0:1746065186.721182:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040640 00002000:00100000:2.0:1746065186.721218:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3653632->3657727) req@ffff88009a4e8380 x1830881263040640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.721228:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8380 with x1830881263040640 ext(3653632->3657727) 00010000:00010000:2.0:1746065186.721236:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.721249:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065186.721261:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e8380 00000100:00100000:2.0:1746065186.721358:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2494 00000100:00100000:2.0:1746065186.721366:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263040640:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065186.721398:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260345984:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.721417:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.721457:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263040256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7061us (11705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.721467:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7434 00000100:00100000:2.0:1746065186.721501:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263040640:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 135us (358us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065186.721507:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2494 00002000:00100000:2.0:1746065186.721511:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3653632->3657727) req@ffff88009a4e8380 x1830881263040640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.721518:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8380 with x1830881263040640 ext(3653632->3657727) 00010000:00010000:2.0:1746065186.721522:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.721530:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065186.721536:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e8380 00000100:00100000:0.0:1746065186.730550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.730614:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263040896 00000100:00100000:2.0:1746065186.730622:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263040896 00002000:00100000:2.0:1746065186.730658:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3883008->3887103) req@ffff880130444a80 x1830881263040896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.730666:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444a80 with x1830881263040896 ext(3883008->3887103) 00010000:00010000:2.0:1746065186.730673:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.730690:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065186.730696:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130444a80 00000100:00100000:2.0:1746065186.730729:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2495 00000100:00100000:2.0:1746065186.730737:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263040896:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065186.731564:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263040896:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 825us (1020us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065186.731571:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2495 00002000:00100000:2.0:1746065186.731577:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3883008->3887103) req@ffff880130444a80 x1830881263040896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.731583:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444a80 with x1830881263040896 ext(3883008->3887103) 00010000:00010000:2.0:1746065186.731588:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.731598:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065186.731603:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130444a80 00000100:00100000:0.0:1746065186.735292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.735523:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.735585:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263041152 00000100:00100000:3.0:1746065186.735593:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263041152 00000100:00100000:2.0:1746065186.735602:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263041408 00000100:00100000:2.0:1746065186.735610:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263041408 00002000:00100000:3.0:1746065186.735629:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3653632->3887103) req@ffff880130447480 x1830881263041152/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.735638:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447480 with x1830881263041152 ext(3653632->3887103) 00010000:00010000:3.0:1746065186.735646:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065186.735654:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4251 00010000:00010000:3.0:1746065186.735658:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 24 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065186.735660:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+297:31758:x1830881263041408:12345-192.168.202.46@tcp:35:multiop.0 00002000:00010000:3.0:1746065186.735669:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130447480 00000100:00100000:3.0:1746065186.735692:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2496 00000100:00100000:3.0:1746065186.735697:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263041152:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065186.736172:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+298:31758:x1830881263041408:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 511us (884us total) trans 8589944183 rc 0/0 00000100:00100000:2.0:1746065186.736179:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4251 00000100:00100000:3.0:1746065186.738655:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263041152:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 2953us (3127us total) trans 21474840867 rc 0/0 00000100:00100000:3.0:1746065186.738663:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2496 00002000:00100000:3.0:1746065186.738670:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3653632->3887103) req@ffff880130447480 x1830881263041152/t21474840867(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.738676:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447480 with x1830881263041152 ext(3653632->3887103) 00010000:00010000:3.0:1746065186.738683:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.738692:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065186.738697:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130447480 00000100:00100000:0.0:1746065186.741231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.741321:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263041536 00000100:00100000:3.0:1746065186.741329:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263041536 00010000:00010000:3.0:1746065186.741356:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065186.741425:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7435 00000100:00100000:3.0:1746065186.741433:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263041536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.741450:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.741472:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.741483:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.741505:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcbcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->3887103) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609b2 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.741626:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.741629:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.741636:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 14 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.741644:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 14 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.741671:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 14 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.741682:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260346240:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.741760:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.743013:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260346240:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.743029:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.743058:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263041536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1625us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.743066:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7435 00000100:00100000:0.0:1746065186.747716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.748101:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263041792 00000100:00100000:3.0:1746065186.748109:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263041792 00002000:00100000:3.0:1746065186.748151:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880130444000 x1830881263041792/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.748167:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444000 with x1830881263041792 ext(4194304->5013503) 00002000:00010000:3.0:1746065186.748172:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130444000 00000100:00100000:3.0:1746065186.748205:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8169 00000100:00100000:3.0:1746065186.748212:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263041792:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065186.755569:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263041792:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7349us (7852us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065186.755577:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8169 00002000:00100000:3.0:1746065186.755587:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880130444000 x1830881263041792/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.755592:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444000 with x1830881263041792 ext(4194304->5013503) 00002000:00010000:3.0:1746065186.755596:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130444000 00000100:00100000:0.0:1746065186.795455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.795556:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042048 00000100:00100000:2.0:1746065186.795564:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042048 00000100:00100000:2.0:1746065186.795602:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9950 00000100:00100000:2.0:1746065186.795609:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+298:31765:x1830881263042048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.795635:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.795653:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcc04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609e3 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.795744:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796070:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796085:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796098:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796103:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796108:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796199:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796210:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796216:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065186.796222:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065186.796288:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796294:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796298:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796302:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b54a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065186.796305:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796310:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796318:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065186.796321:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065186.796324:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796328:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcc0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796356:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796364:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796368:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796372:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b54600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065186.796375:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796378:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796384:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009a192500) 00010000:00010000:2.0:1746065186.796386:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065186.796388:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796392:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcc12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065186.796426:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcc04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 301 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.796436:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 300 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.796442:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.796444:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065186.796446:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b55200, rc 0) 00000100:00100000:2.0:1746065186.796500:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+300:31765:x1830881263042048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 891us (1052us total) trans 8589944184 rc 0/0 00000100:00100000:2.0:1746065186.796507:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9950 00000100:00100000:2.0:1746065186.799858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.799948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.800148:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042176 00000100:00100000:0.0:1746065186.800158:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042176 00000100:00100000:0.0:1746065186.800192:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042304 00000100:00100000:0.0:1746065186.800194:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042304 00000100:00100000:0.0:1746065186.800208:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14528 00000100:00100000:0.0:1746065186.800214:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263042176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065186.800228:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065186.800241:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5a00/0x14b4f8542d4fcc27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609ea expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065186.800287:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260346368:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065186.800288:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14529 00000100:00100000:1.0:1746065186.800296:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263042304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065186.800304:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.800312:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609f1 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.800324:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.800325:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.800341:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 28 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.800354:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 28 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.800362:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be8b600, rc 0) 00000100:00100000:0.0:1746065186.800369:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065186.800386:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263042304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 91us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.800391:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14529 00000100:00100000:2.0:1746065186.801982:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260346368:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065186.802008:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5a00/0x14b4f8542d4fcc27 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ea expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.802018:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4a5a00/0x14b4f8542d4fcc27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ea expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.802027:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4a5a00, rc 0) 00000100:00100000:2.0:1746065186.802054:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263042176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1839us (2203us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065186.802060:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14528 00000100:00100000:0.0:1746065186.808728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.809027:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042432 00000100:00100000:2.0:1746065186.809035:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042432 00000100:00100000:2.0:1746065186.809118:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14530 00000100:00100000:2.0:1746065186.809126:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31765:x1830881263042432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.809140:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.809153:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609f8 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.809176:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.809186:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065186.809188:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065186.809190:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.809211:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.809219:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 14 pid: 8851 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065186.809229:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260346496:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.809879:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.812059:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260346496:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.812332:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.812346:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54200, rc 0) 00000100:00100000:2.0:1746065186.812393:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31765:x1830881263042432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3267us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.812400:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14530 00000100:00100000:0.0:1746065186.813139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.813192:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042560 00000100:00100000:3.0:1746065186.813198:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042560 00002000:00100000:3.0:1746065186.813225:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1998848->2097151) req@ffff88009f9cdf80 x1830881263042560/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.813233:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdf80 with x1830881263042560 ext(1998848->2097151) 00010000:00010000:3.0:1746065186.813239:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 15 pid: 8851 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.813254:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 15 pid: 8851 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065186.813260:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cdf80 00000100:00100000:3.0:1746065186.813288:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2497 00000100:00100000:3.0:1746065186.813294:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263042560:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065186.818049:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263042560:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4747us (4902us total) trans 21474840868 rc 0/0 00000100:00100000:3.0:1746065186.818060:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2497 00002000:00100000:3.0:1746065186.818069:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1998848->2097151) req@ffff88009f9cdf80 x1830881263042560/t21474840868(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/448 e 0 to 0 dl 1746065197 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.818077:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdf80 with x1830881263042560 ext(1998848->2097151) 00010000:00010000:3.0:1746065186.818085:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 17 pid: 8851 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.818097:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 17 pid: 8851 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065186.818104:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cdf80 00000100:00100000:0.0:1746065186.820075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.820219:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042688 00000100:00100000:3.0:1746065186.820226:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042688 00010000:00010000:3.0:1746065186.820254:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 17 pid: 8851 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065186.820499:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7436 00000100:00100000:3.0:1746065186.820507:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263042688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.820518:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.820537:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 17 pid: 8851 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.820547:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 17 pid: 8851 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.820567:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c67600/0x14b4f8542d4fcb2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60957 expref: 17 pid: 8851 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.820594:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.820596:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065186.820602:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.820610:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.820637:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065186.820647:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260346624:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065186.820994:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.823604:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260346624:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065186.823625:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.823659:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881263042688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3152us (3587us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.823667:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7436 00000100:00100000:0.0:1746065186.825628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.825745:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263042944 00000100:00100000:3.0:1746065186.825753:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263042944 00002000:00100000:3.0:1746065186.825801:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f9cdc00 x1830881263042944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.825808:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdc00 with x1830881263042944 ext(1048576->2097151) 00002000:00010000:3.0:1746065186.825812:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cdc00 00000100:00100000:3.0:1746065186.825911:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8170 00000100:00100000:3.0:1746065186.825916:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263042944:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065186.832997:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263042944:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7074us (7369us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.833007:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8170 00002000:00100000:3.0:1746065186.833017:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f9cdc00 x1830881263042944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.833026:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdc00 with x1830881263042944 ext(1048576->2097151) 00002000:00010000:3.0:1746065186.833030:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cdc00 00000100:00100000:2.0:1746065186.836017:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3295:1830881260346752:0@lo:400:kworker.0 00000100:00100000:1.0:1746065186.836017:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260347136:0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.836159:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065186.836160:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065186.836188:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065186.836193:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830881260347008:0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.836196:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260347264:0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.836212:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065186.836213:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065186.836223:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065186.836227:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1830881260346880:0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.836241:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065186.836249:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260347008 00000100:00100000:2.0:1746065186.836251:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830881260347392:0@lo:400:kworker.0 00000100:00100000:1.0:1746065186.836255:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260347008 00000100:00100000:2.0:1746065186.836262:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065186.836280:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260347136 00000100:00100000:2.0:1746065186.836282:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260347136 00000100:00100000:1.0:1746065186.836288:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260346880 00000100:00100000:1.0:1746065186.836290:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260346880 00000100:00100000:2.0:1746065186.836301:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260347264 00000100:00100000:2.0:1746065186.836302:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260347264 00000100:00100000:1.0:1746065186.836303:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260347392 00000100:00100000:1.0:1746065186.836305:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260347392 00000100:00100000:2.0:1746065186.836314:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1746065186.836315:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1746065186.836319:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1830881260347136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065186.836320:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830881260347008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.836347:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1830881260347136:12345-0@lo:400:kworker.0 Request processed in 28us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.836351:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830881260347008:12345-0@lo:400:kworker.0 Request processed in 31us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.836352:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1746065186.836357:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1746065186.836361:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1746065186.836365:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1830881260347264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065186.836367:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1746065186.836371:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830881260346880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.836380:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1830881260347264:12345-0@lo:400:kworker.0 Request processed in 15us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.836384:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1746065186.836389:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830881260346880:12345-0@lo:400:kworker.0 Request processed in 17us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.836393:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1746065186.836402:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1746065186.836406:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830881260347008:0@lo:400:kworker.0 00000100:00100000:1.0:1746065186.836406:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830881260347392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.836412:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840846 gen 2 00000004:00080000:2.0:1746065186.836416:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd05880, transno 21474840797 00000004:00080000:2.0:1746065186.836420:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd05c00, transno 21474840798 00000004:00080000:2.0:1746065186.836422:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd06680, transno 21474840799 00000100:00100000:1.0:1746065186.836423:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830881260347392:12345-0@lo:400:kworker.0 Request processed in 17us (160us total) trans 0 rc 0/0 00000004:00080000:2.0:1746065186.836425:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd07b80, transno 21474840800 00000100:00100000:1.0:1746065186.836426:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000004:00080000:2.0:1746065186.836427:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd04e00, transno 21474840801 00000004:00080000:2.0:1746065186.836429:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd06300, transno 21474840802 00000004:00080000:2.0:1746065186.836431:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd04a80, transno 21474840803 00000004:00080000:2.0:1746065186.836432:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd07100, transno 21474840804 00000004:00080000:2.0:1746065186.836434:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc5a680, transno 21474840805 00000004:00080000:2.0:1746065186.836436:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880380, transno 21474840806 00000004:00080000:2.0:1746065186.836438:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5883800, transno 21474840807 00000004:00080000:2.0:1746065186.836440:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5883480, transno 21474840808 00000100:00080000:1.0:1746065186.836440:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746065186.836441:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a12300, transno 21474840809 00000004:00080000:2.0:1746065186.836443:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc59c00, transno 21474840810 00000100:00080000:1.0:1746065186.836443:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1746065186.836445:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5881c00, transno 21474840811 00000100:00080000:1.0:1746065186.836445:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1746065186.836447:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880700, transno 21474840812 00000004:00080000:2.0:1746065186.836448:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880000, transno 21474840813 00000004:00080000:2.0:1746065186.836450:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5881880, transno 21474840814 00000004:00080000:2.0:1746065186.836452:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d86a00, transno 21474840820 00000004:00080000:2.0:1746065186.836454:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b4000, transno 21474840821 00000004:00080000:2.0:1746065186.837014:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d85500, transno 21474840822 00000004:00080000:2.0:1746065186.837017:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b6d80, transno 21474840823 00000100:00100000:0.0:1746065186.837018:0:14641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260346752 00000004:00080000:2.0:1746065186.837019:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130445f80, transno 21474840824 00000004:00080000:2.0:1746065186.837021:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d86300, transno 21474840825 00000100:00100000:0.0:1746065186.837021:0:14641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260346752 00000004:00080000:2.0:1746065186.837023:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b4e00, transno 21474840826 00000004:00080000:2.0:1746065186.837025:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d86680, transno 21474840827 00000004:00080000:2.0:1746065186.837026:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e8b4a80, transno 21474840828 00000004:00080000:2.0:1746065186.837028:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d84380, transno 21474840829 00000004:00080000:2.0:1746065186.837030:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c0e00, transno 21474840830 00000004:00080000:2.0:1746065186.837032:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0d880, transno 21474840831 00000004:00080000:2.0:1746065186.837034:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c2d80, transno 21474840832 00000004:00080000:2.0:1746065186.837036:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134d84e00, transno 21474840833 00000004:00080000:2.0:1746065186.837037:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380f480, transno 21474840834 00000004:00080000:2.0:1746065186.837039:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c2680, transno 21474840835 00000004:00080000:2.0:1746065186.837041:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380ca80, transno 21474840836 00000004:00080000:2.0:1746065186.837043:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa0380, transno 21474840837 00000004:00080000:2.0:1746065186.837045:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49c000, transno 21474840838 00000004:00080000:2.0:1746065186.837047:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45c700, transno 21474840839 00000004:00080000:2.0:1746065186.837049:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45fb80, transno 21474840840 00000004:00080000:2.0:1746065186.837051:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45ed80, transno 21474840841 00000004:00080000:2.0:1746065186.837053:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49f480, transno 21474840842 00000100:00100000:0.0:1746065186.837053:0:14641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000004:00080000:2.0:1746065186.837054:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45e300, transno 21474840843 00000004:00080000:2.0:1746065186.837056:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f49d880, transno 21474840844 00000100:00100000:0.0:1746065186.837057:0:14641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3295:x1830881260346752:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1746065186.837058:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45d180, transno 21474840845 00000004:00080000:2.0:1746065186.837060:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009baa3480, transno 21474840846 00000100:00100000:2.0:1746065186.837063:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260347136:0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.837085:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1830881260346880:0@lo:400:kworker.0 00000100:00100000:0.0:1746065186.837085:0:14641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3295:x1830881260346752:12345-0@lo:400:kworker.0 Request processed in 28us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.837089:0:14641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1746065186.837091:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830881260347392:0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.837102:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3295:1830881260346752:0@lo:400:kworker.0 00000100:00100000:2.0:1746065186.837107:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873578 gen 2 00000004:00080000:2.0:1746065186.837109:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c1f80, transno 17179873536 00000004:00080000:2.0:1746065186.837115:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c1880, transno 17179873537 00000004:00080000:2.0:1746065186.837117:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c3800, transno 17179873538 00000004:00080000:2.0:1746065186.837118:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c3100, transno 17179873539 00000004:00080000:2.0:1746065186.837120:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c2300, transno 17179873540 00000004:00080000:2.0:1746065186.837122:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c0a80, transno 17179873541 00000004:00080000:2.0:1746065186.837124:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c1c00, transno 17179873542 00000004:00080000:2.0:1746065186.837126:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c3480, transno 17179873543 00000004:00080000:2.0:1746065186.837127:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3c700, transno 17179873544 00000004:00080000:2.0:1746065186.837129:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3ce00, transno 17179873545 00000004:00080000:2.0:1746065186.837131:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd71f80, transno 17179873546 00000004:00080000:2.0:1746065186.837133:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3e300, transno 17179873547 00000004:00080000:2.0:1746065186.837135:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd73800, transno 17179873548 00000004:00080000:2.0:1746065186.837137:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd70000, transno 17179873549 00000004:00080000:2.0:1746065186.837139:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c1500, transno 17179873550 00000004:00080000:2.0:1746065186.837141:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd73b80, transno 17179873551 00000004:00080000:2.0:1746065186.837143:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdc000, transno 17179873555 00000004:00080000:2.0:1746065186.837144:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cddc00, transno 17179873556 00000004:00080000:2.0:1746065186.837146:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cded80, transno 17179873557 00000004:00080000:2.0:1746065186.837148:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdc380, transno 17179873558 00000004:00080000:2.0:1746065186.837150:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdca80, transno 17179873559 00000004:00080000:2.0:1746065186.837151:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd07800, transno 17179873560 00000004:00080000:2.0:1746065186.837153:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdf100, transno 17179873561 00000004:00080000:2.0:1746065186.837155:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd05f80, transno 17179873562 00000004:00080000:2.0:1746065186.837157:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0ea00, transno 17179873563 00000004:00080000:2.0:1746065186.837159:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0df80, transno 17179873564 00000004:00080000:2.0:1746065186.837160:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0e300, transno 17179873565 00000004:00080000:2.0:1746065186.837162:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0d500, transno 17179873566 00000004:00080000:2.0:1746065186.837164:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0ed80, transno 17179873567 00000004:00080000:2.0:1746065186.837165:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0c380, transno 17179873568 00000004:00080000:2.0:1746065186.837167:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0fb80, transno 17179873569 00000004:00080000:2.0:1746065186.837169:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0f800, transno 17179873570 00000004:00080000:2.0:1746065186.837171:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d7fea00, transno 17179873571 00000004:00080000:2.0:1746065186.837173:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fea00, transno 17179873572 00000004:00080000:2.0:1746065186.837175:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d7fca80, transno 17179873573 00000004:00080000:2.0:1746065186.837177:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fe680, transno 17179873574 00000004:00080000:2.0:1746065186.837178:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d7fe300, transno 17179873575 00000004:00080000:2.0:1746065186.837180:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fdf80, transno 17179873576 00000004:00080000:2.0:1746065186.837182:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d7fdf80, transno 17179873577 00000004:00080000:2.0:1746065186.837184:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fe300, transno 17179873578 00000100:00100000:2.0:1746065186.837186:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260347264:0@lo:400:kworker.0 00000004:00080000:3.0:1746065186.837340:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 25 in progress, 0 in flight, 20 done 00000004:00080000:0.0:1746065186.837342:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 35 in progress, 0 in flight, 5 done 00000004:00080000:3.0:1746065186.837452:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 25 done 00000004:00080000:0.0:1746065186.837466:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 35 done 00000100:00100000:0.0:1746065186.842184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.842223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.842278:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263043200 00000100:00100000:3.0:1746065186.842286:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263043200 00002000:00100000:3.0:1746065186.842321:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880135cdc000 x1830881263043200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.842331:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc000 with x1830881263043200 ext(2097152->3145727) 00002000:00010000:3.0:1746065186.842335:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdc000 00000100:00100000:3.0:1746065186.842362:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263043328 00000100:00100000:3.0:1746065186.842365:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263043328 00002000:00100000:3.0:1746065186.842376:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cddc00 x1830881263043328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.842383:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cddc00 with x1830881263043328 ext(3145728->4194303) 00002000:00010000:3.0:1746065186.842385:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cddc00 00000100:00100000:3.0:1746065186.842399:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8171 00000100:00100000:3.0:1746065186.842406:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263043200:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.842477:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8172 00000100:00100000:1.0:1746065186.842488:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263043328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065186.851549:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263043328:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9053us (9317us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065186.851560:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8172 00002000:00100000:1.0:1746065186.851570:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cddc00 x1830881263043328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065186.851579:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cddc00 with x1830881263043328 ext(3145728->4194303) 00002000:00010000:1.0:1746065186.851585:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cddc00 00000100:00100000:2.0:1746065186.852192:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065186.852205:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260347520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065186.852240:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065186.852574:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260347520 00000100:00100000:0.0:1746065186.852581:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260347520 00000100:00100000:0.0:1746065186.852615:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1746065186.852621:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1830881260347520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065186.852636:0:8430:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 572588032 pending 18743296 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746065186.852871:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1830881260347520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 249us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.852877:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1746065186.852959:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260347520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746065186.854789:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263043200:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12377us (12605us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.854797:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8171 00002000:00100000:3.0:1746065186.854806:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880135cdc000 x1830881263043200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.854836:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc000 with x1830881263043200 ext(2097152->3145727) 00002000:00010000:3.0:1746065186.854841:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdc000 00000100:00100000:0.0:1746065186.868550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.870573:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263043712 00000100:00100000:3.0:1746065186.870583:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263043712 00002000:00100000:3.0:1746065186.870622:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880135cdc380 x1830881263043712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.870632:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc380 with x1830881263043712 ext(4194304->5013503) 00002000:00010000:3.0:1746065186.870637:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdc380 00000100:00100000:3.0:1746065186.870664:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8173 00000100:00100000:3.0:1746065186.870671:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263043712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065186.876990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.877050:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263043840 00000100:00100000:2.0:1746065186.877057:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263043840 00000100:00100000:3.0:1746065186.877661:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263043712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6988us (9118us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065186.877670:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8173 00002000:00100000:3.0:1746065186.877678:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880135cdc380 x1830881263043712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.877686:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc380 with x1830881263043712 ext(4194304->5013503) 00002000:00010000:3.0:1746065186.877690:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdc380 00000100:00100000:2.0:1746065186.877731:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14531 00000100:00100000:2.0:1746065186.877737:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263043840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065186.877747:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065186.877760:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e609ff expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.877788:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.877790:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.877796:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 17 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.877808:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 17 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065186.877839:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54000, rc 0) 00000100:00100000:2.0:1746065186.877855:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263043840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 119us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.877859:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14531 00000100:00100000:0.0:1746065186.885522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.886505:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263044096 00000100:00100000:3.0:1746065186.886513:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263044096 00002000:00100000:3.0:1746065186.886550:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880135cdf100 x1830881263044096/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.886558:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf100 with x1830881263044096 ext(1048576->2097151) 00002000:00010000:3.0:1746065186.886562:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdf100 00000100:00100000:3.0:1746065186.886596:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8174 00000100:00100000:3.0:1746065186.886603:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263044096:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065186.892703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.893346:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263044352 00000100:00100000:2.0:1746065186.893354:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263044352 00000100:00100000:2.0:1746065186.893434:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4252 00000100:00100000:2.0:1746065186.893442:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+300:31765:x1830881263044352:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065186.894295:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+301:31765:x1830881263044352:12345-192.168.202.46@tcp:35:cat.0 Request processed in 852us (1599us total) trans 8589944185 rc 0/0 00000100:00100000:2.0:1746065186.894302:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4252 00000100:00100000:3.0:1746065186.895437:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263044096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8831us (9919us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.895445:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8174 00002000:00100000:3.0:1746065186.895453:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880135cdf100 x1830881263044096/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.895468:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf100 with x1830881263044096 ext(1048576->2097151) 00002000:00010000:3.0:1746065186.895473:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdf100 00000100:00100000:2.0:1746065186.900300:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065186.900317:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260347648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065186.900364:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065186.900591:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260347648 00000100:00100000:3.0:1746065186.900598:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260347648 00000100:00100000:3.0:1746065186.900640:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1746065186.900647:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1830881260347648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746065186.900666:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 548601856 pending 13631488 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746065186.900708:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1830881260347648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.900714:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1746065186.900810:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260347648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065186.906447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.907420:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.907551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.907624:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263044608 00000100:00100000:2.0:1746065186.907631:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263044608 00000100:00100000:2.0:1746065186.907668:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9951 00000100:00100000:2.0:1746065186.907675:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+42:31770:x1830881263044608:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:0.0:1746065186.907692:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263044864 00010000:00010000:2.0:1746065186.907694:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065186.907695:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263044864 00010000:00010000:2.0:1746065186.907708:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcc43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a06 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065186.907718:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009ba3c700 x1830881263044864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065186.907726:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c700 with x1830881263044864 ext(2097152->3145727) 00002000:00010000:0.0:1746065186.907729:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3c700 00000100:00100000:0.0:1746065186.907739:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263045120 00000100:00100000:0.0:1746065186.907741:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263045120 00002000:00100000:0.0:1746065186.907748:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba3ce00 x1830881263045120/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065186.907753:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ce00 with x1830881263045120 ext(3145728->4194303) 00002000:00010000:0.0:1746065186.907755:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3ce00 00000100:00100000:0.0:1746065186.907764:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8175 00000100:00100000:0.0:1746065186.907781:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263044864:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065186.907799:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.907811:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 20 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.907833:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 300 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.907837:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.907862:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 300 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.907871:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 300 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065186.907880:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260347776:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.907944:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 20 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.907950:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 20 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065186.907956:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260347904:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.907970:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065186.907984:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8176 00000100:00100000:2.0:1746065186.907989:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263045120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065186.913390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.913500:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260347776:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065186.913509:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260347904:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065186.913534:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065186.915931:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263045376 00000100:00100000:3.0:1746065186.915941:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263045376 00010000:00010000:3.0:1746065186.915969:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 21 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065186.915999:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7437 00000100:00100000:3.0:1746065186.916003:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+21:1960:x1830881263045376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.916012:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.916015:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 21 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.916022:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 21 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.916035:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcbc5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ab expref: 21 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065186.916052:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.916055:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.916060:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.916063:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.916210:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:1960:x1830881263045376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 205us (2826us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.916216:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7437 00000100:00100000:1.0:1746065186.916245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.916729:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263045248 00000100:00100000:2.0:1746065186.916733:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263045248 00010000:00010000:2.0:1746065186.916747:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 301 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065186.916764:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7438 00000100:00100000:2.0:1746065186.916780:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+301:1960:x1830881263045248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.916787:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.916791:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 301 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.916800:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 301 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.916811:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcc19 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609e3 expref: 301 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065186.916978:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263045120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8986us (9425us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065186.916985:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8176 00002000:00100000:3.0:1746065186.916992:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba3ce00 x1830881263045120/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.917000:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ce00 with x1830881263045120 ext(3145728->4194303) 00002000:00010000:3.0:1746065186.917004:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3ce00 00010000:00010000:2.0:1746065186.917013:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065186.917017:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.917023:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.917029:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065186.917047:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065186.917055:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.917061:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:2.0:1746065186.917064:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+300:1960:x1830881263045248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 294us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.917069:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7438 00000004:00200000:3.0:1746065186.917076:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065186.917178:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcc43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 45 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.917194:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 44 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.917199:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.917201:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065186.917203:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b55600, rc 0) 00000100:00100000:3.0:1746065186.917229:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+44:31770:x1830881263044608:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9555us (10792us total) trans 8589944186 rc 0/0 00000100:00100000:3.0:1746065186.917233:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9951 00000100:00100000:2.0:1746065186.919748:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263044864:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11967us (12317us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065186.919759:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8175 00002000:00100000:2.0:1746065186.919780:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009ba3c700 x1830881263044864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/440 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.919788:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c700 with x1830881263044864 ext(2097152->3145727) 00002000:00010000:2.0:1746065186.919792:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3c700 00000100:00100000:0.0:1746065186.962858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.962932:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263045632 00000100:00100000:3.0:1746065186.962940:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263045632 00000100:00100000:3.0:1746065186.963392:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9952 00000100:00100000:3.0:1746065186.963402:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+300:31774:x1830881263045632:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065186.963424:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065186.963439:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f0800/0x14b4f8542d4fcc58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a0d expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.963534:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963546:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963554:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963565:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963574:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963579:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963667:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d000/0x14b4f8542d4fcc6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963675:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d000/0x14b4f8542d4fcc6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963680:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d000/0x14b4f8542d4fcc6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065186.963688:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065186.963764:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963782:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963788:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963793:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f0d400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065186.963796:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963801:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963938:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065186.963941:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065186.963945:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.963950:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d400/0x14b4f8542d4fcc5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.965345:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.965354:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.965359:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.965363:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f0ce00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065186.965366:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.965371:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.965380:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205100) 00010000:00010000:3.0:1746065186.965383:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065186.965385:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.965389:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0x14b4f8542d4fcc66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065186.965439:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f0800/0x14b4f8542d4fcc58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a0d expref: 303 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.965454:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d000/0x14b4f8542d4fcc6d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a0d expref: 302 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.965460:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.965462:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065186.965464:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0d000, rc 0) 00000100:00100000:3.0:1746065186.965515:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+302:31774:x1830881263045632:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2114us (2662us total) trans 8589944187 rc 0/0 00000100:00100000:3.0:1746065186.965522:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9952 00000100:00100000:0.0:1746065186.968035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065186.968526:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263045760 00000100:00100000:3.0:1746065186.968533:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263045760 00000100:00100000:3.0:1746065186.968574:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 755 00000100:00100000:3.0:1746065186.968580:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+302:1959:x1830881263045760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065186.968591:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065186.968608:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d000/0x14b4f8542d4fcc6d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a0d expref: 302 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065186.968620:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065186.968623:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.968660:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+301:1959:x1830881263045760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065186.968666:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 755 00000100:00100000:2.0:1746065186.973067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.973171:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263046016 00000100:00100000:1.0:1746065186.973178:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263046016 00000100:00100000:1.0:1746065186.973252:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14532 00000100:00100000:1.0:1746065186.973260:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+17:31770:x1830881263046016:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065186.973275:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.973288:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a14 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.973310:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.973318:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 26 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.973325:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.973326:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.973329:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.973353:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 26 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.973362:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 26 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065186.973373:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260348032:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.973461:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.973469:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065186.973476:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260348160:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.974552:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.975246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.975292:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263045888 00000100:00100000:2.0:1746065186.975298:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263045888 00000100:00100000:1.0:1746065186.975314:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260348032:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.975322:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260348160:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.975344:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 18 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.975360:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003bc00, rc 0) 00000100:00100000:1.0:1746065186.975408:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:31770:x1830881263046016:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2149us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.975413:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14532 00000100:00100000:1.0:1746065186.975428:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14533 00000100:00100000:1.0:1746065186.975433:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31774:x1830881263045888:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065186.975441:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.975450:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a1b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.975464:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.975471:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.975476:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.975480:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.975481:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.975484:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1454080->1634303] (req 1454080->1634303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.975498:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.975506:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 19 pid: 8851 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065186.975515:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260348288:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.975599:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.975606:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 8 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065186.975613:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260348416:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.975631:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.975637:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 26 pid: 9716 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065186.975643:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260348544:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.975652:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.979458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.979479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.979507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.979521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065186.979538:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263046144 00000100:00100000:0.0:1746065186.979545:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263046144 00010000:00010000:0.0:1746065186.979572:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 9 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746065186.979591:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263046272 00000100:00100000:0.0:1746065186.979593:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263046272 00010000:00010000:0.0:1746065186.979602:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746065186.979613:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263046400 00000100:00100000:0.0:1746065186.979615:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263046400 00010000:00010000:0.0:1746065186.979623:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 20 pid: 8851 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746065186.979631:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263046528 00000100:00100000:0.0:1746065186.979632:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263046528 00010000:00010000:0.0:1746065186.979641:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 27 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746065186.979651:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7439 00000100:00100000:0.0:1746065186.979658:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263046144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065186.979668:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065186.979686:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 9 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065186.979694:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 9 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065186.979715:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065186.979748:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263046144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.979754:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7439 00000100:00100000:0.0:1746065186.979783:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7440 00000100:00100000:0.0:1746065186.979788:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263046272:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065186.979795:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065186.979806:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065186.979830:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065186.979843:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be8be00/0x14b4f8542d4fcbfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609dc expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065186.979856:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065186.979870:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263046272:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.979876:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7440 00000100:00100000:0.0:1746065186.979886:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7441 00000100:00100000:0.0:1746065186.979890:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1958:x1830881263046400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065186.979896:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065186.979903:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 20 pid: 8851 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065186.979910:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 20 pid: 8851 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065186.979926:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065186.979940:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1958:x1830881263046400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.979944:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7441 00000100:00100000:0.0:1746065186.979953:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7442 00010000:00010000:1.0:1746065186.979956:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be8ae00/0x14b4f8542d4fca36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608b6 expref: 19 pid: 8851 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746065186.979957:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263046528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065186.979962:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065186.979969:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 27 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065186.979970:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260348288:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065186.979976:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 27 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065186.979982:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe12e00/0x14b4f8542d4fcb6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60981 expref: 8 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065186.979985:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be8b600/0x14b4f8542d4fcc2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f1 expref: 27 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065186.979988:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260348416:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.979995:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260348544:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065186.979997:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065186.979998:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065186.980003:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065186.980010:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.980015:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1454080->1634303] (req 1454080->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.980023:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003a200, rc 0) 00010000:00010000:0.0:1746065186.980031:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065186.980039:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31774:x1830881263045888:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4607us (4796us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.980041:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260348672:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065186.980044:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14533 00000100:00100000:0.0:1746065186.980080:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065186.980254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.980546:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263046656 00000100:00100000:2.0:1746065186.980549:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263046656 00010000:00010000:2.0:1746065186.980566:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 26 pid: 9716 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065186.980688:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7443 00000100:00100000:2.0:1746065186.980694:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263046656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.980700:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.980709:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 26 pid: 9716 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.980718:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 26 pid: 9716 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.980729:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a211c00/0x14b4f8542d4fca1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6089a expref: 26 pid: 9716 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065186.980750:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.980752:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065186.980756:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.980781:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065186.980800:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065186.980811:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260348800:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065186.981015:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.983420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.983446:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260348672:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065186.983462:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.983489:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263046528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3531us (3966us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065186.983496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.983497:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7442 00000100:00100000:2.0:1746065186.983529:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260348800:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065186.983541:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065186.983569:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263046912 00000100:00100000:3.0:1746065186.983575:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263046912 00002000:00100000:3.0:1746065186.983606:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2617344->2621439) req@ffff880129b0f800 x1830881263046912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.983613:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f800 with x1830881263046912 ext(2617344->2621439) 00002000:00010000:3.0:1746065186.983617:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0f800 00000100:00100000:3.0:1746065186.983629:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047168 00000100:00100000:3.0:1746065186.983631:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047168 00002000:00100000:3.0:1746065186.983641:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1454080->1458175) req@ffff880129b0fb80 x1830881263047168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.983647:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0fb80 with x1830881263047168 ext(1454080->1458175) 00002000:00010000:3.0:1746065186.983649:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0fb80 00000100:00100000:3.0:1746065186.983673:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8177 00000100:00100000:3.0:1746065186.983679:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263046912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065186.983809:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263046912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 130us (396us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065186.983829:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8177 00002000:00100000:3.0:1746065186.983835:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2617344->2621439) req@ffff880129b0f800 x1830881263046912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.983841:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f800 with x1830881263046912 ext(2617344->2621439) 00002000:00010000:3.0:1746065186.983844:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0f800 00000100:00100000:3.0:1746065186.983853:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8178 00000100:00100000:3.0:1746065186.983858:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263047168:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065186.983914:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263047168:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 56us (418us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065186.983919:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8178 00002000:00100000:3.0:1746065186.983924:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1454080->1458175) req@ffff880129b0fb80 x1830881263047168/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065186.983930:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0fb80 with x1830881263047168 ext(1454080->1458175) 00002000:00010000:3.0:1746065186.983932:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0fb80 00000100:00100000:2.0:1746065186.984046:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263046656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3351us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.984052:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7443 00000100:00100000:0.0:1746065186.990552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.990802:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047424 00000100:00100000:2.0:1746065186.990809:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047424 00002000:00100000:2.0:1746065186.990858:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1630208->1634303) req@ffff880129b0ea00 x1830881263047424/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/0 e 0 to 0 dl 1746065197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.990868:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ea00 with x1830881263047424 ext(1630208->1634303) 00002000:00010000:2.0:1746065186.990872:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0ea00 00000100:00100000:2.0:1746065186.990903:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8179 00000100:00100000:2.0:1746065186.990911:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263047424:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065186.991152:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263047424:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 241us (607us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065186.991159:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8179 00002000:00100000:2.0:1746065186.991165:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1630208->1634303) req@ffff880129b0ea00 x1830881263047424/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:102/0 lens 488/4536 e 0 to 0 dl 1746065197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065186.991171:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ea00 with x1830881263047424 ext(1630208->1634303) 00002000:00010000:2.0:1746065186.991174:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0ea00 00000100:00100000:0.0:1746065186.994751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.994855:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047552 00000100:00100000:1.0:1746065186.994866:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047552 00000100:00100000:1.0:1746065186.994907:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14534 00000100:00100000:1.0:1746065186.994914:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:31770:x1830881263047552:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065186.994928:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065186.994941:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a22 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.994964:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.994972:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 7 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.994986:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.994992:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.994994:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065186.994997:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->2166783] (req 2097152->2166783) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.995026:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.995036:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065186.995047:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260348928:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.995129:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 7 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065186.995137:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 7 pid: 4544 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065186.995144:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260349056:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.995162:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.995174:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065186.995180:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260349184:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.995190:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065186.997965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065186.998030:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260348928:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.998039:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260349056:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065186.998046:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260349184:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065186.998070:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->2166783] (req 2097152->2166783) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065186.998083:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003be00, rc 0) 00000100:00100000:1.0:1746065186.998124:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:31770:x1830881263047552:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3209us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065186.998130:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14534 00000100:00100000:2.0:1746065186.998209:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047680 00000100:00100000:2.0:1746065186.998215:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047680 00010000:00010000:2.0:1746065186.998239:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 8 pid: 4544 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065186.998533:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7444 00000100:00100000:2.0:1746065186.998542:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263047680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065186.998551:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065186.998574:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 8 pid: 4544 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065186.998583:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 8 pid: 4544 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065186.998600:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094896200/0x14b4f8542d4fcb7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60996 expref: 8 pid: 4544 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065186.998628:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065186.998659:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263047680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 119us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065186.998665:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7444 00000100:00100000:0.0:1746065186.999530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065186.999730:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263047936 00000100:00100000:2.0:1746065186.999735:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263047936 00000100:00100000:2.0:1746065186.999778:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4253 00000100:00100000:2.0:1746065186.999785:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+301:31774:x1830881263047936:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065186.999955:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+302:31774:x1830881263047936:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 170us (426us total) trans 8589944188 rc 0/0 00000100:00100000:2.0:1746065186.999961:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4253 00000100:00100000:0.0:1746065187.000125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.000737:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048064 00000100:00100000:2.0:1746065187.000741:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048064 00010000:00010000:2.0:1746065187.000758:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.000836:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7445 00000100:00100000:2.0:1746065187.000846:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263048064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.000854:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.000868:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.000876:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.000896:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012daa3200/0x14b4f8542d4fcb08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60934 expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.000907:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.001613:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263048064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 765us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.001619:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7445 00000100:00100000:1.0:1746065187.002014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.002057:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048192 00000100:00100000:0.0:1746065187.002060:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048192 00010000:00010000:0.0:1746065187.002083:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746065187.002103:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7446 00000100:00100000:0.0:1746065187.002109:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881263048192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065187.002116:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065187.002126:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00000100:00080000:1.0:1746065187.002604:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746065187.002726:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.002742:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c67200/0x14b4f8542d4fcb1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60949 expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.002763:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.002765:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.002780:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.002787:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.002849:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065187.002862:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260349312:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065187.002918:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d20c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065187.004210:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065187.008504:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260349312:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065187.008524:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065187.008536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.008690:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048448 00000100:00100000:3.0:1746065187.008696:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048448 00002000:00100000:3.0:1746065187.008730:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2162688->2166783) req@ffff88012d7fca80 x1830881263048448/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.008740:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fca80 with x1830881263048448 ext(2162688->2166783) 00002000:00010000:3.0:1746065187.008744:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fca80 00000100:00100000:2.0:1746065187.008806:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881263048192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6694us (6789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.008836:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7446 00000100:00100000:1.0:1746065187.009044:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8180 00000100:00100000:1.0:1746065187.009053:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263048448:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065187.009167:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263048448:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 115us (631us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065187.009172:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8180 00002000:00100000:1.0:1746065187.009177:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2162688->2166783) req@ffff88012d7fca80 x1830881263048448/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.009184:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fca80 with x1830881263048448 ext(2162688->2166783) 00002000:00010000:1.0:1746065187.009186:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fca80 00000100:00100000:0.0:1746065187.023148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.023308:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048704 00000100:00100000:3.0:1746065187.023316:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048704 00000100:00100000:3.0:1746065187.023871:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9953 00000100:00100000:3.0:1746065187.023880:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+302:31779:x1830881263048704:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065187.023898:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.023911:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c400/0x14b4f8542d4fcc90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a29 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.024004:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024014:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024023:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024033:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024042:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024047:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024126:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d600/0x14b4f8542d4fcca5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024134:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d600/0x14b4f8542d4fcca5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024140:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d600/0x14b4f8542d4fcca5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065187.024147:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000100:00080000:1.0:1746065187.024261:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746065187.024339:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024343:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024347:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024350:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f0da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065187.024352:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024355:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024362:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065187.024364:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065187.024366:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.024369:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0da00/0x14b4f8542d4fcc97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.025022:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.025029:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.025033:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.025037:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f0c200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065187.025040:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.025045:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.025052:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205400) 00010000:00010000:3.0:1746065187.025054:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065187.025056:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.025059:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c200/0x14b4f8542d4fcc9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.025148:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0c400/0x14b4f8542d4fcc90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a29 expref: 305 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.025167:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d600/0x14b4f8542d4fcca5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a29 expref: 304 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.025173:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.025175:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065187.025177:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0d600, rc 0) 00000100:00100000:3.0:1746065187.025234:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+304:31779:x1830881263048704:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1355us (2091us total) trans 8589944189 rc 0/0 00000100:00100000:3.0:1746065187.025243:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9953 00000100:00100000:2.0:1746065187.028041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.028076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.028088:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048832 00000100:00100000:0.0:1746065187.028096:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048832 00000100:00100000:0.0:1746065187.028136:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 756 00000100:00100000:0.0:1746065187.028143:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+304:1960:x1830881263048832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065187.028154:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065187.028172:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0d600/0x14b4f8542d4fcca5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a29 expref: 304 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.028188:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065187.028191:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065187.028220:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+303:1960:x1830881263048832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.028225:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 756 00000100:00100000:2.0:1746065187.028475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.028741:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263048960 00000100:00100000:1.0:1746065187.028745:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263048960 00000100:00100000:1.0:1746065187.028765:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049088 00000100:00100000:1.0:1746065187.028776:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049088 00000100:00100000:1.0:1746065187.028790:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14535 00000100:00100000:1.0:1746065187.028795:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263048960:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.028807:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.028846:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a003ac00/0x14b4f8542d4fccb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a30 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.028886:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260349440:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065187.028978:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14536 00000100:00100000:2.0:1746065187.028985:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263049088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.028996:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.029005:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129b54e00/0x14b4f8542d4fccba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a37 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.029031:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260349568:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065187.029094:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.029095:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.030197:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260349440:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065187.030216:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a003ac00/0x14b4f8542d4fccb3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a30 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065187.030223:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260349568:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065187.030225:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a003ac00/0x14b4f8542d4fccb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a30 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.030239:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129b54e00/0x14b4f8542d4fccba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a37 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.030248:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129b54e00/0x14b4f8542d4fccba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a37 expref: 25 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.030248:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003ac00, rc 0) 00010000:00010000:2.0:1746065187.030259:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54e00, rc 0) 00000100:00100000:2.0:1746065187.030351:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263049088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1366us (1874us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065187.030356:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14536 00000100:00100000:1.0:1746065187.030360:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263048960:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1563us (2282us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065187.030366:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14535 00000100:00100000:0.0:1746065187.037351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.037407:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049344 00000100:00100000:1.0:1746065187.037415:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049344 00002000:00100000:1.0:1746065187.037451:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012d7fdf80 x1830881263049344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 504/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.037461:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fdf80 with x1830881263049344 ext(1048576->2097151) 00002000:00010000:1.0:1746065187.037465:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fdf80 00000100:00100000:1.0:1746065187.037493:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8181 00000100:00100000:1.0:1746065187.037499:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263049344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065187.046139:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263049344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8631us (8787us total) trans 0 rc 868352/868352 00000100:00100000:1.0:1746065187.046150:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8181 00002000:00100000:1.0:1746065187.046160:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012d7fdf80 x1830881263049344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 504/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.046169:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fdf80 with x1830881263049344 ext(1048576->2097151) 00002000:00010000:1.0:1746065187.046174:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fdf80 00000100:00100000:0.0:1746065187.046716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.046761:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049472 00000100:00100000:1.0:1746065187.046778:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049472 00000100:00100000:1.0:1746065187.046846:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14537 00000100:00100000:1.0:1746065187.046852:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263049472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.046863:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.046875:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fccc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a3e expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.046981:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260349696:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065187.047031:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00002000:00010000:1.0:1746065187.048851:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime: 1746065186 -> 1746065187 00000100:00100000:1.0:1746065187.048871:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260349696:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065187.048895:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fccc1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a3e expref: 20 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.048905:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fccc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a3e expref: 20 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.048921:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003a600, rc 0) 00000100:00100000:1.0:1746065187.048958:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263049472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2106us (2243us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065187.048965:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14537 00000100:00100000:0.0:1746065187.053269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.053317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.053392:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049600 00000100:00100000:1.0:1746065187.053400:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049600 00000100:00100000:1.0:1746065187.053442:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049728 00000100:00100000:1.0:1746065187.053445:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049728 00000100:00100000:1.0:1746065187.053459:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14538 00000100:00100000:1.0:1746065187.053464:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263049600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.053482:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065187.053487:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14539 00000100:00100000:2.0:1746065187.053496:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263049728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.053497:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a003ac00/0x14b4f8542d4fccc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a45 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.053503:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.053516:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fcccf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a4c expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.053540:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260349824:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065187.053542:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260349952:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065187.053783:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.053866:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.055329:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260349952:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065187.055354:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fcccf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a4c expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.055365:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129b55e00/0x14b4f8542d4fcccf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a4c expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.055394:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b55e00, rc 0) 00000100:00100000:2.0:1746065187.055606:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263049728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2110us (2286us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065187.055613:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14539 00000100:00100000:1.0:1746065187.056161:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260349824:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065187.056178:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a003ac00/0x14b4f8542d4fccc8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a45 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.056187:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a003ac00/0x14b4f8542d4fccc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a45 expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.056197:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003ac00, rc 0) 00000100:00100000:1.0:1746065187.056215:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263049600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2751us (2957us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065187.056220:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14538 00000100:00100000:0.0:1746065187.056573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.056638:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049856 00000100:00100000:1.0:1746065187.056643:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049856 00000100:00100000:1.0:1746065187.056679:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14540 00000100:00100000:1.0:1746065187.056686:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:31782:x1830881263049856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.056700:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.056711:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a53 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.056756:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.056763:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.056765:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.056779:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.056807:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.056991:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.057005:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260350080:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065187.057106:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.058558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.058599:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263049984 00000100:00100000:3.0:1746065187.058605:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263049984 00000100:00100000:3.0:1746065187.058635:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14541 00000100:00100000:3.0:1746065187.058641:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31779:x1830881263049984:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065187.058652:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.058665:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a5a expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.058683:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.058689:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065187.058691:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065187.058693:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.058713:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.058722:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 16 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.058731:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260350208:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.058789:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.058830:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260350080:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.058849:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.058859:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003b800, rc 0) 00000100:00100000:2.0:1746065187.058883:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:31782:x1830881263049856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2197us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.058883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.058889:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14540 00000100:00100000:1.0:1746065187.058899:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263050112 00000100:00100000:1.0:1746065187.058902:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263050112 00002000:00100000:1.0:1746065187.058986:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1454080->1634303) req@ffff88009ba3ea00 x1830881263050112/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.058996:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ea00 with x1830881263050112 ext(1454080->1634303) 00010000:00010000:1.0:1746065187.059002:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.059010:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:1.0:1746065187.059015:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba3ea00 00000100:00100000:1.0:1746065187.059037:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2498 00000100:00100000:1.0:1746065187.059042:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263050112:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065187.060444:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260350208:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.060462:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.060472:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0dc00, rc 0) 00000100:00100000:3.0:1746065187.060493:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31779:x1830881263049984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1852us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.060498:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14541 00000100:00100000:1.0:1746065187.061405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.061808:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263050240 00000100:00100000:3.0:1746065187.061824:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263050240 00002000:00100000:3.0:1746065187.061856:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2617344->3145727) req@ffff88009ba3d880 x1830881263050240/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.061861:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d880 with x1830881263050240 ext(2617344->3145727) 00010000:00010000:3.0:1746065187.061866:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 17 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.061873:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 17 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065187.061880:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3d880 00000100:00100000:3.0:1746065187.061897:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2499 00000100:00100000:3.0:1746065187.061902:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263050240:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065187.061955:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263050112:12345-192.168.202.46@tcp:4:cat.0 Request processed in 2912us (3071us total) trans 17179873596 rc 0/0 00000100:00100000:2.0:1746065187.061962:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2498 00002000:00100000:2.0:1746065187.061967:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1454080->1634303) req@ffff88009ba3ea00 x1830881263050112/t17179873596(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/448 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.061974:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3ea00 with x1830881263050112 ext(1454080->1634303) 00010000:00010000:2.0:1746065187.061979:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 26 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.061986:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 26 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.061995:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba3ea00 00000100:00080000:1.0:1746065187.062153:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065187.064681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.064794:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263050368 00000100:00100000:2.0:1746065187.064802:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263050368 00010000:00010000:2.0:1746065187.064857:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 26 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.064896:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7447 00000100:00100000:2.0:1746065187.064902:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263050368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.064912:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065187.064926:0:7079:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065187 -> 1746065188 00010000:00010000:2.0:1746065187.064931:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 26 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.064940:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 26 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.064957:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fcc82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1634303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a1b expref: 26 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.064981:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.064982:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.064988:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.064994:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.065026:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.065037:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260350336:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065187.065107:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.067842:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260350336:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065187.067859:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.067891:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881263050368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2988us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.067899:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7447 00000100:00100000:3.0:1746065187.068899:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263050240:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6994us (7493us total) trans 21474840869 rc 0/0 00000100:00100000:3.0:1746065187.068908:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2499 00002000:00100000:3.0:1746065187.068917:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2617344->3145727) req@ffff88009ba3d880 x1830881263050240/t21474840869(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/448 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.068925:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d880 with x1830881263050240 ext(2617344->3145727) 00010000:00010000:3.0:1746065187.068934:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 19 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.068946:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 19 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065187.068952:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3d880 00000100:00100000:0.0:1746065187.071437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.071581:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263050624 00000100:00100000:3.0:1746065187.071589:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263050624 00002000:00100000:3.0:1746065187.071622:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012b45c700 x1830881263050624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.071632:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c700 with x1830881263050624 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.071636:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45c700 00000100:00100000:3.0:1746065187.071651:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8182 00000100:00100000:3.0:1746065187.071659:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263050624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.072305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.072445:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263050752 00000100:00100000:2.0:1746065187.072449:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263050752 00010000:00010000:2.0:1746065187.072467:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 19 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.072485:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7448 00000100:00100000:2.0:1746065187.072490:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263050752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.072497:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.072511:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 19 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.072520:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 19 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.072542:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a003bc00/0x14b4f8542d4fcc7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a14 expref: 19 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.072568:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.072570:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.072577:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.072584:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.072609:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.072619:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260350464:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065187.072676:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.076334:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260350464:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065187.076355:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.076510:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263050752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4018us (4204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.076520:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7448 00000100:00100000:3.0:1746065187.077750:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263050624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6088us (6317us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.077758:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8182 00002000:00100000:3.0:1746065187.077779:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012b45c700 x1830881263050624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.077788:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c700 with x1830881263050624 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.077793:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45c700 00000100:00100000:0.0:1746065187.078114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.078224:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263051008 00000100:00100000:3.0:1746065187.078231:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263051008 00002000:00100000:3.0:1746065187.078255:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012b45ed80 x1830881263051008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.078262:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ed80 with x1830881263051008 ext(2097152->3145727) 00002000:00010000:3.0:1746065187.078265:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ed80 00000100:00100000:3.0:1746065187.078811:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8183 00000100:00100000:3.0:1746065187.078847:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263051008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.081867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.082042:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263051136 00000100:00100000:3.0:1746065187.082049:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263051136 00000100:00100000:2.0:1746065187.082717:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14542 00000100:00100000:2.0:1746065187.082727:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:31782:x1830881263051136:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.082742:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.082757:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a61 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.082786:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.082788:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.082795:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.082807:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 19 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.082842:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54600, rc 0) 00000100:00100000:2.0:1746065187.082878:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:31782:x1830881263051136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 153us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.082883:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14542 00000100:00100000:3.0:1746065187.088057:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263051008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9205us (9935us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.088068:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8183 00002000:00100000:3.0:1746065187.088077:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012b45ed80 x1830881263051008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.088086:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ed80 with x1830881263051008 ext(2097152->3145727) 00002000:00010000:3.0:1746065187.088091:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ed80 00000100:00100000:0.0:1746065187.092669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.092709:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.092737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.092889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.093209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.093251:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263051648 00000100:00100000:3.0:1746065187.093259:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263051648 00000100:00100000:3.0:1746065187.093273:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263051520 00000100:00100000:3.0:1746065187.093275:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263051520 00000100:00100000:2.0:1746065187.093351:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263051904 00000100:00100000:2.0:1746065187.093354:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263051904 00002000:00100000:3.0:1746065187.093392:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2166784->3215359) req@ffff88012b45d880 x1830881263051520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.093402:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881263051520 ext(2166784->3215359) 00002000:00010000:3.0:1746065187.093406:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45d880 00002000:00100000:2.0:1746065187.093471:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012b45dc00 x1830881263051904/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.093478:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45dc00 with x1830881263051904 ext(2097152->3145727) 00002000:00010000:2.0:1746065187.093481:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45dc00 00000100:00100000:2.0:1746065187.093496:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263052032 00000100:00100000:2.0:1746065187.093498:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263052032 00002000:00100000:2.0:1746065187.093508:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012b45e680 x1830881263052032/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.093513:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e680 with x1830881263052032 ext(3145728->4194303) 00002000:00010000:2.0:1746065187.093515:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45e680 00000100:00100000:2.0:1746065187.093538:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8184 00000100:00100000:2.0:1746065187.093545:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263051904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.093706:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8185 00000100:00100000:0.0:1746065187.093718:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263052032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065187.093775:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8186 00000100:00100000:3.0:1746065187.093781:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263051520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065187.094144:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263052288 00000100:00100000:1.0:1746065187.094147:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263052288 00000100:00100000:1.0:1746065187.094171:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14543 00000100:00100000:1.0:1746065187.094176:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31779:x1830881263052288:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.094183:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.094195:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a68 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.094215:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.094221:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.094222:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.094225:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.094247:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.094256:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 21 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.094266:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260350592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.094326:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00002000:00100000:3.0:1746065187.094387:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3215360->4194303) req@ffff88012b45d180 x1830881263051648/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.094393:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d180 with x1830881263051648 ext(3215360->4194303) 00010000:00010000:3.0:1746065187.094398:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 21 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.094408:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 21 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065187.094413:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b45d180 00000100:00100000:3.0:1746065187.094424:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2500 00000100:00100000:3.0:1746065187.094428:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263051648:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065187.097888:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260350592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065187.097917:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.097937:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f7c00, rc 0) 00000100:00100000:1.0:1746065187.097968:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31779:x1830881263052288:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3790us (4758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.097975:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14543 00000100:00100000:0.0:1746065187.098811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.098944:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263052416 00000100:00100000:2.0:1746065187.098951:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263052416 00002000:00100000:2.0:1746065187.098981:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2166783) req@ffff88008f49c000 x1830881263052416/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.098990:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49c000 with x1830881263052416 ext(2097152->2166783) 00010000:00010000:2.0:1746065187.098997:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.099009:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.099015:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f49c000 00000100:00100000:2.0:1746065187.099045:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2501 00000100:00100000:2.0:1746065187.099053:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263052416:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065187.108312:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263051904:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14758us (15565us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.108327:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8184 00002000:00100000:3.0:1746065187.108337:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012b45dc00 x1830881263051904/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.108346:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45dc00 with x1830881263051904 ext(2097152->3145727) 00002000:00010000:3.0:1746065187.108350:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45dc00 00000100:00100000:2.0:1746065187.108737:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263052416:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9684us (9928us total) trans 17179873597 rc 0/0 00000100:00100000:2.0:1746065187.108743:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2501 00002000:00100000:2.0:1746065187.108747:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2166783) req@ffff88008f49c000 x1830881263052416/t17179873597(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/448 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.108754:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49c000 with x1830881263052416 ext(2097152->2166783) 00010000:00010000:2.0:1746065187.108759:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 26 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.108788:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 26 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.108794:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f49c000 00000100:00100000:1.0:1746065187.114789:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263052032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21052us (21877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065187.114800:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8185 00002000:00100000:1.0:1746065187.114811:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012b45e680 x1830881263052032/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.114846:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e680 with x1830881263052032 ext(3145728->4194303) 00002000:00010000:1.0:1746065187.114850:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45e680 00000100:00100000:0.0:1746065187.115970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.116016:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263052544 00000100:00100000:1.0:1746065187.116023:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263052544 00000100:00100000:1.0:1746065187.116282:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14544 00000100:00100000:1.0:1746065187.116290:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:31782:x1830881263052544:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.116304:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.116319:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a6f expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.116340:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.116344:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.116353:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.116362:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982e3000, rc 0) 00000100:00100000:1.0:1746065187.116399:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+27:31782:x1830881263052544:12345-192.168.202.46@tcp:101:cat.0 Request processed in 110us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.116404:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14544 00000100:00100000:3.0:1746065187.117716:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263051520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23932us (25003us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.117724:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8186 00002000:00100000:3.0:1746065187.117731:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2166784->3215359) req@ffff88012b45d880 x1830881263051520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.117738:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881263051520 ext(2166784->3215359) 00010000:00010000:3.0:1746065187.117745:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.117756:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065187.117762:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b45d880 00000100:00100000:3.0:1746065187.119210:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263051648:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24775us (26543us total) trans 0 rc 978944/978944 00000100:00100000:3.0:1746065187.119218:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2500 00002000:00100000:3.0:1746065187.119224:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3215360->4194303) req@ffff88012b45d180 x1830881263051648/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.119239:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d180 with x1830881263051648 ext(3215360->4194303) 00010000:00010000:3.0:1746065187.119246:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.119257:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065187.119263:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b45d180 00000100:00100000:0.0:1746065187.123675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.124439:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263052672 00000100:00100000:2.0:1746065187.124450:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263052672 00010000:00010000:2.0:1746065187.124486:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.124536:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7449 00000100:00100000:2.0:1746065187.124545:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263052672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.124559:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.124583:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.124595:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.124616:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003be00/0x14b4f8542d4fcc89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a22 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.124649:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.124652:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.124659:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.124671:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.124680:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.124681:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.124685:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.124691:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.124724:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.124737:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260350720:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065187.125641:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.125652:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260350848:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065187.125684:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.127640:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260350720:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065187.127655:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260350848:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065187.127675:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.127729:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263052672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3182us (4057us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.127740:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7449 00000100:00100000:0.0:1746065187.131788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.131874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.131964:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263052928 00000100:00100000:3.0:1746065187.131971:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263052928 00002000:00100000:3.0:1746065187.132010:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008f49d880 x1830881263052928/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.132019:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d880 with x1830881263052928 ext(2097152->3145727) 00002000:00010000:3.0:1746065187.132023:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49d880 00000100:00100000:3.0:1746065187.132034:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263053184 00000100:00100000:3.0:1746065187.132036:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263053184 00000100:00100000:1.0:1746065187.132179:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8187 00000100:00100000:1.0:1746065187.132192:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263052928:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065187.132199:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008f49c380 x1830881263053184/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.132207:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49c380 with x1830881263053184 ext(3145728->4194303) 00002000:00010000:3.0:1746065187.132211:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49c380 00000100:00100000:3.0:1746065187.132225:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8188 00000100:00100000:3.0:1746065187.132230:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263053184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.132591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.132606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.132618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.132659:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263053440 00000100:00100000:3.0:1746065187.132662:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263053440 00002000:00100000:3.0:1746065187.132678:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd07800 x1830881263053440/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.132685:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07800 with x1830881263053440 ext(2097152->3145727) 00002000:00010000:3.0:1746065187.132688:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd07800 00000100:00100000:3.0:1746065187.132698:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263053696 00000100:00100000:3.0:1746065187.132700:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263053696 00002000:00100000:3.0:1746065187.132708:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fd05f80 x1830881263053696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.132714:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05f80 with x1830881263053696 ext(3145728->4194303) 00002000:00010000:3.0:1746065187.132716:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05f80 00000100:00100000:3.0:1746065187.132725:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263053952 00000100:00100000:3.0:1746065187.132726:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263053952 00002000:00100000:3.0:1746065187.132735:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd05880 x1830881263053952/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.132740:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05880 with x1830881263053952 ext(3145728->4194303) 00002000:00010000:3.0:1746065187.132742:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05880 00000100:00100000:3.0:1746065187.132750:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8189 00000100:00100000:3.0:1746065187.132754:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263053440:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065187.132884:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8190 00000100:00100000:2.0:1746065187.132892:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263053696:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065187.132994:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8191 00000100:00100000:3.0:1746065187.132999:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263053952:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065187.144255:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881263052928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12059us (12478us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065187.144265:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8187 00002000:00100000:1.0:1746065187.144276:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008f49d880 x1830881263052928/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.144284:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49d880 with x1830881263052928 ext(2097152->3145727) 00002000:00010000:1.0:1746065187.144289:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49d880 00000100:00100000:3.0:1746065187.145168:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263053696:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12274us (12557us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.145175:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8190 00002000:00100000:3.0:1746065187.145180:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fd05f80 x1830881263053696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.145188:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05f80 with x1830881263053696 ext(3145728->4194303) 00002000:00010000:3.0:1746065187.145191:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05f80 00000100:00100000:2.0:1746065187.151064:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263053440:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18298us (18462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065187.151076:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8189 00002000:00100000:2.0:1746065187.151086:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd07800 x1830881263053440/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.151095:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07800 with x1830881263053440 ext(2097152->3145727) 00002000:00010000:2.0:1746065187.151100:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd07800 00000100:00100000:3.0:1746065187.156118:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263053952:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23111us (23491us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.156128:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8191 00002000:00100000:3.0:1746065187.156138:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd05880 x1830881263053952/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.156147:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05880 with x1830881263053952 ext(3145728->4194303) 00002000:00010000:3.0:1746065187.156186:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05880 00000100:00100000:2.0:1746065187.161447:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f49c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263053184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29208us (29564us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065187.161459:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8188 00002000:00100000:2.0:1746065187.161471:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008f49c380 x1830881263053184/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.161481:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f49c380 with x1830881263053184 ext(3145728->4194303) 00002000:00010000:2.0:1746065187.161486:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f49c380 00000100:00100000:0.0:1746065187.161998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.162036:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263054080 00000100:00100000:1.0:1746065187.162043:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263054080 00000100:00100000:1.0:1746065187.162083:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14545 00000100:00100000:1.0:1746065187.162089:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263054080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.162102:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.162115:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a76 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.162135:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.162137:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.162145:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.162157:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.162167:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009534ea00, rc 0) 00000100:00100000:1.0:1746065187.162192:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263054080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 104us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.162197:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14545 00000100:00100000:0.0:1746065187.168390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.168573:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263054336 00000100:00100000:2.0:1746065187.168581:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263054336 00002000:00100000:2.0:1746065187.168619:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd05c00 x1830881263054336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.168628:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05c00 with x1830881263054336 ext(4194304->5013503) 00002000:00010000:2.0:1746065187.168632:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05c00 00000100:00100000:2.0:1746065187.168663:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8192 00000100:00100000:2.0:1746065187.168670:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263054336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.169896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.169957:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263054592 00000100:00100000:2.0:1746065187.169963:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263054592 00002000:00100000:2.0:1746065187.169988:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd06680 x1830881263054592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.169997:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06680 with x1830881263054592 ext(4194304->5013503) 00002000:00010000:2.0:1746065187.170002:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd06680 00000100:00100000:2.0:1746065187.170030:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8193 00000100:00100000:2.0:1746065187.170038:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263054592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065187.179488:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263054336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10808us (11094us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065187.179499:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8192 00002000:00100000:3.0:1746065187.179509:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd05c00 x1830881263054336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.179518:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05c00 with x1830881263054336 ext(4194304->5013503) 00002000:00010000:3.0:1746065187.179523:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05c00 00000100:00100000:2.0:1746065187.180495:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263054592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10455us (10603us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065187.180503:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8193 00002000:00100000:2.0:1746065187.180508:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd06680 x1830881263054592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.180517:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06680 with x1830881263054592 ext(4194304->5013503) 00002000:00010000:2.0:1746065187.180521:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd06680 00000100:00100000:0.0:1746065187.185598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.187051:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263054848 00000100:00100000:2.0:1746065187.187062:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263054848 00000100:00100000:2.0:1746065187.187122:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4254 00000100:00100000:2.0:1746065187.187131:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+303:31779:x1830881263054848:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065187.187331:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+304:31779:x1830881263054848:12345-192.168.202.46@tcp:35:cat.0 Request processed in 201us (1742us total) trans 8589944190 rc 0/0 00000100:00100000:2.0:1746065187.187337:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4254 00000100:00100000:0.0:1746065187.225161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.225232:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263055104 00000100:00100000:3.0:1746065187.225240:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263055104 00000100:00100000:3.0:1746065187.225294:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9954 00000100:00100000:3.0:1746065187.225301:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+304:31786:x1830881263055104:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065187.225326:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.225340:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fcd00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a7d expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.225435:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225448:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225457:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225468:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225473:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225478:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225571:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225579:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225584:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065187.225591:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065187.225663:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225669:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225677:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225681:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8d5000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065187.225684:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225691:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225700:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065187.225702:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065187.225706:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225710:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5000/0x14b4f8542d4fcd07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225736:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225741:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225746:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225750:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b8d5200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065187.225752:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225757:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225775:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:3.0:1746065187.225777:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065187.225779:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225784:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8d5200/0x14b4f8542d4fcd0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.225836:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fcd00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a7d expref: 307 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.225848:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a7d expref: 306 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.225853:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.225855:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065187.225857:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8800, rc 0) 00000100:00100000:3.0:1746065187.225902:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+306:31786:x1830881263055104:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 602us (751us total) trans 8589944191 rc 0/0 00000100:00100000:3.0:1746065187.225908:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9954 00000100:00100000:0.0:1746065187.232218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.232280:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263055232 00000100:00100000:2.0:1746065187.232288:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263055232 00000100:00100000:2.0:1746065187.232342:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 757 00000100:00100000:2.0:1746065187.232350:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+306:1960:x1830881263055232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.232362:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.232383:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd15 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a7d expref: 306 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.232411:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.232415:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.232450:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+305:1960:x1830881263055232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 101us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.232456:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 757 00000100:00100000:0.0:1746065187.240317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.241006:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263055360 00000100:00100000:1.0:1746065187.241015:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263055360 00000100:00100000:3.0:1746065187.242153:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14546 00000100:00100000:3.0:1746065187.242166:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:31788:x1830881263055360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065187.242183:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.242203:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a84 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.242229:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.242237:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 6 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.242243:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.242250:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.242251:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.242254:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1851392->2097151] (req 1851392->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.242279:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.242289:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 23 pid: 8851 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746065187.242298:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260350976:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.242412:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 6 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.242419:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 6 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746065187.242427:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260351104:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.242463:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.242471:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 26 pid: 9716 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.242478:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260351232:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.242493:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065187.245292:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260350976:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.245303:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260351104:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.245310:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260351232:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.245339:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1851392->2097151] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.245352:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8800, rc 0) 00000100:00100000:3.0:1746065187.245401:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:31788:x1830881263055360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3238us (5095us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.245408:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14546 00000100:00100000:0.0:1746065187.246086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.246168:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263055488 00000100:00100000:2.0:1746065187.246174:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263055488 00010000:00010000:2.0:1746065187.246199:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 7 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.246675:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7450 00000100:00100000:2.0:1746065187.246683:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263055488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.246695:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.246714:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 7 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.246723:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 7 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.246745:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcb63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6097a expref: 7 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746065187.246951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.246964:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263055616 00000100:00100000:0.0:1746065187.246967:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263055616 00010000:00010000:0.0:1746065187.246979:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 23 pid: 8851 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746065187.246993:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7451 00000100:00100000:0.0:1746065187.246997:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263055616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065187.247003:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065187.247010:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 23 pid: 8851 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.247017:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 23 pid: 8851 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.247029:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fca21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e608a1 expref: 23 pid: 8851 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.247052:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065187.247079:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263055616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.247085:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7451 00010000:00010000:2.0:1746065187.247197:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.247219:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263055488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 537us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.247224:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7450 00000100:00100000:0.0:1746065187.247888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.249139:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263055744 00000100:00100000:3.0:1746065187.249148:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263055744 00010000:00010000:3.0:1746065187.249172:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 27 pid: 9716 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.249207:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7452 00000100:00100000:3.0:1746065187.249213:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263055744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.249224:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.249238:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 27 pid: 9716 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.249248:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 27 pid: 9716 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.249263:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fca13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60893 expref: 27 pid: 9716 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.249279:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.249280:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.249286:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.249294:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.249322:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065187.249333:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260351360:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065187.249388:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065187.251224:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260351360:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065187.251225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065187.251238:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.251277:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263055744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2064us (3388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.251286:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7452 00000100:00100000:2.0:1746065187.251356:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263056000 00000100:00100000:2.0:1746065187.251360:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263056000 00002000:00100000:2.0:1746065187.251391:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1851392->1855487) req@ffff88008fd04380 x1830881263056000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.251400:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04380 with x1830881263056000 ext(1851392->1855487) 00002000:00010000:2.0:1746065187.251403:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04380 00000100:00100000:2.0:1746065187.251429:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8194 00000100:00100000:2.0:1746065187.251435:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263056000:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065187.251572:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263056000:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 136us (351us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065187.251578:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8194 00002000:00100000:2.0:1746065187.251582:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1851392->1855487) req@ffff88008fd04380 x1830881263056000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.251589:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04380 with x1830881263056000 ext(1851392->1855487) 00002000:00010000:2.0:1746065187.251592:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04380 00000100:00100000:0.0:1746065187.255367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.255602:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263056128 00000100:00100000:3.0:1746065187.255611:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263056128 00000100:00100000:3.0:1746065187.255659:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14547 00000100:00100000:3.0:1746065187.255666:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:31788:x1830881263056128:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065187.255682:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.255695:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a8b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.255720:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.255729:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.255735:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.255736:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.255739:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.255763:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 25 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.255786:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 25 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746065187.255796:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260351488:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.255917:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.255925:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.255932:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260351616:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.255956:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.264034:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.264168:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263056256 00000100:00100000:2.0:1746065187.264176:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263056256 00010000:00010000:2.0:1746065187.264207:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 26 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.264232:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7453 00000100:00100000:2.0:1746065187.264240:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263056256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.264250:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.264267:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 26 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.264277:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 26 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.264298:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.264343:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263056256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.264349:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7453 00010000:00010000:3.0:1746065187.264503:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009534ea00/0x14b4f8542d4fccf9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a76 expref: 25 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746065187.264520:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260351488:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.264528:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260351616:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.264547:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.264557:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc000, rc 0) 00000100:00100000:3.0:1746065187.264576:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:31788:x1830881263056128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8910us (9216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.264582:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14547 00000100:00100000:0.0:1746065187.267125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.267408:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263056384 00000100:00100000:1.0:1746065187.267415:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263056384 00010000:00010000:1.0:1746065187.267442:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.268113:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7454 00000100:00100000:1.0:1746065187.268124:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263056384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.268137:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.268155:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.268171:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.268188:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003b800/0x14b4f8542d4fccd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a53 expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.268211:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.268213:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.268218:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.268226:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.268251:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.268261:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260351744:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065187.268318:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.270448:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260351744:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065187.270462:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.270493:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1959:x1830881263056384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2371us (3375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.270504:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7454 00000100:00100000:0.0:1746065187.272105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.272188:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263056640 00000100:00100000:3.0:1746065187.272194:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263056640 00002000:00100000:3.0:1746065187.272228:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1150976->1155071) req@ffff8800a4e98700 x1830881263056640/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.272236:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e98700 with x1830881263056640 ext(1150976->1155071) 00002000:00010000:3.0:1746065187.272241:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e98700 00000100:00100000:3.0:1746065187.272267:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8195 00000100:00100000:3.0:1746065187.272274:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263056640:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065187.272407:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263056640:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 133us (305us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065187.272413:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8195 00002000:00100000:3.0:1746065187.272418:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1150976->1155071) req@ffff8800a4e98700 x1830881263056640/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.272424:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e98700 with x1830881263056640 ext(1150976->1155071) 00002000:00010000:3.0:1746065187.272427:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e98700 00000100:00100000:0.0:1746065187.316161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.316804:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263056896 00000100:00100000:2.0:1746065187.316978:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263056896 00000100:00100000:2.0:1746065187.317055:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9955 00000100:00100000:2.0:1746065187.317065:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+305:31793:x1830881263056896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.317090:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.317108:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcd31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a92 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.317212:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317229:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317239:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317255:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317261:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317266:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317374:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55e00/0x14b4f8542d4fcd46 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317385:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55e00/0x14b4f8542d4fcd46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317391:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55e00/0x14b4f8542d4fcd46 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065187.317400:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065187.317487:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317495:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317500:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317508:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b54c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065187.317512:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317517:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317528:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065187.317531:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065187.317535:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317539:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54c00/0x14b4f8542d4fcd38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317585:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317591:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317595:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317599:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129b54e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065187.317601:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317606:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317613:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6fe00) 00010000:00010000:2.0:1746065187.317614:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065187.317617:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317622:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54e00/0x14b4f8542d4fcd3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.317661:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55200/0x14b4f8542d4fcd31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a92 expref: 308 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.317674:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55e00/0x14b4f8542d4fcd46 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a92 expref: 307 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.317680:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.317681:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065187.317683:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b55e00, rc 0) 00000100:00100000:2.0:1746065187.317734:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+307:31793:x1830881263056896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 671us (1584us total) trans 8589944192 rc 0/0 00000100:00100000:2.0:1746065187.317740:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9955 00000100:00100000:0.0:1746065187.322488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.322553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.322605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.322646:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057152 00000100:00100000:2.0:1746065187.322653:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057152 00000100:00100000:2.0:1746065187.322694:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 758 00000100:00100000:2.0:1746065187.322700:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+307:1961:x1830881263057152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.322711:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.322729:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55e00/0x14b4f8542d4fcd46 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a92 expref: 307 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.322740:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.322744:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.322833:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+306:1961:x1830881263057152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 132us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.322839:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 758 00000100:00100000:3.0:1746065187.322878:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057024 00000100:00100000:3.0:1746065187.322882:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057024 00000100:00100000:3.0:1746065187.322901:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057280 00000100:00100000:3.0:1746065187.322903:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057280 00000100:00100000:0.0:1746065187.322926:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14548 00000100:00100000:0.0:1746065187.322938:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263057024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065187.322954:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.322966:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c9e200/0x14b4f8542d4fcd54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60a99 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065187.323004:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260351872:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065187.323030:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14549 00000100:00100000:1.0:1746065187.323037:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263057280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.323043:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.323049:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094897600/0x14b4f8542d4fcd5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60aa0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065187.323057:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.323068:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260352000:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065187.323086:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00002000:00010000:2.0:1746065187.324264:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime: 1746065187 -> 1746065188 00002000:00010000:2.0:1746065187.324268:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065186 -> 1746065188 00002000:00010000:2.0:1746065187.324270:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime: 1746065187 -> 1746065188 00000100:00100000:2.0:1746065187.324287:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260351872:192.168.202.46@tcp:106: 00002000:00010000:1.0:1746065187.324299:0:8429:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime: 1746065187 -> 1746065188 00002000:00010000:1.0:1746065187.324302:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime: 1746065187 -> 1746065188 00010000:00010000:2.0:1746065187.324305:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c9e200/0x14b4f8542d4fcd54 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a99 expref: 28 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065187.324309:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260352000:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065187.324315:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c9e200/0x14b4f8542d4fcd54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a99 expref: 28 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.324320:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094897600/0x14b4f8542d4fcd5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa0 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.324323:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9e200, rc 0) 00010000:00010000:1.0:1746065187.324326:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094897600/0x14b4f8542d4fcd5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa0 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065187.324346:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263057024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1414us (1794us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065187.324347:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094897600, rc 0) 00000100:00100000:2.0:1746065187.324352:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14548 00000100:00100000:1.0:1746065187.324360:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263057280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1325us (1755us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065187.324364:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14549 00000100:00100000:0.0:1746065187.337946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.338339:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057408 00000100:00100000:1.0:1746065187.338349:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057408 00000100:00100000:1.0:1746065187.338555:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14550 00000100:00100000:1.0:1746065187.338565:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31793:x1830881263057408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.338584:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.338601:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60aa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.338631:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.338638:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.338640:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.338644:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.338674:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.338685:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 21 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.338699:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260352128:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.339365:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.341498:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260352128:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065187.341528:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.341542:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094896400, rc 0) 00000100:00100000:1.0:1746065187.342054:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31793:x1830881263057408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3486us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.342063:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14550 00000100:00100000:2.0:1746065187.342475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.342957:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057536 00000100:00100000:3.0:1746065187.342965:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057536 00002000:00100000:3.0:1746065187.343005:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1851392->2097151) req@ffff88008fd73800 x1830881263057536/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.343014:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73800 with x1830881263057536 ext(1851392->2097151) 00010000:00010000:3.0:1746065187.343022:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 22 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.343034:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 22 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065187.343041:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd73800 00000100:00100000:3.0:1746065187.343085:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2502 00000100:00100000:3.0:1746065187.343093:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263057536:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065187.350657:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881263057536:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 7555us (8173us total) trans 17179873598 rc 0/0 00000100:00100000:3.0:1746065187.350668:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2502 00002000:00100000:3.0:1746065187.350678:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1851392->2097151) req@ffff88008fd73800 x1830881263057536/t17179873598(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/448 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.350687:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73800 with x1830881263057536 ext(1851392->2097151) 00010000:00010000:3.0:1746065187.350695:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.350706:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:3.0:1746065187.350712:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd73800 00000100:00100000:0.0:1746065187.352744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.352901:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057664 00000100:00100000:2.0:1746065187.352908:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057664 00010000:00010000:2.0:1746065187.352938:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.352964:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7455 00000100:00100000:2.0:1746065187.352971:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881263057664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.352982:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.353000:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.353011:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.353029:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fcd23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a84 expref: 24 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.353062:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.353064:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.353072:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.353079:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.353108:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 25 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.353119:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260352256:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065187.353910:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.355547:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260352256:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065187.355567:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.355609:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881263057664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2638us (2872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.355617:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7455 00000100:00100000:0.0:1746065187.358281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.358343:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263057920 00000100:00100000:3.0:1746065187.358350:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263057920 00002000:00100000:3.0:1746065187.358388:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a4e99f80 x1830881263057920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.358397:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e99f80 with x1830881263057920 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.358401:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e99f80 00000100:00100000:3.0:1746065187.358503:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8196 00000100:00100000:3.0:1746065187.358511:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263057920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.362927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.363230:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058048 00000100:00100000:1.0:1746065187.363238:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058048 00000100:00100000:1.0:1746065187.363440:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14551 00000100:00100000:1.0:1746065187.363449:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31786:x1830881263058048:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065187.363463:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.363478:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60aae expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.363508:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.363516:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 6 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.363521:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 18 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.363526:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.363527:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.363530:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [94208->958463] (req 94208->958463) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.363553:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 18 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.363563:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 18 pid: 2463 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065187.363573:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260352384:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065187.363958:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 6 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.363965:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 6 pid: 4544 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065187.363977:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260352512:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065187.364004:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.364010:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 28 pid: 8429 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065187.364016:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260352640:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.364029:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.366469:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260352384:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.366478:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260352640:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.366697:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263057920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8185us (8420us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.366706:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8196 00002000:00100000:3.0:1746065187.366716:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a4e99f80 x1830881263057920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.366724:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e99f80 with x1830881263057920 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.366728:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e99f80 00000100:00100000:1.0:1746065187.367231:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260352512:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065187.367255:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [94208->958463] (req 94208->958463) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.367272:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094896200, rc 0) 00000100:00100000:1.0:1746065187.367289:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31786:x1830881263058048:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3843us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.367295:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14551 00000100:00100000:0.0:1746065187.368521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.368699:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058304 00000100:00100000:2.0:1746065187.368706:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058304 00010000:00010000:2.0:1746065187.368746:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 7 pid: 4544 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.368777:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7456 00000100:00100000:2.0:1746065187.368783:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263058304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.368792:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.368809:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 7 pid: 4544 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.368841:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 7 pid: 4544 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.368859:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094897800/0x14b4f8542d4fcb5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60973 expref: 7 pid: 4544 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.368882:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.368903:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263058304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 121us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.368908:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7456 00000100:00080000:1.0:1746065187.368987:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065187.369195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.369288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.369468:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058176 00000100:00100000:1.0:1746065187.369472:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058176 00010000:00010000:1.0:1746065187.369484:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 19 pid: 2463 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065187.369498:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058432 00000100:00100000:1.0:1746065187.369500:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058432 00010000:00010000:1.0:1746065187.369507:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 28 pid: 8429 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065187.369530:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7457 00000100:00100000:1.0:1746065187.369535:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263058176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065187.369724:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7458 00000100:00100000:3.0:1746065187.369731:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263058432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.369738:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.369750:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 28 pid: 8429 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746065187.369757:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 28 pid: 8429 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746065187.369779:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fc972 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6081c expref: 28 pid: 8429 timeout: 886 lvb_type: 1 00010000:00010000:3.0:1746065187.369792:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.369811:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263058432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 81us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.369836:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7458 00010000:00010000:1.0:1746065187.370215:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.370225:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 19 pid: 2463 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.370237:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 19 pid: 2463 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.370248:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d500e00/0x14b4f8542d4fc987 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6083f expref: 19 pid: 2463 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.370268:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.370270:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.370276:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.370283:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.370308:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.370319:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260352768:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065187.370380:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.373081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.373355:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058688 00000100:00100000:3.0:1746065187.373362:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058688 00002000:00100000:3.0:1746065187.373394:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x380:0x0] (94208->98303) req@ffff8800a4e9b100 x1830881263058688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.373407:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e9b100 with x1830881263058688 ext(94208->98303) 00002000:00010000:3.0:1746065187.373412:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e9b100 00000100:00100000:3.0:1746065187.373428:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8197 00000100:00100000:3.0:1746065187.373434:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263058688:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065187.373579:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263058688:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 144us (504us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065187.373584:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8197 00002000:00100000:3.0:1746065187.373589:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x380:0x0] (94208->98303) req@ffff8800a4e9b100 x1830881263058688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.373595:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e9b100 with x1830881263058688 ext(94208->98303) 00002000:00010000:3.0:1746065187.373598:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e9b100 00000100:00100000:1.0:1746065187.373718:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260352768:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065187.373733:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.373752:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263058176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4217us (4558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.373758:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7457 00000100:00100000:0.0:1746065187.374976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.375098:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058816 00000100:00100000:1.0:1746065187.375103:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058816 00000100:00100000:1.0:1746065187.375331:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14552 00000100:00100000:1.0:1746065187.375337:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31793:x1830881263058816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.375348:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.375361:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ab5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.375381:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.375388:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.375389:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.375392:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.375414:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.375429:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 22 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.375439:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260352896:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.375496:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.376553:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260352896:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065187.376567:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.376576:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211800, rc 0) 00000100:00100000:1.0:1746065187.376595:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31793:x1830881263058816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1259us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.376600:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14552 00000100:00100000:0.0:1746065187.378612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.378680:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263058944 00000100:00100000:2.0:1746065187.378686:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263058944 00002000:00100000:2.0:1746065187.378713:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->1155071) req@ffff8800a4e9b800 x1830881263058944/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.378721:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e9b800 with x1830881263058944 ext(1048576->1155071) 00010000:00010000:2.0:1746065187.378728:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.378742:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 23 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.378747:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4e9b800 00000100:00100000:2.0:1746065187.378781:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2503 00000100:00100000:2.0:1746065187.378787:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263058944:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065187.381318:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263058944:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 2525us (2703us total) trans 17179873599 rc 0/0 00000100:00100000:2.0:1746065187.381326:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2503 00002000:00100000:2.0:1746065187.381334:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->1155071) req@ffff8800a4e9b800 x1830881263058944/t17179873599(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/448 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.381343:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e9b800 with x1830881263058944 ext(1048576->1155071) 00010000:00010000:2.0:1746065187.381351:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.381362:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.381368:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4e9b800 00000100:00100000:0.0:1746065187.387030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.387635:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059200 00000100:00100000:2.0:1746065187.387642:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059200 00002000:00100000:2.0:1746065187.387675:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (954368->958463) req@ffff8800a4e9bb80 x1830881263059200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.387684:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e9bb80 with x1830881263059200 ext(954368->958463) 00002000:00010000:2.0:1746065187.387689:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e9bb80 00000100:00100000:2.0:1746065187.387717:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8198 00000100:00100000:2.0:1746065187.387723:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263059200:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065187.389042:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263059200:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1316us (2016us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065187.389050:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8198 00002000:00100000:2.0:1746065187.389056:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (954368->958463) req@ffff8800a4e9bb80 x1830881263059200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.389063:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e9bb80 with x1830881263059200 ext(954368->958463) 00002000:00010000:2.0:1746065187.389066:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e9bb80 00000100:00100000:0.0:1746065187.389370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.390282:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059328 00000100:00100000:1.0:1746065187.390287:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059328 00010000:00010000:1.0:1746065187.390309:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.390356:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7459 00000100:00100000:1.0:1746065187.390362:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263059328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.390372:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.390386:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.390400:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.390416:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcd2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a8b expref: 25 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.390561:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.390563:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.390569:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.390576:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.390601:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.390611:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260353024:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065187.391065:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.395326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.395428:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260353024:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065187.395444:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.395477:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263059328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5115us (6108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.395486:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7459 00000100:00100000:0.0:1746065187.395552:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059584 00000100:00100000:0.0:1746065187.395558:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059584 00000100:00100000:0.0:1746065187.395590:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4255 00000100:00100000:0.0:1746065187.395596:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+306:31786:x1830881263059584:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065187.395792:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+307:31786:x1830881263059584:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 196us (472us total) trans 8589944193 rc 0/0 00000100:00100000:0.0:1746065187.395801:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4255 00000100:00100000:2.0:1746065187.396357:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.396411:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059840 00000100:00100000:0.0:1746065187.396416:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059840 00002000:00100000:0.0:1746065187.396437:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008fd70000 x1830881263059840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.396446:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70000 with x1830881263059840 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.396449:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70000 00000100:00100000:0.0:1746065187.396471:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8199 00000100:00100000:0.0:1746065187.396476:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263059840:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065187.408951:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263059840:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12462us (12582us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065187.408963:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8199 00002000:00100000:2.0:1746065187.408977:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008fd70000 x1830881263059840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.408985:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70000 with x1830881263059840 ext(1048576->2097151) 00002000:00010000:2.0:1746065187.408991:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70000 00000100:00100000:0.0:1746065187.418381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.418420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.418470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.418545:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263059968 00000100:00100000:2.0:1746065187.418555:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263059968 00000100:00100000:2.0:1746065187.418596:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060096 00000100:00100000:2.0:1746065187.418598:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060096 00000100:00100000:2.0:1746065187.418609:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060224 00000100:00100000:2.0:1746065187.418611:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060224 00000100:00100000:2.0:1746065187.418625:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14553 00000100:00100000:2.0:1746065187.418633:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263059968:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.418651:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.418668:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b163e00/0x14b4f8542d4fcd77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60abc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.418716:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353152:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065187.418801:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.418838:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14554 00000100:00100000:2.0:1746065187.418843:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263060096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.418850:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.418859:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ac3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.418871:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.418873:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.418880:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.418893:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.418903:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b163400, rc 0) 00000100:00100000:2.0:1746065187.418925:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263060096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 81us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.418931:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14554 00000100:00100000:2.0:1746065187.418945:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14555 00000100:00100000:2.0:1746065187.418950:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263060224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.418954:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.418959:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60aca expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.418968:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.418969:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.418973:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.418981:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.418987:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b163600, rc 0) 00000100:00100000:2.0:1746065187.418998:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263060224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 48us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.419002:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14555 00002000:00010000:2.0:1746065187.424079:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime: 1746065186 -> 1746065188 00002000:00010000:2.0:1746065187.424084:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime: 1746065186 -> 1746065188 00002000:00010000:2.0:1746065187.424086:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime: 1746065186 -> 1746065188 00000100:00100000:2.0:1746065187.424105:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353152:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065187.424134:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b163e00/0x14b4f8542d4fcd77 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60abc expref: 19 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.424146:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b163e00/0x14b4f8542d4fcd77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60abc expref: 19 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.424164:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b163e00, rc 0) 00000100:00100000:2.0:1746065187.424213:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263059968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5580us (5840us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065187.424221:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14553 00000100:00100000:0.0:1746065187.428653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.428698:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.428776:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060480 00000100:00100000:3.0:1746065187.428783:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060480 00000100:00100000:3.0:1746065187.428846:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4256 00000100:00100000:3.0:1746065187.428853:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+307:31793:x1830881263060480:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065187.429039:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+308:31793:x1830881263060480:12345-192.168.202.46@tcp:35:cat.0 Request processed in 183us (391us total) trans 8589944194 rc 0/0 00000100:00100000:3.0:1746065187.429045:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4256 00000100:00100000:2.0:1746065187.430650:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060608 00000100:00100000:2.0:1746065187.430659:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060608 00000100:00100000:2.0:1746065187.430700:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14556 00000100:00100000:2.0:1746065187.430706:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:31800:x1830881263060608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.430717:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.430731:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ad1 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.430753:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.430759:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065187.430761:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065187.430988:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.431011:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.431020:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.431035:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353280:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.431083:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.434057:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353280:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.434085:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.434100:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b162400, rc 0) 00000100:00100000:2.0:1746065187.434148:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:31800:x1830881263060608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3441us (5448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.434156:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14556 00000100:00100000:0.0:1746065187.435482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.435847:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060736 00000100:00100000:2.0:1746065187.435854:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060736 00002000:00100000:2.0:1746065187.435895:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (94208->958463) req@ffff8801298a0700 x1830881263060736/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.435905:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a0700 with x1830881263060736 ext(94208->958463) 00010000:00010000:2.0:1746065187.435913:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 27 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.435926:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 27 pid: 8429 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.435933:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801298a0700 00000100:00100000:2.0:1746065187.437316:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2504 00000100:00100000:2.0:1746065187.437328:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263060736:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065187.464654:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263060736:12345-192.168.202.46@tcp:4:cat.0 Request processed in 27319us (29164us total) trans 21474840870 rc 0/0 00000100:00100000:2.0:1746065187.464667:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2504 00002000:00100000:2.0:1746065187.464679:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (94208->958463) req@ffff8801298a0700 x1830881263060736/t21474840870(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/448 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.464688:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a0700 with x1830881263060736 ext(94208->958463) 00010000:00010000:2.0:1746065187.464697:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 29 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.464710:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 29 pid: 8429 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.464716:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801298a0700 00000100:00100000:0.0:1746065187.467546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.468277:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263060864 00000100:00100000:1.0:1746065187.468288:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263060864 00010000:00010000:1.0:1746065187.468324:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 29 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.468377:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7460 00000100:00100000:1.0:1746065187.468387:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263060864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.468401:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.468423:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 29 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.468435:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 29 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.468456:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcd69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->958463) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aae expref: 29 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.468499:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.468502:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.468511:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.468519:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.468554:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.468567:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260353408:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065187.468667:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.477261:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260353408:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065187.477281:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.477316:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263060864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8931us (9779us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.477326:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7460 00000100:00100000:0.0:1746065187.480040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.480113:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263061120 00000100:00100000:2.0:1746065187.480119:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263061120 00002000:00100000:2.0:1746065187.480151:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff8801298a0e00 x1830881263061120/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.480159:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a0e00 with x1830881263061120 ext(0->1048575) 00002000:00010000:2.0:1746065187.480164:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a0e00 00000100:00100000:2.0:1746065187.480187:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8200 00000100:00100000:2.0:1746065187.480193:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263061120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.482283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.482327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.483262:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263061376 00000100:00100000:1.0:1746065187.483271:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263061376 00002000:00100000:1.0:1746065187.483307:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8801298a1180 x1830881263061376/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.483316:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a1180 with x1830881263061376 ext(1048576->2097151) 00002000:00010000:1.0:1746065187.483321:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801298a1180 00000100:00100000:1.0:1746065187.483340:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263061632 00000100:00100000:1.0:1746065187.483344:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263061632 00002000:00100000:1.0:1746065187.483360:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8801298a1500 x1830881263061632/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.483367:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a1500 with x1830881263061632 ext(1048576->2097151) 00002000:00010000:1.0:1746065187.483370:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801298a1500 00000100:00100000:1.0:1746065187.483388:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8201 00000100:00100000:1.0:1746065187.483397:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263061376:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065187.484748:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8202 00000100:00100000:1.0:1746065187.484757:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263061632:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065187.502152:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263061120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21951us (22111us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.502163:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8200 00002000:00100000:3.0:1746065187.502173:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff8801298a0e00 x1830881263061120/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.502188:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a0e00 with x1830881263061120 ext(0->1048575) 00002000:00010000:3.0:1746065187.502193:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a0e00 00000100:00100000:1.0:1746065187.510481:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263061376:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27075us (28194us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065187.510495:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8201 00002000:00100000:1.0:1746065187.510505:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8801298a1180 x1830881263061376/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.510513:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a1180 with x1830881263061376 ext(1048576->2097151) 00002000:00010000:1.0:1746065187.510518:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801298a1180 00000100:00100000:1.0:1746065187.516284:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263061632:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31517us (33946us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065187.516295:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8202 00002000:00100000:1.0:1746065187.516307:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8801298a1500 x1830881263061632/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.516316:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a1500 with x1830881263061632 ext(1048576->2097151) 00002000:00010000:1.0:1746065187.516321:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801298a1500 00000100:00100000:0.0:1746065187.550434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.550494:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263061760 00000100:00100000:2.0:1746065187.550502:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263061760 00000100:00100000:2.0:1746065187.550559:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14557 00000100:00100000:2.0:1746065187.550567:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:31796:x1830881263061760:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065187.550583:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.550597:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ad8 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.550622:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.550630:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.550635:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.550636:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.550639:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1634304->2097151] (req 1634304->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.550664:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.550674:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.550684:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353536:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.550808:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.550842:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 27 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.550855:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353664:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.550979:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.553507:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353536:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.553517:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353664:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.553544:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1634304->2097151] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.553558:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8aa800, rc 0) 00000100:00100000:2.0:1746065187.553601:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:31796:x1830881263061760:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3034us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.553609:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14557 00000100:00100000:0.0:1746065187.554271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.554349:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263061888 00000100:00100000:1.0:1746065187.554355:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263061888 00010000:00010000:1.0:1746065187.554375:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 28 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.554400:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7461 00000100:00100000:1.0:1746065187.554405:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881263061888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.554414:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.554431:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 28 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.554441:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 28 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.554460:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcc35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609f8 expref: 28 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.554486:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.554512:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263061888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.554518:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7461 00000100:00100000:0.0:1746065187.554805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.555029:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062016 00000100:00100000:1.0:1746065187.555032:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062016 00010000:00010000:1.0:1746065187.555044:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065187.555068:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7462 00000100:00100000:1.0:1746065187.555073:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263062016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.555079:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.555090:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.555097:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.555108:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b54000/0x14b4f8542d4fcc3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e609ff expref: 20 pid: 25185 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.555115:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.555117:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.555122:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.555128:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.555150:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.555160:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260353792:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065187.555411:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.556711:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260353792:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065187.556724:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.556858:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263062016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1784us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.556866:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7462 00000100:00100000:0.0:1746065187.558210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.558259:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062272 00000100:00100000:1.0:1746065187.558265:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062272 00002000:00100000:1.0:1746065187.558298:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1634304->1638399) req@ffff8801298a1f80 x1830881263062272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.558306:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a1f80 with x1830881263062272 ext(1634304->1638399) 00002000:00010000:1.0:1746065187.558311:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a1f80 00000100:00100000:1.0:1746065187.558342:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8203 00000100:00100000:1.0:1746065187.558349:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263062272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065187.558518:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263062272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 169us (310us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065187.558524:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8203 00002000:00100000:1.0:1746065187.558529:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1634304->1638399) req@ffff8801298a1f80 x1830881263062272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.558535:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a1f80 with x1830881263062272 ext(1634304->1638399) 00002000:00010000:1.0:1746065187.558538:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a1f80 00000100:00100000:0.0:1746065187.563653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.563749:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062400 00000100:00100000:2.0:1746065187.563756:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062400 00000100:00100000:2.0:1746065187.563890:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14558 00000100:00100000:2.0:1746065187.563898:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:31796:x1830881263062400:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065187.563913:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.563927:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60adf expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.563951:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.563958:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.563964:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.563966:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.563968:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2650111] (req 2097152->2650111) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.564097:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 20 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.564108:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 20 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.564117:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353920:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.564195:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.564202:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 26 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.564208:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260354048:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.564225:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.570114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.570163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.570233:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062528 00000100:00100000:3.0:1746065187.570241:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062528 00000100:00100000:2.0:1746065187.570271:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260353920:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.570273:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 21 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.570282:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260354048:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.570295:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062656 00000100:00100000:3.0:1746065187.570297:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062656 00010000:00010000:2.0:1746065187.570304:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->2650111] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 21 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.570306:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 27 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.570318:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7463 00000100:00100000:3.0:1746065187.570324:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263062528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.570324:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ab000, rc 0) 00010000:00010000:3.0:1746065187.570334:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.570352:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 21 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.570361:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 21 pid: 4544 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.570361:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:31796:x1830881263062400:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6464us (6716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.570367:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14558 00010000:00010000:3.0:1746065187.570379:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcce4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a61 expref: 20 pid: 4544 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.570393:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.570409:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263062528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.570414:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7463 00000100:00100000:3.0:1746065187.570424:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7464 00000100:00100000:3.0:1746065187.570428:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263062656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.570434:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.570441:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 27 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.570453:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 27 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.570464:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f0dc00/0x14b4f8542d4fccdd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a5a expref: 27 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.570471:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.570472:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.570477:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.570483:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.570509:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065187.570518:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260354176:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065187.570629:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065187.572607:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260354176:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065187.572625:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.573146:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263062656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2714us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.573156:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7464 00000100:00100000:0.0:1746065187.578699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.580757:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263062912 00000100:00100000:1.0:1746065187.580775:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263062912 00002000:00100000:1.0:1746065187.580831:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2646016->2650111) req@ffff8801298a2d80 x1830881263062912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.580840:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a2d80 with x1830881263062912 ext(2646016->2650111) 00002000:00010000:1.0:1746065187.580845:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a2d80 00000100:00100000:1.0:1746065187.580865:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8204 00000100:00100000:1.0:1746065187.580872:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263062912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065187.581005:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263062912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 133us (2313us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065187.581011:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8204 00002000:00100000:1.0:1746065187.581016:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2646016->2650111) req@ffff8801298a2d80 x1830881263062912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.581022:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a2d80 with x1830881263062912 ext(2646016->2650111) 00002000:00010000:1.0:1746065187.581025:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a2d80 00000100:00100000:0.0:1746065187.597250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.597525:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063040 00000100:00100000:3.0:1746065187.597533:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063040 00000100:00080000:1.0:1746065187.597588:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065187.597598:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9956 00000100:00100000:3.0:1746065187.597610:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:31804:x1830881263063040:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065187.597630:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.597645:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fcda1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ae6 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.597693:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.598039:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.598050:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.598132:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.598139:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.598144:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.598235:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.598245:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 43 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.598251:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.598277:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 43 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.598287:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 43 pid: 14645 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.598298:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260354304:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.599218:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.602421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.602663:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260354304:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.602684:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065187.602749:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063296 00000100:00100000:1.0:1746065187.602756:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063296 00000100:00100000:1.0:1746065187.602852:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4257 00000100:00100000:1.0:1746065187.602859:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+44:27246:x1830881263063296:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065187.603032:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+45:27246:x1830881263063296:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 172us (618us total) trans 8589944195 rc 0/0 00000100:00100000:1.0:1746065187.603038:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4257 00000100:00080000:2.0:1746065187.603263:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065187.607620:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.607752:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063424 00000100:00100000:3.0:1746065187.607759:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063424 00010000:00010000:3.0:1746065187.607797:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 45 pid: 14645 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.607939:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7465 00000100:00100000:3.0:1746065187.607946:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+45:1960:x1830881263063424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.607958:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.607964:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 45 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.607974:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 45 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.607992:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b55600/0x14b4f8542d4fcc4a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a06 expref: 45 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.608208:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.608214:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.608223:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.608229:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.608918:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.608954:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+44:1960:x1830881263063424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1008us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.608961:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7465 00010000:00010000:0.0:1746065187.609115:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609121:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:0.0:1746065187.609155:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:0.0:1746065187.609158:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065187.609171:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609179:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609186:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609191:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609197:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609201:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cce800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065187.609434:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609441:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609452:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065187.609454:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065187.609458:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609466:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cce800/0x14b4f8542d4fcda8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609558:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609564:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609568:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609573:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccfc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065187.609575:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609579:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609586:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205500) 00010000:00010000:0.0:1746065187.609587:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065187.609589:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609593:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccfc00/0x14b4f8542d4fcdaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.609621:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fcda1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 22 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.609631:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 21 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.609640:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065187.609642:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065187.609643:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc000, rc 0) 00000100:00100000:0.0:1746065187.609880:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+21:31804:x1830881263063040:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 12275us (12636us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.609886:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9956 00000100:00100000:0.0:1746065187.614476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.614501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.614519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.614555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.614583:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063552 00000100:00100000:0.0:1746065187.614589:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063552 00000100:00100000:0.0:1746065187.614617:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063680 00000100:00100000:0.0:1746065187.614618:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063680 00000100:00100000:0.0:1746065187.614625:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063808 00000100:00100000:0.0:1746065187.614627:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063808 00000100:00100000:0.0:1746065187.614633:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263063936 00000100:00100000:0.0:1746065187.614634:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263063936 00000100:00100000:0.0:1746065187.614643:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14559 00000100:00100000:0.0:1746065187.614649:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263063552:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065187.614663:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.614720:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60aed expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.614739:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.614740:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.614747:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.614759:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.614781:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdca000, rc 0) 00000100:00100000:0.0:1746065187.614812:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263063552:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 163us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.614833:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14559 00000100:00100000:0.0:1746065187.614848:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14560 00000100:00100000:0.0:1746065187.614852:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263063680:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065187.614859:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.614866:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60af4 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.614877:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.614878:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.614882:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.614890:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.614896:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdca600, rc 0) 00000100:00100000:0.0:1746065187.614908:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263063680:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 56us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.614913:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14560 00000100:00100000:0.0:1746065187.614923:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14561 00000100:00100000:0.0:1746065187.614927:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263063808:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065187.614932:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.614942:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60afb expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.614950:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.614952:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.614955:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.614962:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.614969:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdca800, rc 0) 00000100:00100000:0.0:1746065187.614987:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263063808:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 59us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.614991:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14561 00000100:00100000:0.0:1746065187.615002:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14562 00000100:00100000:0.0:1746065187.615006:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263063936:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065187.615012:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.615018:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcdd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b02 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065187.615047:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0028380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260354432:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065187.615929:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.615968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.616008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.616069:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064064 00000100:00100000:2.0:1746065187.616073:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064064 00000100:00100000:2.0:1746065187.616101:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064192 00000100:00100000:2.0:1746065187.616103:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064192 00000100:00100000:2.0:1746065187.616115:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14563 00000100:00100000:2.0:1746065187.616120:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263064064:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065187.616127:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.616134:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8aaa00/0x14b4f8542d4fcdd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b09 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.616157:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260354560:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065187.616192:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.616204:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14564 00000100:00100000:2.0:1746065187.616208:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263064192:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065187.616214:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.616220:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b10 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.616236:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.616237:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.616242:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.616256:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.616263:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ab800, rc 0) 00000100:00100000:2.0:1746065187.616278:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263064192:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.616283:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14564 00002000:00010000:2.0:1746065187.619868:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime: 1746065187 -> 1746065188 00002000:00010000:2.0:1746065187.619874:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065187 -> 1746065188 00002000:00010000:2.0:1746065187.619876:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime: 1746065187 -> 1746065188 00000100:00100000:2.0:1746065187.619896:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260354560:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065187.619923:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f8aaa00/0x14b4f8542d4fcdd9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b09 expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.619934:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8aaa00/0x14b4f8542d4fcdd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b09 expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.619982:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8aaa00, rc 0) 00000100:00100000:2.0:1746065187.620018:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263064064:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 3896us (4050us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065187.620024:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14563 00002000:00010000:2.0:1746065187.620073:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065187 -> 1746065188 00002000:00010000:2.0:1746065187.620076:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065187 -> 1746065188 00002000:00010000:2.0:1746065187.620078:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065187 -> 1746065188 00000100:00100000:2.0:1746065187.620085:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0028380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260354432:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065187.620099:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcdd2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b02 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.620107:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcdd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b02 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.620113:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdca400, rc 0) 00000100:00100000:2.0:1746065187.620136:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263063936:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 5129us (5580us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065187.620140:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14562 00000100:00100000:0.0:1746065187.626544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.626639:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064448 00000100:00100000:2.0:1746065187.626647:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064448 00000100:00100000:2.0:1746065187.626834:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9957 00000100:00100000:2.0:1746065187.626843:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+21:31804:x1830881263064448:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065187.626859:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.626874:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fcde7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b17 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.626962:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065187.626974:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 22 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.626980:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065187.627004:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 22 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.627013:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 22 pid: 14645 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.627023:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260354688:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.627094:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.628982:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260354688:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.629001:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065187.630326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.630383:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064576 00000100:00100000:3.0:1746065187.630388:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064576 00010000:00010000:3.0:1746065187.630413:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 23 pid: 14645 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.630474:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7466 00000100:00100000:3.0:1746065187.630481:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+23:1960:x1830881263064576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.630490:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.630495:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 23 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.630504:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 23 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.630522:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fcdb6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ae6 expref: 23 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.630547:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.630552:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.630559:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.630905:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.630923:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.630955:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+22:1960:x1830881263064576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 473us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.630961:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7466 00010000:00010000:2.0:1746065187.631021:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065187.631026:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:2.0:1746065187.631040:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065187.631473:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fcde7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b17 expref: 23 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.631518:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b17 expref: 22 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.631524:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.631526:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065187.631528:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8aac00, rc 0) 00000100:00100000:2.0:1746065187.631705:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+22:31804:x1830881263064448:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 4862us (5168us total) trans 8589944196 rc 0/0 00000100:00100000:2.0:1746065187.631711:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9957 00000100:00100000:0.0:1746065187.633953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.634043:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064832 00000100:00100000:2.0:1746065187.634050:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064832 00000100:00100000:2.0:1746065187.634298:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9958 00000100:00100000:2.0:1746065187.634306:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+22:31804:x1830881263064832:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065187.634324:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.634327:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065187.634347:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aac00/0x14b4f8542d4fcdee lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b17 expref: 22 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.634358:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.634362:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065187.634371:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab600/0x14b4f8542d4fcdfc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b1e expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.634440:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab400/0x14b4f8542d4fce03 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065187.634449:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab400/0x14b4f8542d4fce03 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065187.634456:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab400/0x14b4f8542d4fce03 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:2.0:1746065187.634464:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065187.634548:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab600/0x14b4f8542d4fcdfc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b1e expref: 24 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.634564:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab400/0x14b4f8542d4fce03 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b1e expref: 23 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.634570:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.634572:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065187.634574:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8ab400, rc 0) 00000100:00100000:2.0:1746065187.635133:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+23:31804:x1830881263064832:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 826us (1185us total) trans 8589944197 rc 0/0 00000100:00100000:2.0:1746065187.635140:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9958 00000100:00100000:0.0:1746065187.636615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.636709:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263064960 00000100:00100000:2.0:1746065187.636716:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263064960 00000100:00100000:2.0:1746065187.636747:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9959 00000100:00100000:2.0:1746065187.636753:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+23:31804:x1830881263064960:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065187.636782:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.636794:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aba00/0x14b4f8542d4fce11 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b25 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.637161:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aba00/0x14b4f8542d4fce11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b25 expref: 24 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.637173:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aba00/0x14b4f8542d4fce11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b25 expref: 24 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.637187:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.637189:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065187.637192:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8aba00, rc 0) 00000100:00100000:2.0:1746065187.637566:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+24:31804:x1830881263064960:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 812us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.637572:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9959 00000100:00100000:0.0:1746065187.643048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.643321:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065088 00000100:00100000:2.0:1746065187.643328:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065088 00000100:00100000:2.0:1746065187.643365:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14565 00000100:00100000:2.0:1746065187.643373:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263065088:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065187.643408:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.643424:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.643431:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.643438:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.643439:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.643442:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.643467:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 7 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.643477:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 7 pid: 9716 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.643488:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260354816:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.644837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065187.644870:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.644881:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.645124:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065344 00000100:00100000:3.0:1746065187.645129:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065344 00000100:00100000:3.0:1746065187.645158:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14566 00000100:00100000:3.0:1746065187.645164:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263065344:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065187.645186:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.645202:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.645209:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.645216:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.645220:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.645222:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.645224:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.645241:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.645249:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 25 pid: 8427 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746065187.645259:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260355072:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.645325:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.645333:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 9 pid: 9716 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746065187.645346:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260355200:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.645371:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.645378:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.645385:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260355328:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.645398:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260354944:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.645401:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.645420:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.647754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.647810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.647868:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.648126:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065600 00000100:00100000:3.0:1746065187.648133:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065600 00000100:00100000:3.0:1746065187.648174:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065216 00000100:00100000:3.0:1746065187.648176:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065216 00000100:00100000:3.0:1746065187.648192:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14567 00000100:00100000:3.0:1746065187.648198:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263065600:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:1.0:1746065187.648200:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14568 00000100:00100000:1.0:1746065187.648208:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263065216:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065187.648229:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.648229:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.648242:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.648243:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.648248:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065187.648250:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065187.648250:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.648252:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.648257:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.648262:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.648263:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.648265:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.648281:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.648285:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.648291:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.648293:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 25 pid: 8427 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065187.648302:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260355584:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.648303:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260355456:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.648356:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746065187.648758:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065187.648778:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 10 pid: 9716 timeout: 886 lvb_type: 1 00000100:00100000:1.0:1746065187.648786:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e9ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260355712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065187.648809:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.648831:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.648839:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e9aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260355840:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.648853:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065187.649461:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065472 00000100:00100000:3.0:1746065187.649466:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065472 00000100:00100000:1.0:1746065187.649549:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.649662:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065728 00000100:00100000:3.0:1746065187.649665:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065728 00000100:00100000:2.0:1746065187.649669:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14569 00000100:00100000:2.0:1746065187.649677:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263065472:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:3.0:1746065187.649684:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14570 00000100:00100000:3.0:1746065187.649690:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263065728:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065187.649699:0:2463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.649709:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.649710:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.649716:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065187.649717:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065187.649719:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.649719:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.649725:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.649732:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.649735:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 18 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.649741:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.649742:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.649743:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.649744:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.649757:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260355968:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.649758:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.649781:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 25 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.649789:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260356096:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.649803:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5972000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065187.649847:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.649853:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 11 pid: 2463 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746065187.649860:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260356224:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.650224:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.650233:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 26 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.650252:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260356352:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.650286:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d00480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.653138:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260354816:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065187.661506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.661541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.662831:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260355072:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.662845:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260355200:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065187.664167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.664237:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260355328:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.664261:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065187.664293:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260354944:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.664308:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.666560:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065856 00000100:00100000:1.0:1746065187.666571:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065856 00010000:00010000:1.0:1746065187.666605:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 10 pid: 9716 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746065187.666629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.666631:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263066112 00000100:00100000:1.0:1746065187.666633:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263066112 00010000:00010000:1.0:1746065187.666644:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 27 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746065187.666647:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263066240 00000100:00100000:0.0:1746065187.666650:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263066240 00000100:00100000:1.0:1746065187.666661:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7467 00010000:00010000:0.0:1746065187.666664:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 19 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.666667:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263065856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.666678:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065187.666678:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7468 00000100:00100000:0.0:1746065187.666683:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263066112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065187.666690:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.666696:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 10 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.666702:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 27 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.666706:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 10 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.666710:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 27 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.666724:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca000/0x14b4f8542d4fcdbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aed expref: 10 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.666724:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a211800/0x14b4f8542d4fcd70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ab5 expref: 27 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.666738:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065187.666749:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.666791:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263065984 00000100:00100000:2.0:1746065187.666795:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263065984 00010000:00010000:2.0:1746065187.666810:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 12 pid: 9716 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.666834:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7469 00000100:00100000:2.0:1746065187.666839:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263066240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.666844:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.666852:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 19 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.666860:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 19 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.666870:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b162400/0x14b4f8542d4fcd8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad1 expref: 19 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.666881:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.666883:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.666886:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.666896:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.666926:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.666971:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263065856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 114us (5239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.666977:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7467 00000100:00100000:1.0:1746065187.666989:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7470 00000100:00100000:1.0:1746065187.666994:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881263065984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.667001:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.667009:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 12 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.667015:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 12 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.667026:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdca800/0x14b4f8542d4fcdcb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60afb expref: 12 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:1.0:1746065187.667033:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065187.667236:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.667242:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.667259:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.667264:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.667275:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.667280:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8abc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065187.667284:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.667290:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.667299:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.667305:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8abc00/0x14b4f8542d4fce18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065187.667420:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263066112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 735us (3254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.667426:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7468 00000100:00100000:0.0:1746065187.667502:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.667513:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263066368 00000100:00100000:0.0:1746065187.667516:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263066368 00010000:00010000:0.0:1746065187.667527:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 26 pid: 8427 timeout: 886 lvb_type: 1 00000100:00100000:0.0:1746065187.667538:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7471 00000100:00100000:0.0:1746065187.667543:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263066368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065187.667548:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065187.667556:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 26 pid: 8427 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.667560:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263066240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 719us (931us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065187.667563:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 26 pid: 8427 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.667566:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7469 00010000:00010000:0.0:1746065187.667574:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b163600/0x14b4f8542d4fcd85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aca expref: 26 pid: 8427 timeout: 886 lvb_type: 1 00010000:00010000:0.0:1746065187.667582:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.667583:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.667586:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.667596:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.667611:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.667616:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260355584:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065187.667627:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+25:1959:x1830881263066368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.667632:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7471 00000100:00100000:2.0:1746065187.667638:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e9ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260355712:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.667677:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e9aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260355840:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.667693:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.667732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.667746:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263066496 00000100:00100000:2.0:1746065187.667748:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263066496 00002000:00100000:2.0:1746065187.667779:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2650111) req@ffff88008fd71500 x1830881263066496/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.667786:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71500 with x1830881263066496 ext(2097152->2650111) 00010000:00010000:2.0:1746065187.667792:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.667798:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 18 pid: 25185 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.667808:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd71500 00000100:00100000:2.0:1746065187.667843:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2505 00000100:00100000:2.0:1746065187.667849:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+18:1958:x1830881263066496:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065187.668281:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260355968:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.668291:0:2463:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.668332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.668345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.668353:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263066624 00000100:00100000:2.0:1746065187.668355:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263066624 00010000:00010000:2.0:1746065187.668367:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 25 pid: 8427 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.668376:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263066880 00000100:00100000:2.0:1746065187.668378:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263066880 00010000:00010000:2.0:1746065187.668384:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.668392:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7472 00000100:00100000:2.0:1746065187.668397:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263066624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.668402:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.668411:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 25 pid: 8427 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.668421:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 25 pid: 8427 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.668432:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b163400/0x14b4f8542d4fcd7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ac3 expref: 25 pid: 8427 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.668440:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.668456:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263066624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.668461:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7472 00000100:00100000:2.0:1746065187.668471:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7473 00000100:00100000:2.0:1746065187.668475:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263066880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.668480:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.668487:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.668493:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.668503:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094896400/0x14b4f8542d4fcd62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60aa7 expref: 26 pid: 8429 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.668509:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.668521:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263066880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.668528:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7473 00000100:00100000:2.0:1746065187.668549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.668558:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263066752 00000100:00100000:2.0:1746065187.668560:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263066752 00010000:00010000:2.0:1746065187.668568:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 12 pid: 9716 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.668577:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7474 00000100:00100000:2.0:1746065187.668581:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881263066752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.668585:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.668591:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 12 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.668597:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 12 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.668607:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdca600/0x14b4f8542d4fcdc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60af4 expref: 12 pid: 9716 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.668614:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.668616:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.668618:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668623:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668638:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065187.668646:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668651:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668664:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668670:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668676:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668680:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094897200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065187.668683:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668689:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668697:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.668706:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094897200/0x14b4f8542d4fce2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.668736:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263065216:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 20529us (20926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.668742:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14568 00000100:00100000:2.0:1746065187.668774:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263066752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 180us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.668779:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7474 00000100:00100000:2.0:1746065187.668811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.668850:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067008 00000100:00100000:2.0:1746065187.668853:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067008 00002000:00100000:2.0:1746065187.668868:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1634304->2097151) req@ffff88008fd07b80 x1830881263067008/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.668875:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07b80 with x1830881263067008 ext(1634304->2097151) 00010000:00010000:2.0:1746065187.668880:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 20 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.668888:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 20 pid: 25185 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.668893:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd07b80 00000100:00100000:2.0:1746065187.668906:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2506 00000100:00100000:2.0:1746065187.668910:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263067008:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065187.669334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.669344:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067264 00000100:00100000:2.0:1746065187.669347:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067264 00010000:00010000:2.0:1746065187.669357:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 24 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.669368:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7475 00000100:00100000:2.0:1746065187.669372:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881263067264:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.669379:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.669386:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 24 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.669394:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 24 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.669403:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.669417:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881263067264:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 44us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.669421:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7475 00000100:00100000:2.0:1746065187.669477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.669488:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067136 00000100:00100000:2.0:1746065187.669491:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067136 00010000:00010000:2.0:1746065187.669500:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 10 pid: 2463 timeout: 886 lvb_type: 1 00000100:00100000:2.0:1746065187.669511:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7476 00000100:00100000:2.0:1746065187.669514:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263067136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.669520:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.669526:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 10 pid: 2463 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.669532:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 10 pid: 2463 timeout: 886 lvb_type: 1 00010000:00010000:2.0:1746065187.669541:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.669553:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263067136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 38us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.669558:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7476 00000100:00100000:0.0:1746065187.670504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.670517:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067392 00000100:00100000:0.0:1746065187.670521:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067392 00010000:00010000:0.0:1746065187.670534:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 25 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746065187.670550:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7477 00000100:00100000:0.0:1746065187.670555:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263067392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065187.670561:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065187.670570:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 25 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065187.670578:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 25 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065187.670589:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.670591:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.670594:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.670605:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.670617:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065187.670632:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263067392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.670638:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7477 00000100:00100000:1.0:1746065187.671358:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263065984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4361us (9858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.671366:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7470 00000100:00100000:3.0:1746065187.671455:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263065088:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 28081us (28412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.671463:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14565 00010000:00010000:3.0:1746065187.671506:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982e3000/0x14b4f8542d4fccf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a6f expref: 23 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.671516:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260356096:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.671526:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8ab800/0x14b4f8542d4fcde0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b10 expref: 8 pid: 2463 timeout: 886 lvb_type: 1 00000100:00100000:3.0:1746065187.671537:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260356224:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.671546:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f7c00/0x14b4f8542d4fcceb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60a68 expref: 24 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.671554:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260356352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.671569:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671577:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671582:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671599:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671606:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671611:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671617:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e3e9a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065187.671620:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671626:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671637:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671643:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fce3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065187.671677:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263065728:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 21987us (22129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.671683:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14570 00010000:00010000:3.0:1746065187.671700:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671706:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671717:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671722:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671727:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671736:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cca800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065187.671738:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671743:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671751:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.671757:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cca800/0x14b4f8542d4fce1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065187.671799:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263065344:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 26635us (26966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.671805:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14566 00000100:00100000:3.0:1746065187.671846:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260355456:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.671860:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.684267:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881263066496:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 16410us (16527us total) trans 21474840871 rc 0/0 00000100:00100000:2.0:1746065187.684277:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2505 00002000:00100000:2.0:1746065187.684286:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2650111) req@ffff88008fd71500 x1830881263066496/t21474840871(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/448 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.684295:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71500 with x1830881263066496 ext(2097152->2650111) 00010000:00010000:2.0:1746065187.684302:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 22 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.684313:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 22 pid: 25185 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.684319:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd71500 00000100:00100000:2.0:1746065187.689672:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263067008:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 20748us (20848us total) trans 21474840872 rc 0/0 00000100:00100000:2.0:1746065187.689686:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2506 00002000:00100000:2.0:1746065187.689697:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1634304->2097151) req@ffff88008fd07b80 x1830881263067008/t21474840872(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/448 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.689706:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07b80 with x1830881263067008 ext(1634304->2097151) 00010000:00010000:2.0:1746065187.689715:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 22 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:2.0:1746065187.689727:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 22 pid: 25185 timeout: 886 lvb_type: 0 00002000:00010000:2.0:1746065187.689734:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd07b80 00000100:00100000:0.0:1746065187.694754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.694870:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067520 00000100:00100000:3.0:1746065187.694877:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067520 00010000:00010000:3.0:1746065187.694906:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 22 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:3.0:1746065187.694944:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7478 00000100:00100000:3.0:1746065187.694952:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263067520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.694969:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.694986:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 22 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.694996:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 22 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.695013:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab000/0x14b4f8542d4fcd9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60adf expref: 22 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:3.0:1746065187.695044:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.695046:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.695051:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695058:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695077:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.695109:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263067520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 157us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.695114:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7478 00010000:00010000:3.0:1746065187.695133:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695140:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695161:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695167:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695173:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695178:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e3e8c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065187.695181:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695186:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695195:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.695199:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fce26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065187.695232:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263065600:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 47034us (47485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.695238:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14567 00000100:00100000:0.0:1746065187.695495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.695787:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067648 00000100:00100000:3.0:1746065187.695791:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067648 00010000:00010000:3.0:1746065187.695803:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 21 pid: 25185 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.696537:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7479 00000100:00100000:1.0:1746065187.696546:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881263067648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.696556:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.696570:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 21 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.696580:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 21 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.696593:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8aa800/0x14b4f8542d4fcd93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ad8 expref: 21 pid: 25185 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.696619:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.696620:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.696623:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.696630:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.696645:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.696667:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1958:x1830881263067648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 123us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.696673:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7479 00010000:00010000:3.0:1746065187.696975:0:2463:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.696983:0:2463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.696998:0:2463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.697004:0:2463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.697009:0:2463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.697014:0:2463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f8ab200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065187.697016:0:2463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.697022:0:2463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.697031:0:2463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.697040:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f8ab200/0x14b4f8542d4fce34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065187.697402:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263065472:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 47724us (49531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.697409:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14569 00000100:00100000:0.0:1746065187.699372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.699424:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263067904 00000100:00100000:2.0:1746065187.699431:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263067904 00000100:00100000:2.0:1746065187.699461:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9960 00000100:00100000:2.0:1746065187.699466:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+24:31804:x1830881263067904:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:2.0:1746065187.699500:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.699518:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aba00/0x14b4f8542d4fce11 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b25 expref: 24 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699546:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.699550:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065187.699572:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065187.699583:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602a4 expref: 307 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699594:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 43 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699599:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 43 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699605:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 43 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699611:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fc432 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60513 expref: 307 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699616:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065187.699639:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fc432 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60513 expref: 307 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699648:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fc432 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60513 expref: 307 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.699659:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356480:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.699729:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 43 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699736:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 43 pid: 14645 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.699746:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356608:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.699786:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 43 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.699792:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 43 pid: 14645 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.699798:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356736:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.700563:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 43 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.700571:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 43 pid: 20754 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.700578:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356864:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065187.701185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065187.701548:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602a4 expref: 307 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.701557:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602a4 expref: 307 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.701565:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356992:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.701590:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a59720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065187.701607:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356480:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.701677:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263068032 00000100:00100000:1.0:1746065187.701682:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263068032 00010000:00010000:1.0:1746065187.701703:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fc432 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60513 expref: 308 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.701731:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7480 00000100:00100000:1.0:1746065187.701737:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+308:1961:x1830881263068032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.701745:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.701749:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fc432 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60513 expref: 308 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.701757:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fc432 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60513 expref: 308 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.701785:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fc432 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60513 expref: 308 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.701799:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.701803:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.701808:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.701843:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+307:1961:x1830881263068032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.701849:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7480 00000100:00100000:0.0:1746065187.703144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.703277:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263068416 00000100:00100000:3.0:1746065187.703283:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263068416 00000100:00100000:3.0:1746065187.703323:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4258 00000100:00100000:3.0:1746065187.703329:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+44:27247:x1830881263068416:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065187.703489:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+45:27247:x1830881263068416:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 159us (347us total) trans 8589944198 rc 0/0 00000100:00100000:3.0:1746065187.703495:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4258 00000100:00100000:2.0:1746065187.703578:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356608:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.703587:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356736:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.703592:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356864:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065187.706377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.706607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.706657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.706674:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263068544 00000100:00100000:0.0:1746065187.706681:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263068544 00010000:00010000:0.0:1746065187.706704:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 45 pid: 20754 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746065187.706723:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263068160 00000100:00100000:0.0:1746065187.706724:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263068160 00010000:00010000:0.0:1746065187.706731:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 46 pid: 14645 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746065187.706740:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263068800 00000100:00100000:0.0:1746065187.706742:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263068800 00010000:00010000:0.0:1746065187.706750:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602a4 expref: 307 pid: 14644 timeout: 886 lvb_type: 0 00000100:00100000:0.0:1746065187.706773:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7481 00000100:00100000:0.0:1746065187.706779:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+46:1960:x1830881263068544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065187.706790:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065187.706795:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 46 pid: 20754 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065187.706804:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 46 pid: 20754 timeout: 886 lvb_type: 0 00010000:00010000:0.0:1746065187.706842:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fbfa1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602ab expref: 46 pid: 20754 timeout: 886 lvb_type: 0 00000100:00100000:2.0:1746065187.706910:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260356992:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.706937:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065187.707000:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7482 00000100:00100000:1.0:1746065187.707008:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+45:1959:x1830881263068160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.707015:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.707019:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 45 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707026:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 45 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707036:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a38be00/0x14b4f8542d4fc3d7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e604f0 expref: 45 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707046:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.707050:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.707057:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.707085:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+44:1959:x1830881263068160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.707095:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7482 00000100:00100000:1.0:1746065187.707110:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7483 00000100:00100000:1.0:1746065187.707115:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+307:1960:x1830881263068800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.707121:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.707125:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602a4 expref: 307 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707131:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602a4 expref: 307 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707141:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733200/0x14b4f8542d4fbf9a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e602a4 expref: 307 pid: 14644 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707148:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.707150:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.707154:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.707166:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+306:1960:x1830881263068800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.707171:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7483 00010000:00010000:0.0:1746065187.707306:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065187.707310:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.707315:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065187.707330:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+43:1960:x1830881263068544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 551us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.707336:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7481 00000100:00100000:0.0:1746065187.707391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.707591:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263068672 00000100:00100000:1.0:1746065187.707595:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263068672 00010000:00010000:1.0:1746065187.707608:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 43 pid: 14645 timeout: 886 lvb_type: 0 00000100:00100000:1.0:1746065187.707621:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7484 00000100:00100000:1.0:1746065187.707627:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+43:1959:x1830881263068672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.707633:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.707636:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 43 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707643:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 43 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707654:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73d600/0x14b4f8542d4fc2cd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60456 expref: 43 pid: 14645 timeout: 886 lvb_type: 0 00010000:00010000:1.0:1746065187.707662:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.707665:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.707670:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.707676:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.707987:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.708007:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+42:1959:x1830881263068672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 380us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.708012:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7484 00010000:00010000:2.0:1746065187.708069:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065187.708075:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000040:00080000:2.0:1746065187.708594:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3056, 88 off258352 00000004:00080000:2.0:1746065187.708601:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786999785409ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.710708:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3085, 88 off261080 00000004:00080000:2.0:1746065187.710718:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787001902068ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065187.710736:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3086, 88 off261168 00000004:00080000:2.0:1746065187.710739:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787001923673ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065187.710751:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3057, 88 off258440 00000004:00080000:2.0:1746065187.710754:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787001938776ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.710773:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3058, 88 off258528 00000004:00080000:2.0:1746065187.710776:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787001960913ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.710784:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3087, 88 off261256 00000004:00080000:2.0:1746065187.710786:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787001971178ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065187.710793:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3088, 88 off261344 00000004:00080000:2.0:1746065187.710795:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787001979806ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065187.710802:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3089, 88 off261432 00000004:00080000:2.0:1746065187.710805:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787001989458ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065187.710811:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3059, 88 off258616 00000004:00080000:2.0:1746065187.710828:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787002012725ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.711245:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3090, 88 off261520 00000004:00080000:2.0:1746065187.711250:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787002434879ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065187.711262:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3060, 88 off258704 00000004:00080000:2.0:1746065187.711264:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787002449169ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.711357:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3091, 88 off261608 00000004:00080000:2.0:1746065187.711361:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787002545370ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065187.711370:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3061, 88 off258792 00000004:00080000:2.0:1746065187.711372:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787002557090ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.711378:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3062, 88 off258880 00000004:00080000:2.0:1746065187.711381:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787002565524ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.711387:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3063, 88 off258968 00000004:00080000:2.0:1746065187.711389:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787002573770ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.711395:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3064, 88 off259056 00000004:00080000:2.0:1746065187.711397:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787002581666ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065187.711403:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3092, 88 off261696 00000004:00080000:2.0:1746065187.711405:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787002589788ns, next at 737095943431ns, rc = 0 00000001:00080000:0.0:1746065187.740110:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944193 is committed 00000001:00080000:0.0:1746065187.740128:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944151 is committed 00000001:00080000:0.0:1746065187.740141:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944195 is committed 00000001:00080000:0.0:1746065187.740150:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944167 is committed 00000001:00080000:0.0:1746065187.740195:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944199 is committed 00000004:00080000:0.0:1746065187.740199:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2374 committed 00000004:00010000:3.0:1746065187.740200:0:14645:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a002bb80 reply state ffff88009457b800 transno 8589944199 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00080000:0.0:1746065187.740206:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2345 committed 00000100:00100000:3.0:1746065187.740211:0:14645:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1746065187.740212:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2344 committed 00000004:00080000:0.0:1746065187.740213:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2343 committed 00000004:00080000:0.0:1746065187.740214:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2342 committed 00000004:00080000:0.0:1746065187.740216:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2373 committed 00000004:00080000:0.0:1746065187.740217:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2341 committed 00000004:00080000:0.0:1746065187.740218:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2372 committed 00000004:00080000:0.0:1746065187.740220:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2340 committed 00000004:00080000:0.0:1746065187.740221:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2371 committed 00000004:00080000:0.0:1746065187.740223:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2370 committed 00000004:00080000:0.0:1746065187.740225:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2369 committed 00000004:00080000:0.0:1746065187.740226:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2339 committed 00000004:00080000:0.0:1746065187.740227:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2338 committed 00000004:00080000:0.0:1746065187.740228:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2368 committed 00000004:00080000:0.0:1746065187.740230:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2367 committed 00000004:00080000:0.0:1746065187.740231:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2337 committed 00010000:00080000:3.0:1746065187.740291:0:14645:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000001:00080000:0.0:1746065187.740297:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944198 is committed 00000001:00080000:0.0:1746065187.740301:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944194 is committed 00000100:00100000:3.0:1746065187.740304:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:31804:x1830881263067904:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 40834us (40933us total) trans 8589944199 rc 0/0 00000100:00100000:3.0:1746065187.740312:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9960 00000100:00100000:3.0:1746065187.740436:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260357248:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746065187.740466:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.740474:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.740480:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.740485:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9b5600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065187.740488:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.740494:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.740508:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065187.740511:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065187.740514:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:0.0:1746065187.740518:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9b5600/0x14b4f8542d4fce42 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065187.740534:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260357504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.740571:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.740595:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260357120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.740604:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260358016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.740619:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.740636:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.740637:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260357632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.740651:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065187.740652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.740655:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260357376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.740669:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.740678:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357504 00000100:00100000:0.0:1746065187.740678:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260357888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.740683:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357504 00000100:00100000:0.0:1746065187.740688:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.740704:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357120 00000100:00100000:2.0:1746065187.740706:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357120 00000100:00100000:0.0:1746065187.740706:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260358016 00000100:00100000:0.0:1746065187.740708:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260358016 00000100:00100000:2.0:1746065187.740714:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357632 00000100:00100000:2.0:1746065187.740716:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357632 00000100:00100000:0.0:1746065187.740722:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357376 00000100:00100000:0.0:1746065187.740723:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357376 00000100:00100000:2.0:1746065187.740724:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357888 00000100:00100000:2.0:1746065187.740725:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357888 00000100:00100000:0.0:1746065187.740735:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14571 00000100:00100000:0.0:1746065187.740740:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3298:x1830881260357504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065187.740908:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065187.740910:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065187.740912:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065187.740914:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065187.740916:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065187.740934:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3298:x1830881260357504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (363us total) trans 21474840873 rc 0/0 00000100:00100000:2.0:1746065187.741238:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14572 00000100:00100000:2.0:1746065187.741244:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881260357120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.741335:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260357120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (715us total) trans 21474840874 rc 0/0 00000100:00100000:2.0:1746065187.741341:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14572 00000100:00100000:2.0:1746065187.741352:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14573 00000100:00100000:2.0:1746065187.741356:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3298:x1830881260358016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.741427:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3298:x1830881260358016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (791us total) trans 21474840875 rc 0/0 00000100:00100000:2.0:1746065187.741431:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14573 00000100:00100000:2.0:1746065187.741443:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14574 00000100:00100000:2.0:1746065187.741447:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830881260357632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.741516:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260357632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (862us total) trans 21474840876 rc 0/0 00000100:00100000:2.0:1746065187.741520:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14574 00000100:00100000:2.0:1746065187.741528:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14575 00000100:00100000:2.0:1746065187.741532:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3298:x1830881260357376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.741602:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3298:x1830881260357376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (932us total) trans 21474840877 rc 0/0 00000100:00100000:2.0:1746065187.741606:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14575 00000100:00100000:2.0:1746065187.741614:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14576 00000100:00100000:2.0:1746065187.741618:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3298:x1830881260357888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065187.741676:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065187.741678:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065187.741680:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065187.741681:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065187.741683:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065187.741697:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3298:x1830881260357888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1008us total) trans 21474840878 rc 0/0 00000100:00100000:2.0:1746065187.741701:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14576 00000100:00100000:2.0:1746065187.741720:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260358400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.741736:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.741750:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260358912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.741760:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.741778:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065187.741782:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801298a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260358528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.741793:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.741799:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260359040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.741808:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.741830:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260358400 00000100:00100000:2.0:1746065187.741833:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260358400 00000100:00100000:2.0:1746065187.741845:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260358912 00000100:00100000:2.0:1746065187.741846:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260358912 00000100:00100000:2.0:1746065187.741852:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260358528 00000100:00100000:2.0:1746065187.741853:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260358528 00000100:00100000:2.0:1746065187.741858:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260359040 00000100:00100000:2.0:1746065187.741859:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260359040 00000100:00100000:2.0:1746065187.741865:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14577 00000100:00100000:2.0:1746065187.741869:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260358400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.741968:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260358400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (231us total) trans 17179873600 rc 0/0 00000100:00100000:2.0:1746065187.741973:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14577 00000100:00100000:2.0:1746065187.741981:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14578 00000100:00100000:2.0:1746065187.741984:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260358912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.742047:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260358912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (287us total) trans 17179873601 rc 0/0 00000100:00100000:2.0:1746065187.742052:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14578 00000100:00100000:2.0:1746065187.742059:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14579 00000100:00100000:2.0:1746065187.742063:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260358528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065187.742114:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065187.742116:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:2.0:1746065187.742118:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:2.0:1746065187.742119:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:2.0:1746065187.742121:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065187.742133:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260358528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (340us total) trans 17179873602 rc 0/0 00000100:00100000:2.0:1746065187.742137:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14579 00000100:00100000:2.0:1746065187.742144:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14580 00000100:00100000:2.0:1746065187.742148:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260359040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.742214:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260359040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (404us total) trans 17179873603 rc 0/0 00000100:00100000:2.0:1746065187.742218:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14580 00000004:00080000:2.0:1746065187.742242:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801298a1c00/2, rc 0, transno 17179873602 00000100:00100000:2.0:1746065187.742246:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801298a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260358528:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065187.742252:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3e300/2, rc 0, transno 17179873603 00000100:00100000:2.0:1746065187.742254:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260359040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065187.742258:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e9a680/2, rc 0, transno 17179873600 00000100:00100000:2.0:1746065187.742261:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260358400:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065187.742265:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3e680/2, rc 0, transno 17179873601 00000100:00100000:2.0:1746065187.742267:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260358912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.742342:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.742355:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260357760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.742366:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.742378:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260358272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.742391:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.742399:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801298a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260358784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.742410:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.742419:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746065187.742423:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260358144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.742436:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.742442:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801298a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260358656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.742453:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.742467:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357248 00000100:00100000:3.0:1746065187.742469:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357248 00000100:00100000:3.0:1746065187.742480:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260357760 00000100:00100000:3.0:1746065187.742482:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260357760 00000100:00100000:3.0:1746065187.742487:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260358272 00000100:00100000:3.0:1746065187.742489:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260358272 00000100:00100000:3.0:1746065187.742493:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260358784 00000100:00100000:3.0:1746065187.742495:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260358784 00000100:00100000:3.0:1746065187.742500:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260358144 00000100:00100000:3.0:1746065187.742501:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260358144 00000100:00100000:3.0:1746065187.742507:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260358656 00000100:00100000:3.0:1746065187.742508:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260358656 00000100:00100000:3.0:1746065187.742515:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14581 00000100:00100000:3.0:1746065187.742519:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260357248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.742601:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260357248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (259us total) trans 21474840879 rc 0/0 00000100:00100000:3.0:1746065187.742606:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14581 00000100:00100000:3.0:1746065187.742615:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14582 00000100:00100000:3.0:1746065187.742619:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260357760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.742686:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260357760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (319us total) trans 21474840880 rc 0/0 00000100:00100000:3.0:1746065187.742691:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14582 00000100:00100000:3.0:1746065187.742699:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14583 00000100:00100000:3.0:1746065187.742703:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260358272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.742784:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260358272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (391us total) trans 17179873604 rc 0/0 00000100:00100000:3.0:1746065187.742788:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14583 00000100:00100000:3.0:1746065187.742796:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14584 00000100:00100000:3.0:1746065187.742799:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260358784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.742886:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260358784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (475us total) trans 17179873605 rc 0/0 00000100:00100000:3.0:1746065187.742891:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14584 00000100:00100000:3.0:1746065187.742900:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14585 00000100:00100000:3.0:1746065187.742903:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260358144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.742970:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130718050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260358144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (532us total) trans 17179873606 rc 0/0 00000100:00100000:3.0:1746065187.742975:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14585 00000100:00100000:3.0:1746065187.742982:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14586 00000100:00100000:3.0:1746065187.742986:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260358656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065187.743043:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065187.743045:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065187.743046:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065187.743048:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065187.743049:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065187.743065:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260358656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (611us total) trans 17179873607 rc 0/0 00000100:00100000:3.0:1746065187.743070:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14586 00000004:00080000:3.0:1746065187.743098:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e9aa00/2, rc 0, transno 17179873606 00000100:00100000:3.0:1746065187.743101:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260358144:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065187.743107:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801298a2680/2, rc 0, transno 17179873607 00000100:00100000:3.0:1746065187.743109:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801298a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260358656:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065187.743114:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e9ad80/2, rc 0, transno 17179873604 00000100:00100000:3.0:1746065187.743116:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260358272:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065187.743121:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801298a2a00/2, rc 0, transno 17179873605 00000100:00100000:3.0:1746065187.743123:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801298a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260358784:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065187.743129:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46ad80/2, rc 0, transno 21474840879 00000100:00100000:3.0:1746065187.743136:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260357248:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065187.743142:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095352300/2, rc 0, transno 21474840880 00000100:00100000:3.0:1746065187.743144:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260357760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.743178:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065187.743183:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260359168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.743199:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.743215:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260359168 00000100:00100000:3.0:1746065187.743217:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260359168 00000100:00100000:3.0:1746065187.743231:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14587 00000100:00100000:3.0:1746065187.743235:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260359168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.743310:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3296:x1830881260359168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (109us total) trans 21474840881 rc 0/0 00000100:00100000:3.0:1746065187.743315:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14587 00000004:00080000:3.0:1746065187.743332:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130445f80/2, rc 0, transno 21474840881 00000100:00100000:3.0:1746065187.743334:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260359168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065187.743779:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f469f80/2, rc 0, transno 21474840874 00000100:00100000:1.0:1746065187.743783:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260357120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065187.743789:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46a680/2, rc 0, transno 21474840876 00000100:00100000:1.0:1746065187.743791:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260357632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.744153:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14571 00000100:00100000:2.0:1746065187.744476:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:2.0:1746065187.744501:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f469500/2, rc 0, transno 21474840877 00000100:00100000:2.0:1746065187.744504:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260357376:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065187.744511:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4e8a80/2, rc 0, transno 21474840878 00000100:00100000:2.0:1746065187.744513:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260357888:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065187.744519:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46a300/2, rc 0, transno 21474840873 00000100:00100000:2.0:1746065187.744521:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260357504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065187.744528:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4ebb80/2, rc 0, transno 21474840875 00000100:00100000:2.0:1746065187.744530:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260358016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.744588:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263068928 00000100:00100000:3.0:1746065187.744591:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263068928 00000100:00100000:3.0:1746065187.744619:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9961 00000100:00100000:3.0:1746065187.744623:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31804:x1830881263068928:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065187.744636:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.744649:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b2c expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.744683:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.744693:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.744706:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.744708:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065187.744712:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982e3000, rc 0) 00000100:00100000:3.0:1746065187.744739:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31804:x1830881263068928:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 115us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.744744:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9961 00000100:00100000:0.0:1746065187.751780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.751837:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263069056 00000100:00100000:1.0:1746065187.751845:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263069056 00000100:00100000:1.0:1746065187.751883:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 759 00000100:00100000:1.0:1746065187.751889:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31804:x1830881263069056:12345-192.168.202.46@tcp:103:mirror_io.0 00010000:00010000:1.0:1746065187.751900:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.751921:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8ab400/0x14b4f8542d4fce03 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b1e expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.751934:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.751937:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.751979:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31804:x1830881263069056:12345-192.168.202.46@tcp:103:mirror_io.0 Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.751984:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 759 00000100:00100000:0.0:1746065187.756643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.756698:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263069312 00000100:00100000:1.0:1746065187.756706:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263069312 00000100:00100000:1.0:1746065187.756759:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4259 00000100:00100000:1.0:1746065187.756778:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31804:x1830881263069312:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065187.757026:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31804:x1830881263069312:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 249us (390us total) trans 8589944200 rc 0/0 00000100:00100000:1.0:1746065187.757033:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4259 00000100:00100000:0.0:1746065187.760079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.760196:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263069568 00000100:00100000:2.0:1746065187.760203:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263069568 00000100:00100000:2.0:1746065187.760338:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4260 00000100:00100000:2.0:1746065187.760346:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31804:x1830881263069568:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065187.760933:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31804:x1830881263069568:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 587us (859us total) trans 8589944201 rc 0/0 00000100:00100000:2.0:1746065187.760940:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4260 00000100:00100000:0.0:1746065187.794032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.795250:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263069824 00000100:00100000:1.0:1746065187.795261:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263069824 00000100:00100000:1.0:1746065187.795322:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9962 00000100:00100000:1.0:1746065187.795329:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:31813:x1830881263069824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.795352:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065187.795366:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aa600/0x14b4f8542d4fce50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b33 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.795460:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.795472:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.795480:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.795490:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.795494:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.795499:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.795593:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.795600:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.795605:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:1.0:1746065187.795612:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065187.796840:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796848:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796857:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796862:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013047c200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065187.796865:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796872:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796883:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065187.796886:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065187.796889:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796893:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c200/0x14b4f8542d4fce57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796922:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796926:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796930:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796934:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013047d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065187.796936:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796940:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796948:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5a36c00) 00010000:00010000:1.0:1746065187.796950:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065187.796952:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.796956:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013047d800/0x14b4f8542d4fce5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065187.796979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065187.796992:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8aa600/0x14b4f8542d4fce50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.797001:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.797006:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.797008:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065187.797009:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013047c600, rc 0) 00000100:00100000:1.0:1746065187.797046:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31813:x1830881263069824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1717us (3023us total) trans 8589944202 rc 0/0 00000100:00100000:1.0:1746065187.797052:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9962 00000100:00100000:1.0:1746065187.797068:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263070080 00000100:00100000:1.0:1746065187.797072:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263070080 00000100:00100000:3.0:1746065187.798000:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9963 00000100:00100000:3.0:1746065187.798010:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+6:31814:x1830881263070080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065187.798024:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.798035:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fce73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b3a expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.798099:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798587:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798595:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798607:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798612:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798618:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798698:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798705:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798710:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065187.798717:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065187.798780:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798786:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798792:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798796:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cca800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065187.798798:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798803:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798810:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065187.798812:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065187.798842:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.798846:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fce7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.799063:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.799069:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.799073:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.799077:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccb800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065187.799079:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.799083:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.799093:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205200) 00010000:00010000:3.0:1746065187.799095:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065187.799098:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.799101:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fce81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.799128:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c732c00/0x14b4f8542d4fce73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.799136:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.799141:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.799143:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065187.799144:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc000, rc 0) 00000100:00100000:3.0:1746065187.799183:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:31814:x1830881263070080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1176us (2205us total) trans 8589944203 rc 0/0 00000100:00100000:3.0:1746065187.799189:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9963 00000100:00100000:0.0:1746065187.800412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.800753:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263070464 00000100:00100000:3.0:1746065187.800771:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263070464 00000100:00100000:3.0:1746065187.800964:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9964 00000100:00100000:3.0:1746065187.800972:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31810:x1830881263070464:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065187.800988:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.801001:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094897200/0x14b4f8542d4fce96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b48 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.801059:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.801069:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.801075:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 7 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.801081:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.801104:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 7 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.801114:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 7 pid: 14645 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065187.801125:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260359296:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.801198:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.801205:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 250 pid: 16767 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065187.801212:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009baa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260359424:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.801228:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.801471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.801505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.801840:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263070336 00000100:00100000:0.0:1746065187.801843:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263070336 00000100:00100000:0.0:1746065187.801861:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263070592 00000100:00100000:0.0:1746065187.801863:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263070592 00000100:00100000:0.0:1746065187.801892:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14588 00000100:00100000:0.0:1746065187.801898:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263070336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065187.801906:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.801916:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b41 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.801918:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14589 00000100:00100000:2.0:1746065187.801925:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263070592:12345-192.168.202.46@tcp:101:cat.0 00002000:00010000:0.0:1746065187.801933:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d724, atime: 0x6812d722, ctime: 0x6812d724, blocks: 0x7a9 00010000:00010000:2.0:1746065187.801938:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.801945:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.801947:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.801948:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b4f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.801954:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 27 pid: 8428 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746065187.801961:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d724, atime: 0x6812d722, ctime: 0x6812d724, blocks: 0x821 00010000:00010000:0.0:1746065187.801966:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 27 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.801969:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.801970:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.801974:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e8400, rc 0) 00010000:00010000:2.0:1746065187.801975:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.801985:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.801992:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c765a00, rc 0) 00000100:00100000:0.0:1746065187.801994:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263070336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 97us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.801999:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14588 00000100:00100000:2.0:1746065187.802009:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263070592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 86us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.802014:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14589 00000100:00100000:1.0:1746065187.802377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.805334:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263070720 00000100:00100000:0.0:1746065187.805344:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263070720 00000100:00100000:0.0:1746065187.805875:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14590 00000100:00100000:0.0:1746065187.805882:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263070720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065187.805897:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.805911:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b56 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065187.805930:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d724, atime: 0x6812d724, ctime: 0x6812d724, blocks: 0x821 00010000:00010000:0.0:1746065187.805946:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.805948:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.805954:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 26 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.805966:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 26 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.805974:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e8000, rc 0) 00000100:00100000:3.0:1746065187.806216:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260359296:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.806225:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009baa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260359424:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.806248:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065187.809002:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263070720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3110us (6615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.809011:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14590 00000100:00100000:2.0:1746065187.809154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.809257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.809284:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.809330:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263070976 00000100:00100000:3.0:1746065187.809337:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263070976 00000100:00100000:3.0:1746065187.809359:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263071232 00000100:00100000:3.0:1746065187.809361:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263071232 00000100:00100000:3.0:1746065187.809372:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14591 00000100:00100000:3.0:1746065187.809378:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263070976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065187.809391:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.809403:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b64 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.809420:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.809422:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.809428:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 24 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.809440:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 24 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.809448:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094897a00, rc 0) 00000100:00100000:3.0:1746065187.809477:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263070976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 100us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.809481:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14591 00000100:00100000:3.0:1746065187.809489:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14592 00000100:00100000:3.0:1746065187.809494:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263071232:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065187.809498:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.809506:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b72 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065187.809522:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d724, atime: 0x6812d723, ctime: 0x6812d724, blocks: 0x821 00010000:00010000:3.0:1746065187.809529:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.809530:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.809533:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.809541:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 21 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.809546:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094896200, rc 0) 00000100:00100000:3.0:1746065187.809556:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263071232:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.809560:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14592 00000100:00100000:2.0:1746065187.810203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.810217:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.810227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.810243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.810252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.810263:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263071744 00000100:00100000:2.0:1746065187.810266:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263071744 00000100:00100000:2.0:1746065187.810279:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263072000 00000100:00100000:2.0:1746065187.810280:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263072000 00000100:00100000:2.0:1746065187.810289:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263070848 00000100:00100000:2.0:1746065187.810290:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263070848 00000100:00100000:2.0:1746065187.810296:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263071104 00000100:00100000:2.0:1746065187.810297:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263071104 00000100:00100000:2.0:1746065187.810304:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263071360 00000100:00100000:2.0:1746065187.810305:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263071360 00000100:00100000:2.0:1746065187.810313:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14593 00000100:00100000:2.0:1746065187.810317:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263071744:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.810323:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.810329:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b87 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.810338:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810339:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810343:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 28 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810351:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 28 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810356:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c764000, rc 0) 00000100:00100000:2.0:1746065187.810370:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263071744:12345-192.168.202.46@tcp:101:cat.0 Request processed in 52us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.810374:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14593 00000100:00100000:2.0:1746065187.810382:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14594 00000100:00100000:2.0:1746065187.810385:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263072000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.810390:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.810396:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b95 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065187.810408:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d723, atime: 0x6812d723, ctime: 0x6812d723, blocks: 0x1029 00010000:00010000:2.0:1746065187.810414:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810415:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810418:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 27 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810425:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 27 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810431:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c765e00, rc 0) 00000100:00100000:2.0:1746065187.810440:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263072000:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.810444:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14594 00000100:00100000:2.0:1746065187.810450:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14595 00000100:00100000:2.0:1746065187.810453:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263070848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.810457:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.810461:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b5d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.810467:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810468:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810471:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810482:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810487:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c765800, rc 0) 00000100:00100000:2.0:1746065187.810495:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263070848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.810498:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14595 00000100:00100000:2.0:1746065187.810503:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14596 00000100:00100000:2.0:1746065187.810506:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263071104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.810510:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.810513:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b6b expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.810520:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810521:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810524:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 25 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810530:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 25 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810535:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c765000, rc 0) 00000100:00100000:2.0:1746065187.810543:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263071104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.810547:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14596 00000100:00100000:2.0:1746065187.810555:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14597 00000100:00100000:2.0:1746065187.810559:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263071360:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065187.810563:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.810570:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b79 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065187.810579:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d724, atime: 0x6812d723, ctime: 0x6812d724, blocks: 0x168b 00010000:00010000:2.0:1746065187.810585:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810586:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.810594:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810601:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.810607:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c764200, rc 0) 00000100:00100000:2.0:1746065187.810618:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263071360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.810622:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14597 00000100:00100000:2.0:1746065187.810644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.810656:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263071488 00000100:00100000:2.0:1746065187.810658:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263071488 00010000:00010000:2.0:1746065187.810672:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 8 pid: 14645 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065187.810690:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263071616 00000100:00100000:2.0:1746065187.810692:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263071616 00010000:00010000:2.0:1746065187.810699:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 251 pid: 16767 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065187.810711:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7485 00000100:00100000:2.0:1746065187.810715:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263071488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.810723:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.810727:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 8 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065187.810735:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 8 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065187.810749:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fce88 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b3a expref: 8 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065187.810776:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.810780:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065187.810828:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7486 00000100:00100000:1.0:1746065187.810835:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881263071616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.810841:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.810845:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 251 pid: 16767 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746065187.810939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.810963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.810973:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263071872 00000100:00100000:0.0:1746065187.810975:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263071872 00000100:00100000:0.0:1746065187.810985:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263072128 00000100:00100000:0.0:1746065187.810986:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263072128 00000100:00100000:0.0:1746065187.810995:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14598 00000100:00100000:0.0:1746065187.810999:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263071872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065187.811005:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.811010:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b8e expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.811019:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.811020:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.811023:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.811031:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.811037:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e9400, rc 0) 00000100:00100000:0.0:1746065187.811050:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263071872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.811054:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14598 00000100:00100000:0.0:1746065187.811065:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14599 00000100:00100000:0.0:1746065187.811068:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263072128:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065187.811073:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.811078:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b80 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.811086:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.811087:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065187.811091:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 26 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.811098:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 26 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065187.811103:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e8600, rc 0) 00000100:00100000:0.0:1746065187.811114:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263072128:12345-192.168.202.46@tcp:101:cat.0 Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.811118:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14599 00010000:00010000:2.0:1746065187.811798:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.811837:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 251 pid: 16767 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065187.811851:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013047c600/0x14b4f8542d4fce65 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b33 expref: 251 pid: 16767 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065187.811870:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.811873:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.811878:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.811883:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065187.811909:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.811929:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1960:x1830881263071616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1095us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.811935:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7486 00010000:00010000:3.0:1746065187.812022:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065187.812029:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065187.812043:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065187.812154:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094897200/0x14b4f8542d4fce96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 251 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.812168:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.812174:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.812177:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065187.812179:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094896400, rc 0) 00000100:00100000:3.0:1746065187.812192:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31810:x1830881263070464:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11221us (11783us total) trans 8589944204 rc 0/0 00000100:00100000:3.0:1746065187.812198:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9964 00010000:00010000:2.0:1746065187.812316:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.812331:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263071488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1614us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.812336:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7485 00000100:00100000:0.0:1746065187.823145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.823399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.823451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.824115:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263072640 00000100:00100000:0.0:1746065187.824122:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263072640 00000100:00100000:0.0:1746065187.824152:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263072256 00000100:00100000:0.0:1746065187.824154:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263072256 00000100:00100000:0.0:1746065187.824163:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263072384 00000100:00100000:0.0:1746065187.824164:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263072384 00000100:00100000:0.0:1746065187.824178:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9965 00000100:00100000:0.0:1746065187.824185:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:31816:x1830881263072640:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065187.824205:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.824219:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e8a00/0x14b4f8542d4fceff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60baa expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.824309:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824320:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824328:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824338:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824343:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824347:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824426:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824433:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824437:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065187.824444:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065187.824508:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824515:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824522:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824527:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e3e9c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065187.824530:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824536:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824546:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065187.824548:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065187.824551:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824554:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824580:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824585:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824590:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824594:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e3e9a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065187.824596:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824600:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824609:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669300) 00010000:00010000:0.0:1746065187.824611:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065187.824613:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824617:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.824646:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e8a00/0x14b4f8542d4fceff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.824654:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.824659:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065187.824661:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065187.824663:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e9000, rc 0) 00000100:00100000:0.0:1746065187.824699:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:31816:x1830881263072640:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 514us (1561us total) trans 8589944205 rc 0/0 00000100:00100000:3.0:1746065187.824841:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9966 00000100:00100000:3.0:1746065187.824849:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+10:31814:x1830881263072256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065187.824856:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.824862:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60b9c expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.824882:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.824890:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.824900:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.824903:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065187.824904:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094897600, rc 0) 00000100:00100000:3.0:1746065187.824919:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:31814:x1830881263072256:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.824925:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9966 00000100:00100000:3.0:1746065187.824941:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9967 00000100:00100000:3.0:1746065187.824946:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31813:x1830881263072384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065187.824953:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.824958:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094896000/0x14b4f8542d4fcf29 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ba3 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.824975:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094896000/0x14b4f8542d4fcf29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ba3 expref: 251 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.824983:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094896000/0x14b4f8542d4fcf29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ba3 expref: 251 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.824992:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.824993:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065187.824995:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094896000, rc 0) 00000100:00100000:3.0:1746065187.825009:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31813:x1830881263072384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.825014:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9967 00000100:00100000:0.0:1746065187.825967:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9965 00000100:00100000:0.0:1746065187.848291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.850067:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263073152 00000100:00100000:2.0:1746065187.850080:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263073152 00002000:00100000:2.0:1746065187.850129:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8801298a1880 x1830881263073152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.850144:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a1880 with x1830881263073152 ext(1048576->2097151) 00002000:00010000:2.0:1746065187.850149:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801298a1880 00000100:00100000:2.0:1746065187.850196:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8205 00000100:00100000:2.0:1746065187.850207:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263073152:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.857065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.857127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.857188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.857242:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263072896 00000100:00100000:0.0:1746065187.857252:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263072896 00002000:00100000:0.0:1746065187.857303:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff8801298a2300 x1830881263072896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.857319:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a2300 with x1830881263072896 ext(0->1048575) 00002000:00010000:0.0:1746065187.857324:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a2300 00000100:00100000:0.0:1746065187.857345:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263073408 00000100:00100000:0.0:1746065187.857349:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263073408 00002000:00100000:0.0:1746065187.857365:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8801298a3800 x1830881263073408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.857372:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a3800 with x1830881263073408 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.857375:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801298a3800 00000100:00100000:0.0:1746065187.857388:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263073664 00000100:00100000:0.0:1746065187.857392:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263073664 00002000:00100000:0.0:1746065187.857406:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8801298a3b80 x1830881263073664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.857412:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a3b80 with x1830881263073664 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.857415:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a3b80 00000100:00100000:0.0:1746065187.857456:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8206 00000100:00100000:0.0:1746065187.857467:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263072896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065187.857965:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8207 00000100:00100000:1.0:1746065187.857974:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263073408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065187.858395:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8208 00000100:00100000:3.0:1746065187.858404:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263073664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065187.861272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.861307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.861321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.861339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.861367:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263073920 00000100:00100000:3.0:1746065187.861374:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263073920 00002000:00100000:3.0:1746065187.861410:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009baa2d80 x1830881263073920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.861426:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2d80 with x1830881263073920 ext(0->1048575) 00002000:00010000:3.0:1746065187.861430:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2d80 00000100:00100000:3.0:1746065187.861447:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263074176 00000100:00100000:3.0:1746065187.861449:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263074176 00002000:00100000:3.0:1746065187.861460:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009baa0000 x1830881263074176/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.861466:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0000 with x1830881263074176 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.861469:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0000 00000100:00100000:3.0:1746065187.861477:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263074560 00000100:00100000:3.0:1746065187.861479:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263074560 00002000:00100000:3.0:1746065187.861486:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009baa2a00 x1830881263074560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.861492:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2a00 with x1830881263074560 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.861494:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa2a00 00000100:00100000:3.0:1746065187.861500:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263074688 00000100:00100000:3.0:1746065187.861502:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263074688 00002000:00100000:3.0:1746065187.861510:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009baa1880 x1830881263074688/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.861515:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1880 with x1830881263074688 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.861517:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1880 00000100:00100000:3.0:1746065187.861526:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8209 00000100:00100000:3.0:1746065187.861533:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881263073920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065187.862033:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8210 00000100:00100000:2.0:1746065187.862042:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881263074176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.862571:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8211 00000100:00100000:0.0:1746065187.862579:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881263074560:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.863665:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8212 00000100:00100000:0.0:1746065187.863674:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1959:x1830881263074688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065187.870066:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263073152:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19853us (21776us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065187.870076:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8205 00002000:00100000:2.0:1746065187.870085:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8801298a1880 x1830881263073152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.870093:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a1880 with x1830881263073152 ext(1048576->2097151) 00002000:00010000:2.0:1746065187.870098:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801298a1880 00000100:00100000:0.0:1746065187.873035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.873574:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263074944 00000100:00100000:2.0:1746065187.873583:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263074944 00000100:00100000:2.0:1746065187.873633:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9968 00000100:00100000:2.0:1746065187.873641:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31810:x1830881263074944:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065187.873658:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065187.873660:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065187.873685:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094896000/0x14b4f8542d4fcf29 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ba3 expref: 251 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.873704:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.873709:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065187.873719:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c764800/0x14b4f8542d4fcf30 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bb1 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.873770:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.873781:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.873788:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.873794:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.873799:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.873845:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.873855:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 9 pid: 16767 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065187.873864:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260359552:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.874480:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.874488:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065187.874495:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260359680:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.875228:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 8 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.875238:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 8 pid: 14645 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065187.875245:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260359808:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.875266:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b6fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065187.875504:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263073408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17530us (18376us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065187.875512:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8207 00002000:00100000:1.0:1746065187.875521:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8801298a3800 x1830881263073408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.875535:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a3800 with x1830881263073408 ext(1048576->2097151) 00002000:00010000:1.0:1746065187.875539:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801298a3800 00000100:00100000:0.0:1746065187.886572:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263073664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28159us (29374us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065187.886587:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8208 00002000:00100000:0.0:1746065187.886598:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8801298a3b80 x1830881263073664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.886608:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a3b80 with x1830881263073664 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.886612:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a3b80 00000100:00100000:0.0:1746065187.890511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.890854:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075072 00000100:00100000:2.0:1746065187.890863:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075072 00010000:00010000:2.0:1746065187.890897:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 10 pid: 16767 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065187.890923:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260359552:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.890924:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7487 00000100:00100000:2.0:1746065187.890930:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881263075072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.890944:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.890949:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 10 pid: 16767 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065187.890959:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 10 pid: 16767 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065187.890979:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3e9000/0x14b4f8542d4fcf14 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60baa expref: 10 pid: 16767 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065187.890999:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065187.891003:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.891010:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065187.891015:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065187.891051:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263075072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 121us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.891058:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7487 00000100:00100000:1.0:1746065187.891698:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260359680:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065187.891775:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260359808:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065187.891800:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065187.891843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.891855:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.891865:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075200 00000100:00100000:1.0:1746065187.891867:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075200 00010000:00010000:1.0:1746065187.891882:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065187.891895:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075328 00000100:00100000:1.0:1746065187.891897:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075328 00010000:00010000:1.0:1746065187.891905:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065187.891917:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7488 00000100:00100000:1.0:1746065187.891922:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263075200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.891929:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.891933:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065187.891943:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065187.891955:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094897600/0x14b4f8542d4fcf22 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b9c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065187.891965:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.891969:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.891974:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.891978:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.891993:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263075200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.891998:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7488 00000100:00100000:1.0:1746065187.892025:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7489 00000100:00100000:1.0:1746065187.892029:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263075328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.892034:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.892038:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065187.892046:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065187.892055:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982e3000/0x14b4f8542d4fce49 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b2c expref: 9 pid: 14645 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065187.892063:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.892066:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.892072:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.892077:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.892090:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.892103:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263075328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.892107:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7489 00010000:00010000:1.0:1746065187.892121:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065187.892126:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000040:00080000:1.0:1746065187.892631:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3065, 88 off259144 00000004:00080000:1.0:1746065187.892637:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787183821048ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892692:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3093, 88 off261784 00000004:00080000:1.0:1746065187.892696:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787183880218ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065187.892734:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3094, 88 off261872 00000004:00080000:1.0:1746065187.892738:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787183922402ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065187.892751:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3066, 88 off259232 00000004:00080000:1.0:1746065187.892754:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787183938248ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892782:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3067, 88 off259320 00000004:00080000:1.0:1746065187.892786:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787183970336ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892793:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3095, 88 off261960 00000004:00080000:1.0:1746065187.892795:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787183980196ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065187.892807:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3096, 88 off262048 00000004:00080000:1.0:1746065187.892810:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787183994388ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065187.892858:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3098, 88 off262232 00000004:00080000:1.0:1746065187.892862:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787184046329ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065187.892876:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3068, 88 off259408 00000004:00080000:1.0:1746065187.892878:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787184063152ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892885:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3099, 88 off262320 00000004:00080000:1.0:1746065187.892888:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787184072309ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065187.892898:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3069, 88 off259496 00000004:00080000:1.0:1746065187.892901:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787184085966ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892907:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3100, 88 off262408 00000004:00080000:1.0:1746065187.892910:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787184094429ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065187.892919:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3070, 88 off259584 00000004:00080000:1.0:1746065187.892922:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787184106854ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892928:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3071, 88 off259672 00000004:00080000:1.0:1746065187.892931:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787184115466ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892940:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3072, 88 off259760 00000004:00080000:1.0:1746065187.892943:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787184127871ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892967:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3073, 88 off259848 00000004:00080000:1.0:1746065187.892970:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787184155214ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065187.892977:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3101, 88 off262496 00000004:00080000:1.0:1746065187.892979:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 787184163939ns, next at 737095943431ns, rc = 0 00000100:00100000:3.0:1746065187.894152:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263072896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36683us (37093us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.894162:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8206 00002000:00100000:3.0:1746065187.894170:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff8801298a2300 x1830881263072896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.894178:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801298a2300 with x1830881263072896 ext(0->1048575) 00002000:00010000:3.0:1746065187.894182:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801298a2300 00000100:00100000:0.0:1746065187.903525:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263074560:12345-192.168.202.46@tcp:3:cat.0 Request processed in 40940us (42195us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065187.903535:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8211 00002000:00100000:0.0:1746065187.903546:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009baa2a00 x1830881263074560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.903555:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2a00 with x1830881263074560 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.903560:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa2a00 00000100:00100000:0.0:1746065187.903904:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263074176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 41862us (42594us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065187.903910:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8210 00002000:00100000:0.0:1746065187.903915:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009baa0000 x1830881263074176/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.903922:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0000 with x1830881263074176 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.903925:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0000 00000100:00100000:0.0:1746065187.911919:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.911944:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075456 00000100:00100000:0.0:1746065187.911951:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075456 00000100:00100000:0.0:1746065187.911988:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9969 00000100:00100000:0.0:1746065187.911993:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31813:x1830881263075456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065187.912009:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.912026:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bb8 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.912068:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.912075:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.912087:0:14644:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065187.912097:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.912107:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065187.912110:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065187.912113:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.912118:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54200, rc 0) 00000100:00100000:0.0:1746065187.912149:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31813:x1830881263075456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 156us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.912154:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9969 00000100:00100000:3.0:1746065187.912534:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263073920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 51000us (51270us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.912540:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8209 00002000:00100000:3.0:1746065187.912548:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009baa2d80 x1830881263073920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.912556:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2d80 with x1830881263073920 ext(0->1048575) 00002000:00010000:3.0:1746065187.912559:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2d80 00000100:00100000:0.0:1746065187.915257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.915281:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075584 00000100:00100000:0.0:1746065187.915289:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075584 00000100:00100000:0.0:1746065187.915318:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9970 00000100:00100000:0.0:1746065187.915324:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:31816:x1830881263075584:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065187.915340:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.915355:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bbf expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.915396:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.915405:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.915415:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065187.915417:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065187.915421:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.915426:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54a00, rc 0) 00000100:00100000:1.0:1746065187.915456:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263074688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 51783us (54115us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065187.915467:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8212 00002000:00100000:1.0:1746065187.915474:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009baa1880 x1830881263074688/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.915482:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1880 with x1830881263074688 ext(1048576->2097151) 00002000:00010000:1.0:1746065187.915486:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1880 00000100:00100000:0.0:1746065187.915878:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:31816:x1830881263075584:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 552us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.915883:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9970 00000001:00080000:0.0:1746065187.921230:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944205 is committed 00000001:00080000:0.0:1746065187.921244:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944206 is committed 00000004:00080000:0.0:1746065187.921247:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2382 committed 00000004:00080000:0.0:1746065187.921253:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2354 committed 00000004:00080000:0.0:1746065187.921258:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2353 committed 00000004:00080000:0.0:1746065187.921259:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2352 committed 00000004:00080000:0.0:1746065187.921261:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2351 committed 00000004:00080000:0.0:1746065187.921263:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2381 committed 00000004:00080000:0.0:1746065187.921264:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2350 committed 00000004:00080000:0.0:1746065187.921266:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2380 committed 00000004:00080000:0.0:1746065187.921267:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2349 committed 00000004:00080000:0.0:1746065187.921268:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2379 committed 00000004:00080000:0.0:1746065187.921270:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2378 committed 00000004:00080000:0.0:1746065187.921271:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2377 committed 00000004:00080000:0.0:1746065187.921272:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2348 committed 00000004:00080000:0.0:1746065187.921274:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2347 committed 00000004:00080000:0.0:1746065187.921275:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2376 committed 00000004:00080000:0.0:1746065187.921276:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2375 committed 00000004:00080000:0.0:1746065187.921277:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2346 committed 00000001:00080000:0.0:1746065187.921282:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944200 is committed 00000001:00080000:0.0:1746065187.921286:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944201 is committed 00010000:00010000:1.0:1746065187.921326:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 251 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.921338:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065187.921341:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065187.921344:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.921352:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.921358:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.921363:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 6 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.921368:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 6 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.921373:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 6 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.921405:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 6 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.921416:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260359936:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065187.921497:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.921503:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a002aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260360064:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065187.921517:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.921557:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065187.921567:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a002b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260360192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065187.921606:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.921624:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260360576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065187.921637:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.921648:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065187.921652:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260360704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065187.921665:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.921676:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260361088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065187.921686:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.921708:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260360192 00000100:00100000:0.0:1746065187.921714:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260360192 00000100:00100000:0.0:1746065187.921738:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260360576 00000100:00100000:0.0:1746065187.921740:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260360576 00000100:00100000:0.0:1746065187.921749:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260360704 00000100:00100000:0.0:1746065187.921750:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260360704 00000100:00100000:0.0:1746065187.921758:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260361088 00000100:00100000:0.0:1746065187.921794:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260361088 00000100:00100000:0.0:1746065187.921808:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14600 00000100:00100000:0.0:1746065187.921829:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3295:x1830881260360192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.921840:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14601 00000100:00100000:3.0:1746065187.921845:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3295:x1830881260360576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065187.921873:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14602 00000100:00100000:0.0:1746065187.921877:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3295:x1830881260360704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065187.921957:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065187.921960:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065187.921962:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065187.921963:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065187.921965:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065187.921990:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260360704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (323us total) trans 17179873608 rc 0/0 00000100:00100000:0.0:1746065187.921995:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14602 00000100:00100000:0.0:1746065187.922011:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14603 00000100:00100000:0.0:1746065187.922015:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881260361088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.922148:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260360320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.922168:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.922181:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260360832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.922193:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.922202:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260361344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.922214:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.922215:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260361088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 200us (528us total) trans 17179873610 rc 0/0 00000100:00100000:0.0:1746065187.922220:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14603 00000100:00100000:2.0:1746065187.922224:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260361856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.922229:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260360320 00000100:00100000:0.0:1746065187.922231:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260360320 00000100:00100000:2.0:1746065187.922235:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.922240:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260360832 00000100:00100000:0.0:1746065187.922241:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260360832 00000100:00100000:2.0:1746065187.922245:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746065187.922247:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260361344 00000100:00100000:2.0:1746065187.922248:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260360448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065187.922248:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260361344 00000100:00100000:0.0:1746065187.922255:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260361856 00000100:00100000:0.0:1746065187.922257:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260361856 00000100:00100000:2.0:1746065187.922260:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.922263:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260360448 00000100:00100000:0.0:1746065187.922264:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260360448 00000100:00100000:2.0:1746065187.922266:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260360960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065187.922271:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14604 00000100:00100000:2.0:1746065187.922275:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.922275:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881260360320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065187.922281:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260361472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.922291:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.922297:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260361984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.922307:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065187.922323:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260360960 00000100:00100000:2.0:1746065187.922325:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260360960 00000100:00100000:2.0:1746065187.922335:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260361472 00000100:00100000:2.0:1746065187.922336:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260361472 00002000:00010000:0.0:1746065187.922338:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065187.922341:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065188 -> 1746065188 00000100:00100000:2.0:1746065187.922342:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260361984 00002000:00010000:0.0:1746065187.922343:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065188 -> 1746065188 00000100:00100000:2.0:1746065187.922344:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260361984 00002000:00010000:0.0:1746065187.922345:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065188 -> 1746065188 00002000:00010000:0.0:1746065187.922347:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065187.922350:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14605 00000100:00100000:2.0:1746065187.922354:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260360832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065187.922365:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260360320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (196us total) trans 17179873611 rc 0/0 00000100:00100000:0.0:1746065187.922370:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14604 00000100:00100000:0.0:1746065187.922379:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14606 00000100:00100000:0.0:1746065187.922383:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260361344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.922426:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260360832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (231us total) trans 17179873612 rc 0/0 00000100:00100000:2.0:1746065187.922430:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14605 00000100:00100000:2.0:1746065187.922440:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14607 00000100:00100000:2.0:1746065187.922443:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260361856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065187.922454:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14608 00000100:00100000:2.0:1746065187.922457:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881260360448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065187.922463:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065187.922465:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065188 -> 1746065188 00002000:00010000:0.0:1746065187.922467:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065187 -> 1746065187 00002000:00010000:0.0:1746065187.922469:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065188 -> 1746065188 00002000:00010000:0.0:1746065187.922470:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065187.922486:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3297:x1830881260361344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (271us total) trans 21474840882 rc 0/0 00000100:00100000:0.0:1746065187.922491:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14606 00000100:00100000:0.0:1746065187.922500:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14609 00000100:00100000:0.0:1746065187.922504:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260360960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065187.922516:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065187.922518:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065187 -> 1746065187 00002000:00010000:2.0:1746065187.922520:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065187 -> 1746065187 00002000:00010000:2.0:1746065187.922522:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065187 -> 1746065187 00002000:00010000:2.0:1746065187.922523:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746065187.922540:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260360448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (278us total) trans 17179873613 rc 0/0 00000100:00100000:2.0:1746065187.922544:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14608 00000100:00100000:2.0:1746065187.922554:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14610 00000100:00100000:2.0:1746065187.922557:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260361472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.922564:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260360960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (288us total) trans 17179873614 rc 0/0 00000100:00100000:0.0:1746065187.922571:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14609 00000100:00100000:0.0:1746065187.922580:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14611 00000100:00100000:0.0:1746065187.922583:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260361984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.922644:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260361216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.922665:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.922677:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260361728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.922691:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.922701:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746065187.922705:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260361600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.922718:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065187.922726:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260362112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.922736:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.922736:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260361216 00000100:00100000:0.0:1746065187.922739:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260361216 00000100:00100000:3.0:1746065187.922748:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260361600 00000100:00100000:0.0:1746065187.922748:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260361728 00000100:00100000:3.0:1746065187.922750:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260361600 00000100:00100000:0.0:1746065187.922750:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260361728 00000100:00100000:0.0:1746065187.922754:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260362112 00000100:00100000:0.0:1746065187.922756:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260362112 00000100:00100000:3.0:1746065187.922772:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14612 00000100:00100000:3.0:1746065187.922776:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260361216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.922777:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14613 00000100:00100000:0.0:1746065187.922780:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260361728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.922786:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14614 00000100:00100000:3.0:1746065187.922789:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260361600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.922789:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14615 00000100:00100000:0.0:1746065187.922793:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260362112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065187.922831:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065187.922833:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065187.922835:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065187.922836:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065187.922838:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065187.922855:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881260360576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1010us (1217us total) trans 17179873609 rc 0/0 00000100:00100000:0.0:1746065187.922860:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14601 00000004:00080000:0.0:1746065187.922887:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133266a00/2, rc 0, transno 17179873610 00000100:00100000:0.0:1746065187.922891:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260361088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065187.922897:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133264000/2, rc 0, transno 17179873608 00000100:00100000:0.0:1746065187.922899:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260360704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065187.922905:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba1f100/2, rc 0, transno 17179873609 00000100:00100000:0.0:1746065187.922907:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260360576:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065187.922966:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065187.922968:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065188 -> 1746065188 00002000:00010000:0.0:1746065187.923060:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065186 -> 1746065186 00002000:00010000:0.0:1746065187.923062:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065188 -> 1746065188 00002000:00010000:0.0:1746065187.923064:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:1.0:1746065187.923080:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd04000/2, rc 0, transno 17179873613 00000100:00100000:1.0:1746065187.923084:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260360448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065187.923089:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133264e00/2, rc 0, transno 17179873614 00000100:00100000:1.0:1746065187.923095:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260360960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065187.923101:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0028000/2, rc 0, transno 17179873611 00000100:00100000:1.0:1746065187.923103:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260360320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065187.923107:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880133267b80/2, rc 0, transno 17179873612 00000100:00100000:1.0:1746065187.923109:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880133267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260360832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065187.923115:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095355500/2, rc 0, transno 21474840882 00000100:00100000:1.0:1746065187.923121:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260361344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065187.923142:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881260360192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1328us (1536us total) trans 17179873615 rc 0/0 00000100:00100000:1.0:1746065187.923147:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14600 00000004:00080000:0.0:1746065187.923163:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a002b100/2, rc 0, transno 17179873615 00000100:00100000:0.0:1746065187.923167:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a002b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260360192:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065187.923173:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260362240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065187.923189:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065187.923201:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260362240 00000100:00100000:0.0:1746065187.923204:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260362240 00000100:00100000:0.0:1746065187.923217:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14616 00000100:00100000:0.0:1746065187.923222:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3296:x1830881260362240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065187.923272:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:2.0:1746065187.923275:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065188 -> 1746065188 00002000:00010000:2.0:1746065187.923276:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065187 -> 1746065187 00002000:00010000:2.0:1746065187.923278:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065188 -> 1746065188 00002000:00010000:2.0:1746065187.923279:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5771 -> 5771 00000100:00100000:2.0:1746065187.923300:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3297:x1830881260361472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 742us (1007us total) trans 21474840883 rc 0/0 00000100:00100000:2.0:1746065187.923305:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14610 00000004:00080000:1.0:1746065187.923353:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095356300/2, rc 0, transno 21474840883 00000100:00100000:1.0:1746065187.923357:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260361472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.923404:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3297:x1830881260361856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 959us (1166us total) trans 21474840885 rc 0/0 00000100:00100000:0.0:1746065187.923409:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14607 00000004:00080000:1.0:1746065187.923473:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fe680/2, rc 0, transno 21474840885 00000100:00100000:1.0:1746065187.923477:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260361856:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065187.923533:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065187.923536:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065187.923537:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065187.923539:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065187.923540:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065187.923559:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881260361984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 975us (1251us total) trans 21474840884 rc 0/0 00000100:00100000:2.0:1746065187.923564:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14611 00000100:00100000:0.0:1746065187.923606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.923619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.923650:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260359936:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065187.923651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.923657:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a002aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260360064:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065187.923665:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075840 00000100:00100000:0.0:1746065187.923668:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075840 00010000:00010000:1.0:1746065187.923682:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c764800/0x14b4f8542d4fcf30 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 251 pid: 16767 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746065187.923685:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9971 00000100:00100000:0.0:1746065187.923689:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+7:31814:x1830881263075840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065187.923696:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065187.923697:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065187.923706:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcf4c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bc6 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.923717:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c765c00, rc 0) 00010000:00010000:0.0:1746065187.923731:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcf4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bc6 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.923737:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31810:x1830881263074944:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 50099us (50711us total) trans 8589944206 rc 0/0 00010000:00010000:0.0:1746065187.923740:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcf4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bc6 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.923742:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9968 00010000:00010000:0.0:1746065187.923749:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065187.923752:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065187.923754:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129b54600, rc 0) 00000100:00100000:1.0:1746065187.923757:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075712 00000100:00100000:1.0:1746065187.923772:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075712 00000100:00100000:0.0:1746065187.923804:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:31814:x1830881263075840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065187.923808:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9971 00002000:00010000:3.0:1746065187.923882:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065187.923884:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065188 -> 1746065188 00002000:00010000:3.0:1746065187.923886:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065186 -> 1746065186 00002000:00010000:3.0:1746065187.923888:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065188 -> 1746065188 00002000:00010000:3.0:1746065187.923889:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1961 -> 1961 00000100:00100000:3.0:1746065187.923910:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260361216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1134us (1244us total) trans 21474840886 rc 0/0 00000100:00100000:3.0:1746065187.923915:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14612 00000100:00100000:3.0:1746065187.924003:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260361728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1221us (1311us total) trans 21474840887 rc 0/0 00000100:00100000:3.0:1746065187.924008:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14613 00000004:00080000:3.0:1746065187.924028:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095357100/2, rc 0, transno 21474840886 00000100:00100000:3.0:1746065187.924031:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260361216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065187.924036:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fd500/2, rc 0, transno 21474840887 00000100:00100000:3.0:1746065187.924038:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260361728:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065187.924104:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065187.924106:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065187.924108:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065187.924109:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065187.924111:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065187.924129:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3296:x1830881260361600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1339us (1410us total) trans 21474840888 rc 0/0 00000100:00100000:3.0:1746065187.924134:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14614 00000004:00080000:3.0:1746065187.924152:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fea00/2, rc 0, transno 21474840888 00000100:00100000:3.0:1746065187.924154:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260361600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.924168:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3296:x1830881260362240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 946us (977us total) trans 21474840890 rc 0/0 00000100:00100000:0.0:1746065187.924173:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14616 00000004:00080000:3.0:1746065187.924179:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e9b480/2, rc 0, transno 21474840890 00000100:00100000:3.0:1746065187.924182:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260362240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.924209:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260362112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1415us (1471us total) trans 21474840889 rc 0/0 00000100:00100000:0.0:1746065187.924213:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14615 00000100:00100000:1.0:1746065187.924224:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263075968 00000100:00100000:1.0:1746065187.924227:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263075968 00000100:00100000:1.0:1746065187.924239:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4261 00000100:00100000:1.0:1746065187.924244:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:31816:x1830881263075712:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:1.0:1746065187.924288:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:31816:x1830881263075712:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 44us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.924293:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4261 00000100:00100000:1.0:1746065187.924302:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4262 00000100:00100000:1.0:1746065187.924307:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31813:x1830881263075968:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:1.0:1746065187.924336:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31813:x1830881263075968:12345-192.168.202.46@tcp:49:cat.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.924341:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4262 00000004:00080000:1.0:1746065187.924374:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fdf80/2, rc 0, transno 21474840884 00000100:00100000:1.0:1746065187.924377:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260361984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065187.924572:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fe300/2, rc 0, transno 21474840889 00000100:00100000:3.0:1746065187.924575:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260362112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065187.924783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.924876:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263076224 00000100:00100000:3.0:1746065187.924879:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263076224 00000100:00100000:3.0:1746065187.924953:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4263 00000100:00100000:3.0:1746065187.924960:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31810:x1830881263076224:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:3.0:1746065187.924998:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31810:x1830881263076224:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.925002:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4263 00000100:00100000:0.0:1746065187.925105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.925157:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263076096 00000100:00100000:3.0:1746065187.925161:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263076096 00000100:00100000:3.0:1746065187.925184:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4264 00000100:00100000:3.0:1746065187.925189:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:31814:x1830881263076096:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:3.0:1746065187.925221:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:31814:x1830881263076096:12345-192.168.202.46@tcp:49:cat.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.925229:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4264 00000100:00100000:0.0:1746065187.928898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.929256:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263076352 00000100:00100000:3.0:1746065187.929262:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263076352 00000100:00100000:3.0:1746065187.929300:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 760 00000100:00100000:3.0:1746065187.929306:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263076352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.929315:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.929332:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54600/0x14b4f8542d4fcf4c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bc6 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.929367:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065187.929371:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.929486:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:1961:x1830881263076352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 179us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.929491:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 760 00000100:00100000:0.0:1746065187.934307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.934332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.934520:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263076480 00000100:00100000:2.0:1746065187.934528:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263076480 00000100:00100000:2.0:1746065187.934571:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263076608 00000100:00100000:2.0:1746065187.934574:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263076608 00000100:00100000:2.0:1746065187.934590:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14617 00000100:00100000:2.0:1746065187.934596:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:31816:x1830881263076480:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:3.0:1746065187.934604:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14618 00000100:00100000:3.0:1746065187.934611:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:31810:x1830881263076608:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065187.934611:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.934617:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.934624:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bd4 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.934624:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bcd expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.934646:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 22 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.934646:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.934654:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.934655:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.934659:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.934660:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065187.934663:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1638400->2097151] (req 1638400->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.934664:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.934665:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.934668:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3465216->4009983] (req 3465216->4009983) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.934684:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 30 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.934684:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.934694:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 30 pid: 9716 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065187.934694:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.934703:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260362496:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065187.934705:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260362368:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.935119:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065187.935127:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 26 pid: 8427 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065187.935135:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260362624:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.935167:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 22 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.935175:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 22 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.935181:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260362752:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.935193:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065187.935326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.935408:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263076864 00000100:00100000:1.0:1746065187.935411:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263076864 00000100:00100000:2.0:1746065187.935432:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbbc00 going to sleep for 11 seconds 00002000:00100000:1.0:1746065187.935435:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008fd70700 x1830881263076864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.935443:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70700 with x1830881263076864 ext(1048576->2097151) 00010000:00010000:1.0:1746065187.935448:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 28 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746065187.935456:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 28 pid: 8427 timeout: 887 lvb_type: 1 00002000:00010000:1.0:1746065187.935461:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd70700 00000100:00100000:1.0:1746065187.935767:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2507 00000100:00100000:1.0:1746065187.935776:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+28:1958:x1830881263076864:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065187.936225:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260362368:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065187.937711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.937727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.937913:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260362624:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065187.937938:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1638400->2097151] (req 1638400->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065187.937952:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcc9800, rc 0) 00000100:00100000:2.0:1746065187.937994:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+29:31816:x1830881263076480:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3396us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.938001:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14617 00000100:00100000:3.0:1746065187.938084:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263077120 00000100:00100000:3.0:1746065187.938089:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263077120 00010000:00010000:3.0:1746065187.938111:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 23 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.938133:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263076992 00000100:00100000:3.0:1746065187.938135:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263076992 00010000:00010000:3.0:1746065187.938144:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 31 pid: 9716 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.938155:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7490 00000100:00100000:3.0:1746065187.938159:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263077120:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.938168:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.938186:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 23 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065187.938195:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 23 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065187.938212:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.938229:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263077120:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.938235:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7490 00000100:00100000:3.0:1746065187.938245:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7491 00000100:00100000:3.0:1746065187.938249:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263076992:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065187.938255:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065187.938262:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 31 pid: 9716 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065187.938275:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 31 pid: 9716 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065187.938284:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.938286:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.938291:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.938297:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.938317:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065187.938325:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260362880:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065187.938368:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065187.938388:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9400/0x14b4f8542d4fceea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b8e expref: 31 pid: 9716 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.938399:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260362496:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.938408:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c764200/0x14b4f8542d4fcee3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b79 expref: 22 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.938415:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260362752:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.938430:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.938438:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bf400, rc 0) 00000100:00100000:3.0:1746065187.938452:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31810:x1830881263076608:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3843us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.938457:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14618 00000100:00100000:0.0:1746065187.940400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.940506:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263077376 00000100:00100000:3.0:1746065187.940512:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263077376 00002000:00100000:3.0:1746065187.940543:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f9cf480 x1830881263077376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.940551:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf480 with x1830881263077376 ext(1048576->2097151) 00010000:00010000:3.0:1746065187.940558:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065187.940568:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00002000:00010000:3.0:1746065187.940574:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cf480 00000100:00100000:3.0:1746065187.940600:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2508 00000100:00100000:3.0:1746065187.940606:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263077376:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065187.942386:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881263076864:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6606us (7055us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065187.942394:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2507 00002000:00100000:1.0:1746065187.942401:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008fd70700 x1830881263076864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.942414:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70700 with x1830881263076864 ext(1048576->2097151) 00010000:00010000:1.0:1746065187.942421:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746065187.942430:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00002000:00010000:1.0:1746065187.942436:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fd70700 00000100:00100000:0.0:1746065187.943037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.943700:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263077632 00000100:00100000:1.0:1746065187.943706:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263077632 00002000:00100000:1.0:1746065187.943733:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3465216->3469311) req@ffff88009f9cd180 x1830881263077632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.943742:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd180 with x1830881263077632 ext(3465216->3469311) 00002000:00010000:1.0:1746065187.943746:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cd180 00000100:00100000:1.0:1746065187.943776:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8213 00000100:00100000:1.0:1746065187.943783:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263077632:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065187.943853:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260362880:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065187.943868:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065187.943892:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263076992:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5642us (6163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065187.943899:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7491 00000100:00100000:1.0:1746065187.943912:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263077632:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 129us (875us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065187.943918:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8213 00002000:00100000:1.0:1746065187.943923:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3465216->3469311) req@ffff88009f9cd180 x1830881263077632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065187.943930:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd180 with x1830881263077632 ext(3465216->3469311) 00002000:00010000:1.0:1746065187.943933:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cd180 00000100:00100000:3.0:1746065187.951115:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263077376:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10489us (10700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.951126:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2508 00002000:00100000:3.0:1746065187.951137:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f9cf480 x1830881263077376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.951145:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf480 with x1830881263077376 ext(1048576->2097151) 00010000:00010000:3.0:1746065187.951154:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065187.951165:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00002000:00010000:3.0:1746065187.951170:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f9cf480 00000100:00100000:0.0:1746065187.953995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.954212:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263077888 00000100:00100000:3.0:1746065187.954220:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263077888 00000100:00100000:0.0:1746065187.954224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.954268:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263078016 00000100:00100000:2.0:1746065187.954272:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263078016 00010000:00010000:2.0:1746065187.954292:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746065187.954294:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.954317:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7492 00000100:00100000:2.0:1746065187.954324:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263078016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065187.954340:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065187.954368:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00002000:00100000:3.0:1746065187.954375:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4005888->4009983) req@ffff880130444700 x1830881263077888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746065187.954379:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00002000:00100000:3.0:1746065187.954383:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444700 with x1830881263077888 ext(4005888->4009983) 00002000:00010000:3.0:1746065187.954387:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130444700 00010000:00010000:2.0:1746065187.954398:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094897a00/0x14b4f8542d4fceb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b64 expref: 27 pid: 8427 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.954410:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263078272 00000100:00100000:3.0:1746065187.954413:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263078272 00010000:00010000:2.0:1746065187.954416:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065187.954424:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8801350f8380 x1830881263078272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.954429:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8380 with x1830881263078272 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.954432:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350f8380 00000100:00100000:3.0:1746065187.954441:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8214 00000100:00100000:3.0:1746065187.954447:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263077888:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065187.954450:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263078016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 127us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065187.954455:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7492 00000100:00100000:0.0:1746065187.954532:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8215 00000100:00100000:0.0:1746065187.954538:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263078272:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065187.956644:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263077888:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 2188us (2648us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065187.956653:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8214 00002000:00100000:3.0:1746065187.956661:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4005888->4009983) req@ffff880130444700 x1830881263077888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.956670:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444700 with x1830881263077888 ext(4005888->4009983) 00002000:00010000:3.0:1746065187.956674:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130444700 00000100:00100000:1.0:1746065187.965199:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.965507:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.965557:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263078528 00000100:00100000:3.0:1746065187.965566:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263078528 00000100:00100000:0.0:1746065187.965585:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263078784 00000100:00100000:0.0:1746065187.965589:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263078784 00002000:00100000:3.0:1746065187.965603:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880133265180 x1830881263078528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.965609:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880133267800 x1830881263078784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.965611:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133265180 with x1830881263078528 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.965615:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133265180 00002000:00100000:0.0:1746065187.965616:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133267800 with x1830881263078784 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.965619:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133267800 00000100:00100000:3.0:1746065187.965634:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8216 00000100:00100000:3.0:1746065187.965640:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263078528:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065187.965647:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8217 00000100:00100000:0.0:1746065187.965652:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263078784:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065187.967799:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263078272:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13255us (13497us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065187.967808:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8215 00002000:00100000:0.0:1746065187.967832:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8801350f8380 x1830881263078272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.967840:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8380 with x1830881263078272 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.967844:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350f8380 00000100:00100000:0.0:1746065187.971150:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065187.971495:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263078912 00000100:00100000:1.0:1746065187.971503:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263078912 00010000:00010000:1.0:1746065187.971533:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 29 pid: 8427 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746065187.971568:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7493 00000100:00100000:1.0:1746065187.971574:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263078912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065187.971584:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065187.971603:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 29 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746065187.971613:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 29 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746065187.971630:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c765a00/0x14b4f8542d4fceab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b4f expref: 29 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:1.0:1746065187.971646:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.971648:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065187.971654:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.971660:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065187.971686:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065187.971696:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801298a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260363008:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065187.971778:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065187.974767:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263078528:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 9106us (9555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.974779:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8216 00002000:00100000:3.0:1746065187.974791:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880133265180 x1830881263078528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.974799:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133265180 with x1830881263078528 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.974804:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133265180 00000100:00100000:1.0:1746065187.976201:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801298a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260363008:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065187.976220:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065187.976256:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263078912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4681us (5114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.976264:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7493 00000100:00100000:0.0:1746065187.978208:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.978241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.978590:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263078784:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12935us (13081us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065187.978598:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8217 00002000:00100000:0.0:1746065187.978609:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880133267800 x1830881263078784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.978618:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133267800 with x1830881263078784 ext(1048576->2097151) 00002000:00010000:0.0:1746065187.978622:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880133267800 00000100:00100000:3.0:1746065187.978644:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263079424 00000100:00100000:0.0:1746065187.978644:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263079168 00000100:00100000:3.0:1746065187.978650:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263079424 00000100:00100000:0.0:1746065187.978650:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263079168 00002000:00100000:3.0:1746065187.978722:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8801350f8e00 x1830881263079424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.978730:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8e00 with x1830881263079424 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.978734:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f8e00 00000100:00100000:3.0:1746065187.978748:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8218 00000100:00100000:3.0:1746065187.978754:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263079424:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:0.0:1746065187.979181:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1638400->1642495) req@ffff8801350f8a80 x1830881263079168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.979189:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8a80 with x1830881263079168 ext(1638400->1642495) 00002000:00010000:0.0:1746065187.979193:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350f8a80 00000100:00100000:0.0:1746065187.979206:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8219 00000100:00100000:0.0:1746065187.979212:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263079168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.979316:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263079168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 104us (1113us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065187.979322:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8219 00002000:00100000:0.0:1746065187.979327:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1638400->1642495) req@ffff8801350f8a80 x1830881263079168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/4536 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.979333:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8a80 with x1830881263079168 ext(1638400->1642495) 00002000:00010000:0.0:1746065187.979336:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350f8a80 00000100:00100000:0.0:1746065187.986479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.986589:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263079552 00000100:00100000:3.0:1746065187.986597:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263079552 00000100:00100000:3.0:1746065187.986642:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14619 00000100:00100000:3.0:1746065187.986649:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+26:31816:x1830881263079552:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065187.986665:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065187.986679:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bdb expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.986704:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.986711:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 27 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.986717:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.986718:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065187.986721:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->1376255] (req 1048576->1376255) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065187.986751:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 27 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.986772:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 27 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.986782:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260363136:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065187.986892:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065187.986899:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 25 pid: 21998 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065187.986907:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260363264:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.986923:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065187.991286:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263079424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12522us (13034us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065187.991297:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8218 00002000:00100000:3.0:1746065187.991307:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8801350f8e00 x1830881263079424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065187.991315:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8e00 with x1830881263079424 ext(1048576->2097151) 00002000:00010000:3.0:1746065187.991320:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f8e00 00000100:00100000:0.0:1746065187.992381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.992411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065187.992413:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260363136:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065187.992423:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260363264:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065187.992435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065187.992441:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263079808 00010000:00010000:3.0:1746065187.992443:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->1376255] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065187.992447:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263079808 00010000:00010000:3.0:1746065187.992457:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e9c00, rc 0) 00000100:00100000:0.0:1746065187.992457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:2.0:1746065187.992474:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff8801350f9500 x1830881263079808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065187.992474:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263080064 00000100:00100000:3.0:1746065187.992479:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:31816:x1830881263079552:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5831us (6008us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065187.992479:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263080064 00000100:00100000:0.0:1746065187.992480:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263080320 00002000:00100000:2.0:1746065187.992481:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f9500 with x1830881263079808 ext(2097152->3145727) 00000100:00100000:0.0:1746065187.992483:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263080320 00002000:00010000:2.0:1746065187.992484:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f9500 00000100:00100000:3.0:1746065187.992485:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14619 00002000:00100000:1.0:1746065187.992497:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8801350f9880 x1830881263080064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 504/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.992500:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff8801350f9c00 x1830881263080320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065187.992501:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263080576 00000100:00100000:2.0:1746065187.992503:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263080576 00002000:00100000:1.0:1746065187.992505:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f9880 with x1830881263080064 ext(3145728->4194303) 00002000:00100000:0.0:1746065187.992506:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f9c00 with x1830881263080320 ext(2097152->3145727) 00002000:00010000:1.0:1746065187.992508:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f9880 00002000:00010000:0.0:1746065187.992509:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350f9c00 00002000:00100000:2.0:1746065187.992513:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8801350f9f80 x1830881263080576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/0 e 0 to 0 dl 1746065198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065187.992519:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f9f80 with x1830881263080576 ext(3145728->4194303) 00002000:00010000:2.0:1746065187.992521:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350f9f80 00000100:00100000:1.0:1746065187.992521:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8220 00000100:00100000:0.0:1746065187.992531:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8221 00000100:00100000:0.0:1746065187.992537:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263080064:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065187.992540:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8222 00000100:00100000:1.0:1746065187.992544:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8223 00000100:00100000:2.0:1746065187.992545:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263080320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065187.992550:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263080576:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065187.993651:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263079808:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065187.999261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.999300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065187.999512:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263080064:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6973us (7098us total) trans 0 rc 503808/503808 00000100:00100000:0.0:1746065187.999520:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8221 00002000:00100000:0.0:1746065187.999535:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8801350f9880 x1830881263080064/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 504/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 503808/503808 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065187.999543:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f9880 with x1830881263080064 ext(3145728->4194303) 00002000:00010000:0.0:1746065187.999548:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f9880 00000100:00100000:2.0:1746065187.999627:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263080704 00000100:00100000:2.0:1746065187.999636:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263080704 00010000:00010000:2.0:1746065187.999667:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 30 pid: 21998 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065187.999689:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263080832 00000100:00100000:2.0:1746065187.999691:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263080832 00010000:00010000:2.0:1746065187.999701:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 27 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.000062:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7494 00000100:00100000:2.0:1746065188.000076:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263080704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1746065188.000090:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746065188.000099:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.000117:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 30 pid: 21998 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.000126:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 30 pid: 21998 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.000146:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8000/0x14b4f8542d4fceb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b56 expref: 30 pid: 21998 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.000162:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.000196:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263080704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 127us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.000202:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7494 00000100:00100000:2.0:1746065188.000237:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7495 00000100:00100000:2.0:1746065188.000242:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263080832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.000248:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.000255:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 27 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.000268:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 27 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.000279:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c765000/0x14b4f8542d4fcedc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b6b expref: 27 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.000286:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.000288:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.000293:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.000301:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.000326:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.000336:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260363392:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.000379:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.000746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.000918:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263080960 00000100:00100000:3.0:1746065188.000923:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263080960 00000100:00100000:3.0:1746065188.000951:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14620 00000100:00100000:3.0:1746065188.000957:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263080960:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.000968:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.000978:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fcf68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60be2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.001002:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260363520:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065188.002082:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.006196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065188.006311:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065188.006340:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260363392:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.006456:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.006458:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260363520:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065188.006479:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fcf68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60be2 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.006489:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8c00/0x14b4f8542d4fcf68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60be2 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065188.006494:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263080832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6252us (7192us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065188.006505:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e8c00, rc 0) 00000100:00100000:2.0:1746065188.006505:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7495 00000100:00100000:3.0:1746065188.006522:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263080960:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5566us (5776us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065188.006526:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14620 00000100:00100000:3.0:1746065188.006536:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263081088 00000100:00100000:3.0:1746065188.006540:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263081088 00000100:00100000:3.0:1746065188.006560:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14621 00000100:00100000:3.0:1746065188.006565:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263081088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.006576:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.006586:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60be9 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.006623:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260363648:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065188.006684:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065188.007376:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263080576:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14823us (14915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065188.007383:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8223 00002000:00100000:1.0:1746065188.007391:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8801350f9f80 x1830881263080576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.007405:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f9f80 with x1830881263080576 ext(3145728->4194303) 00002000:00010000:1.0:1746065188.007409:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350f9f80 00000100:00100000:0.0:1746065188.012227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.012387:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263081344 00000100:00100000:1.0:1746065188.012395:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263081344 00002000:00100000:1.0:1746065188.012433:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1372160->1376255) req@ffff8801350faa00 x1830881263081344/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.012442:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350faa00 with x1830881263081344 ext(1372160->1376255) 00002000:00010000:1.0:1746065188.012446:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350faa00 00000100:00100000:1.0:1746065188.012462:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8224 00000100:00100000:1.0:1746065188.012468:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263081344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.012600:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263081344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 131us (381us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065188.012606:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8224 00002000:00100000:1.0:1746065188.012611:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1372160->1376255) req@ffff8801350faa00 x1830881263081344/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.012616:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350faa00 with x1830881263081344 ext(1372160->1376255) 00002000:00010000:1.0:1746065188.012618:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350faa00 00000100:00100000:2.0:1746065188.013379:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881263080320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20832us (20941us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.013386:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8222 00002000:00100000:2.0:1746065188.013392:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff8801350f9c00 x1830881263080320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.013398:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f9c00 with x1830881263080320 ext(2097152->3145727) 00002000:00010000:2.0:1746065188.013402:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801350f9c00 00002000:00010000:3.0:1746065188.015014:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065187 -> 1746065188 00000100:00100000:3.0:1746065188.015034:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260363648:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065188.015061:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf6f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60be9 expref: 23 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.015073:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e9a00/0x14b4f8542d4fcf6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60be9 expref: 23 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.015082:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e9a00, rc 0) 00000100:00100000:3.0:1746065188.015122:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263081088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8556us (8934us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065188.015129:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14621 00000100:00100000:0.0:1746065188.017841:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.018101:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263081600 00000100:00100000:3.0:1746065188.018109:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263081600 00000100:00100000:3.0:1746065188.018155:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4265 00000100:00100000:3.0:1746065188.018162:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+7:31816:x1830881263081600:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065188.018371:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:31816:x1830881263081600:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 205us (531us total) trans 8589944207 rc 0/0 00000100:00100000:3.0:1746065188.018377:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4265 00000100:00100000:0.0:1746065188.018418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.018691:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263079808:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26162us (26311us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065188.018698:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8220 00002000:00100000:1.0:1746065188.018710:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff8801350f9500 x1830881263079808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:103/0 lens 488/440 e 0 to 0 dl 1746065198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.018718:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f9500 with x1830881263079808 ext(2097152->3145727) 00002000:00010000:1.0:1746065188.018723:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f9500 00000100:00100000:3.0:1746065188.019093:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263081728 00000100:00100000:3.0:1746065188.019097:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263081728 00000100:00100000:3.0:1746065188.019213:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14622 00000100:00100000:3.0:1746065188.019219:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+22:31814:x1830881263081728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.019649:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.019662:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bf0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.019684:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.019690:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065188.019691:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065188.019694:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.019716:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.019729:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 28 pid: 8429 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.019739:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260363776:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065188.020910:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.026608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.026652:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260363776:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.026678:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.026693:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e8e00, rc 0) 00000100:00100000:3.0:1746065188.026736:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+23:31814:x1830881263081728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7516us (8317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.026743:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14622 00000100:00100000:3.0:1746065188.027233:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263081856 00000100:00100000:3.0:1746065188.027239:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263081856 00000100:00100000:3.0:1746065188.027597:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14623 00000100:00100000:3.0:1746065188.027603:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881263081856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.027616:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.027633:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9200/0x14b4f8542d4fcf7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bf7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065188.027667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.027669:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260363904:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065188.027802:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263081984 00000100:00100000:2.0:1746065188.027806:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263081984 00000100:00100000:3.0:1746065188.027883:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.028490:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14624 00000100:00100000:2.0:1746065188.028497:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263081984:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.028506:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.028516:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdca200/0x14b4f8542d4fcf84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60bfe expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.028541:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260364032:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065188.028567:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.029681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.029707:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263082112 00000100:00100000:1.0:1746065188.029713:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263082112 00002000:00010000:2.0:1746065188.029773:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065186 -> 1746065188 00000100:00100000:2.0:1746065188.029795:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260363904:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065188.029835:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9200/0x14b4f8542d4fcf7d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf7 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.029847:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9200/0x14b4f8542d4fcf7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf7 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.029869:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3e9200, rc 0) 00000100:00100000:2.0:1746065188.029901:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263081856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2298us (3303us total) trans 0 rc 301/301 00000100:00080000:1.0:1746065188.029963:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1746065188.029989:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3465216->4009983) req@ffff88012e8b6d80 x1830881263082112/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.029997:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6d80 with x1830881263082112 ext(3465216->4009983) 00010000:00010000:1.0:1746065188.030004:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 29 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065188.030014:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 29 pid: 8429 timeout: 887 lvb_type: 0 00002000:00010000:1.0:1746065188.030020:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b6d80 00000100:00100000:1.0:1746065188.030035:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2509 00000100:00100000:1.0:1746065188.030041:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263082112:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065188.030473:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14623 00000100:00100000:2.0:1746065188.030509:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260364032:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065188.030523:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdca200/0x14b4f8542d4fcf84 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bfe expref: 26 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.030531:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdca200/0x14b4f8542d4fcf84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bfe expref: 26 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.030537:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdca200, rc 0) 00000100:00100000:2.0:1746065188.030554:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881263081984:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2058us (2887us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065188.030559:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14624 00000100:00100000:3.0:1746065188.034201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.034801:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263082240 00000100:00100000:2.0:1746065188.034809:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263082240 00000100:00100000:2.0:1746065188.035319:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14625 00000100:00100000:2.0:1746065188.035327:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31813:x1830881263082240:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.035342:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.035355:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c05 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.035375:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.035377:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.035381:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.035391:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.035400:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdca400, rc 0) 00000100:00100000:2.0:1746065188.035435:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31813:x1830881263082240:12345-192.168.202.46@tcp:101:cat.0 Request processed in 109us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.035440:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14625 00000100:00100000:1.0:1746065188.036934:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881263082112:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6885us (7249us total) trans 21474840891 rc 0/0 00000100:00100000:1.0:1746065188.036943:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2509 00002000:00100000:1.0:1746065188.036950:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3465216->4009983) req@ffff88012e8b6d80 x1830881263082112/t21474840891(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.036959:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6d80 with x1830881263082112 ext(3465216->4009983) 00010000:00010000:1.0:1746065188.036966:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 32 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065188.036976:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 32 pid: 8429 timeout: 887 lvb_type: 0 00002000:00010000:1.0:1746065188.037492:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b6d80 00000100:00100000:0.0:1746065188.042024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.042085:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263082368 00000100:00100000:2.0:1746065188.042094:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263082368 00010000:00010000:2.0:1746065188.042125:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 32 pid: 8429 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.042577:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7496 00000100:00100000:2.0:1746065188.042585:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1959:x1830881263082368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.042597:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.042617:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 32 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.042628:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 32 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.042649:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fcf5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3465216->4009983) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bd4 expref: 32 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.042667:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.042669:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.042675:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.042683:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.042689:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.042690:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.042693:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.042699:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.042722:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.042733:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260364160:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.042871:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.042879:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260364288:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.042903:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.045702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.045786:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263082624 00000100:00100000:1.0:1746065188.045793:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263082624 00002000:00100000:1.0:1746065188.045848:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8801350f8000 x1830881263082624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.045856:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8000 with x1830881263082624 ext(4194304->5013503) 00002000:00010000:1.0:1746065188.045860:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f8000 00000100:00100000:1.0:1746065188.045876:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8225 00000100:00100000:1.0:1746065188.045882:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263082624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.046928:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260364160:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.046946:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260364288:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.046963:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.046989:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881263082368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4405us (4973us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.046997:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7496 00000100:00100000:1.0:1746065188.052170:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263082624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6281us (6466us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065188.052179:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8225 00002000:00100000:1.0:1746065188.052188:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8801350f8000 x1830881263082624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.052195:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8000 with x1830881263082624 ext(4194304->5013503) 00002000:00010000:1.0:1746065188.052199:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f8000 00000100:00100000:0.0:1746065188.055340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.055389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.055420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.055448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.055467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.055479:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083008 00000100:00100000:3.0:1746065188.055486:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083008 00000100:00100000:0.0:1746065188.055492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065188.055521:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff8801350f8700 x1830881263083008/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.055530:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8700 with x1830881263083008 ext(2097152->3145727) 00002000:00010000:3.0:1746065188.055535:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f8700 00000100:00100000:3.0:1746065188.055546:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083136 00000100:00100000:3.0:1746065188.055548:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083136 00002000:00100000:3.0:1746065188.055556:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094a94000 x1830881263083136/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.055562:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94000 with x1830881263083136 ext(3145728->4194303) 00002000:00010000:3.0:1746065188.055564:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a94000 00000100:00100000:2.0:1746065188.055566:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083520 00000100:00100000:2.0:1746065188.055570:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083520 00000100:00100000:3.0:1746065188.055571:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083392 00000100:00100000:3.0:1746065188.055572:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083392 00002000:00100000:3.0:1746065188.055580:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a94700 x1830881263083392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.055585:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94700 with x1830881263083392 ext(2097152->3145727) 00002000:00010000:3.0:1746065188.055588:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a94700 00002000:00100000:2.0:1746065188.055588:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a94380 x1830881263083520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.055595:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94380 with x1830881263083520 ext(3145728->4194303) 00000100:00100000:3.0:1746065188.055596:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8226 00002000:00010000:2.0:1746065188.055597:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a94380 00000100:00100000:3.0:1746065188.055602:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881263083008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.055602:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8227 00000100:00100000:1.0:1746065188.055610:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881263083136:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.055614:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8228 00000100:00100000:2.0:1746065188.055618:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263083392:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.055648:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8229 00000100:00100000:1.0:1746065188.055652:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263083520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065188.056614:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083776 00000100:00100000:3.0:1746065188.056619:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083776 00000100:00100000:3.0:1746065188.056639:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263083904 00000100:00100000:3.0:1746065188.056641:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263083904 00000100:00100000:3.0:1746065188.056655:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14626 00000100:00100000:3.0:1746065188.056660:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263083776:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065188.056662:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14627 00000100:00100000:1.0:1746065188.056668:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263083904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.056669:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.056676:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.056684:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fcf92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c0c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.056684:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe13000/0x14b4f8542d4fcf99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c13 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.056720:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260364544:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065188.056720:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801298a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260364416:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065188.056781:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.056789:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065188.063249:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801298a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260364416:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065188.063280:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260364544:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065188.063280:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe13000/0x14b4f8542d4fcf99 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c13 expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.063293:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe13000/0x14b4f8542d4fcf99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c13 expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.063296:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fcf92 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c0c expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.063306:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fcf92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c0c expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.063323:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe13000, rc 0) 00000100:00100000:1.0:1746065188.063366:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263083904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6696us (7872us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.063374:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14627 00010000:00010000:3.0:1746065188.063502:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210a00, rc 0) 00000100:00100000:3.0:1746065188.063652:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881263083776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6990us (8183us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065188.063658:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14626 00000100:00100000:3.0:1746065188.066626:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263083008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11016us (11286us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065188.066636:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8226 00002000:00100000:3.0:1746065188.066645:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff8801350f8700 x1830881263083008/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.066653:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801350f8700 with x1830881263083008 ext(2097152->3145727) 00002000:00010000:3.0:1746065188.066658:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801350f8700 00000100:00100000:2.0:1746065188.071182:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263083136:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15564us (15784us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.071192:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8227 00002000:00100000:2.0:1746065188.071204:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094a94000 x1830881263083136/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.071214:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94000 with x1830881263083136 ext(3145728->4194303) 00002000:00010000:2.0:1746065188.071219:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a94000 00000100:00100000:0.0:1746065188.071650:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.071684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.072188:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263084160 00000100:00100000:3.0:1746065188.072196:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263084160 00000100:00100000:3.0:1746065188.072235:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263084032 00000100:00100000:3.0:1746065188.072238:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263084032 00000100:00100000:3.0:1746065188.072254:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14628 00000100:00100000:3.0:1746065188.072261:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263084160:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.072272:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.072287:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fcfa0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c21 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.072335:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260364672:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065188.072403:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.072500:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14629 00000100:00100000:2.0:1746065188.072507:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263084032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.072513:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.072520:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdcbc00/0x14b4f8542d4fcfa7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c1a expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.072543:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260364800:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065188.072564:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00002000:00010000:3.0:1746065188.075599:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime: 1746065188 -> 1746065189 00000100:00100000:3.0:1746065188.075624:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260364672:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065188.075648:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fcfa0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c21 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.075660:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a596c600/0x14b4f8542d4fcfa0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c21 expref: 28 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.075672:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596c600, rc 0) 00002000:00010000:2.0:1746065188.076237:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065188 -> 1746065189 00000100:00100000:2.0:1746065188.076248:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260364800:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065188.076262:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdcbc00/0x14b4f8542d4fcfa7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c1a expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.076270:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdcbc00/0x14b4f8542d4fcfa7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c1a expref: 27 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.076281:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdcbc00, rc 0) 00000100:00100000:3.0:1746065188.076396:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263084160:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4133us (4744us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065188.076402:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14628 00000100:00100000:2.0:1746065188.076446:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263084032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3939us (4761us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065188.076451:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14629 00000100:00100000:2.0:1746065188.077079:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263083392:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21458us (21629us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.077086:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8228 00002000:00100000:2.0:1746065188.077094:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a94700 x1830881263083392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.077101:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94700 with x1830881263083392 ext(2097152->3145727) 00002000:00010000:2.0:1746065188.077105:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a94700 00000100:00100000:1.0:1746065188.079334:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263083520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23676us (23908us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065188.079346:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8229 00002000:00100000:1.0:1746065188.079353:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a94380 x1830881263083520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.079360:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94380 with x1830881263083520 ext(3145728->4194303) 00002000:00010000:1.0:1746065188.079364:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a94380 00000100:00100000:0.0:1746065188.081965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.082047:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263084416 00000100:00100000:3.0:1746065188.082056:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263084416 00000100:00100000:3.0:1746065188.082104:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4266 00000100:00100000:3.0:1746065188.082112:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31813:x1830881263084416:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065188.082287:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31813:x1830881263084416:12345-192.168.202.46@tcp:35:cat.0 Request processed in 175us (328us total) trans 8589944208 rc 0/0 00000100:00100000:3.0:1746065188.082293:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4266 00000100:00100000:0.0:1746065188.089080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.089146:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263084672 00000100:00100000:1.0:1746065188.089154:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263084672 00002000:00100000:1.0:1746065188.089188:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094a95880 x1830881263084672/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.089196:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95880 with x1830881263084672 ext(4194304->5013503) 00002000:00010000:1.0:1746065188.089201:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a95880 00000100:00100000:1.0:1746065188.089252:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8230 00000100:00100000:1.0:1746065188.089258:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881263084672:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.097989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.098380:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881263084672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9120us (9305us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065188.098390:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8230 00002000:00100000:1.0:1746065188.098400:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094a95880 x1830881263084672/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.098408:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95880 with x1830881263084672 ext(4194304->5013503) 00002000:00010000:1.0:1746065188.098413:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a95880 00000100:00100000:0.0:1746065188.098691:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263084928 00000100:00100000:0.0:1746065188.098698:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263084928 00000100:00100000:0.0:1746065188.098998:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9972 00000100:00100000:0.0:1746065188.099004:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801298a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31820:x1830881263084928:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065188.099020:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065188.099033:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fcfae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c28 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.099107:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099117:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099126:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099135:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099139:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099144:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099211:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099216:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099221:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065188.099227:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065188.099287:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099293:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099297:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099302:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50bae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065188.099305:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099309:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099318:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065188.099320:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065188.099323:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099327:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bae00/0x14b4f8542d4fcfb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099352:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099356:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099360:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099363:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50bb000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065188.099578:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099585:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099591:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669100) 00010000:00010000:0.0:1746065188.099593:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065188.099595:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099599:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb000/0x14b4f8542d4fcfbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065188.099627:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fcfae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.099636:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.099641:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065188.099643:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065188.099645:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50bb200, rc 0) 00000100:00100000:0.0:1746065188.100358:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801298a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31820:x1830881263084928:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1352us (2375us total) trans 8589944209 rc 0/0 00000100:00100000:0.0:1746065188.100364:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9972 00000100:00100000:0.0:1746065188.102559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.102711:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263085184 00000100:00100000:3.0:1746065188.102719:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263085184 00000100:00100000:3.0:1746065188.102766:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4267 00000100:00100000:3.0:1746065188.102773:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b51f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31820:x1830881263085184:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065188.102946:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b51f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31820:x1830881263085184:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 173us (392us total) trans 8589944210 rc 0/0 00000100:00100000:3.0:1746065188.102951:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4267 00000100:00100000:0.0:1746065188.104929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.105004:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263085440 00000100:00100000:2.0:1746065188.105010:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263085440 00000100:00100000:2.0:1746065188.105046:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4268 00000100:00100000:2.0:1746065188.105052:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:31814:x1830881263085440:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065188.105207:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:31814:x1830881263085440:12345-192.168.202.46@tcp:35:cat.0 Request processed in 154us (281us total) trans 8589944211 rc 0/0 00000100:00100000:2.0:1746065188.105213:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4268 00000100:00100000:0.0:1746065188.146967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.147367:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263085696 00000100:00100000:2.0:1746065188.147375:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263085696 00000100:00100000:2.0:1746065188.148386:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9973 00000100:00100000:2.0:1746065188.148395:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:31824:x1830881263085696:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065188.148417:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.148432:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fcfd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c2f expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.148518:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.148778:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.148791:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.148803:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.148809:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.148828:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.148918:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.148926:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.148931:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065188.148938:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065188.149002:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149009:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149014:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149019:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdcbe00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065188.149022:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149028:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149037:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065188.149040:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065188.149043:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149048:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcbe00/0x14b4f8542d4fcfd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149193:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149199:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149204:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149207:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdcb200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065188.149209:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149214:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149220:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801356ed500) 00010000:00010000:2.0:1746065188.149223:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065188.149225:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149229:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcb200/0x14b4f8542d4fcfdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.149258:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fcfd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.149268:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 11 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.149273:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065188.149275:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065188.149278:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdcba00, rc 0) 00000100:00100000:2.0:1746065188.153944:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:31824:x1830881263085696:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5537us (6971us total) trans 8589944212 rc 0/0 00000100:00100000:2.0:1746065188.153957:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9973 00000100:00100000:0.0:1746065188.158123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.158211:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263085824 00000100:00100000:2.0:1746065188.158219:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263085824 00000100:00100000:2.0:1746065188.158266:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14630 00000100:00100000:2.0:1746065188.158273:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:31824:x1830881263085824:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065188.158291:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.158305:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c36 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.158330:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.158338:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 24 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.158344:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.158345:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.158348:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [1015808->1048575] (req 1015808->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.158374:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 24 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.158383:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 24 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.158393:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260364928:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.158555:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.158563:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 30 pid: 8428 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.158572:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260365056:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.158591:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.160413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.160584:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260364928:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.160598:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260365056:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.160619:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [1015808->1048575] (req 1015808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.160632:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdcb000, rc 0) 00000100:00100000:3.0:1746065188.161071:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263085952 00000100:00100000:3.0:1746065188.161079:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263085952 00010000:00010000:3.0:1746065188.161106:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 25 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065188.161147:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7497 00000100:00100000:3.0:1746065188.161155:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263085952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.161167:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.161190:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 25 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.161200:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 25 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.161219:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c765800/0x14b4f8542d4fced5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b5d expref: 25 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.161264:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.161485:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:31824:x1830881263085824:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3211us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.161491:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14630 00000100:00100000:3.0:1746065188.161553:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263085952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 400us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.161559:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7497 00000100:00100000:3.0:1746065188.161876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.161923:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263086080 00000100:00100000:0.0:1746065188.161926:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263086080 00010000:00010000:0.0:1746065188.161938:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 31 pid: 8428 timeout: 887 lvb_type: 1 00000100:00100000:0.0:1746065188.161951:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7498 00000100:00100000:0.0:1746065188.161955:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263086080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065188.161961:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065188.161968:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 31 pid: 8428 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746065188.161975:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 31 pid: 8428 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746065188.161986:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8400/0x14b4f8542d4fcea4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b41 expref: 31 pid: 8428 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746065188.162005:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065188.162006:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065188.162011:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.162018:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.162037:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065188.162046:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260365184:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065188.162083:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.163343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.163408:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263086336 00000100:00100000:1.0:1746065188.163413:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263086336 00000100:00100000:2.0:1746065188.163426:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260365184:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.163437:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065188.163439:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x380:0x0] (1015808->1019903) req@ffff880094a96d80 x1830881263086336/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.163447:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96d80 with x1830881263086336 ext(1015808->1019903) 00002000:00010000:1.0:1746065188.163451:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a96d80 00000100:00100000:1.0:1746065188.163465:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8231 00000100:00100000:1.0:1746065188.163471:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263086336:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065188.163475:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263086080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1517us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.163481:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7498 00000100:00100000:1.0:1746065188.163592:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263086336:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 117us (247us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065188.163598:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8231 00002000:00100000:1.0:1746065188.163602:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x380:0x0] (1015808->1019903) req@ffff880094a96d80 x1830881263086336/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.163609:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96d80 with x1830881263086336 ext(1015808->1019903) 00002000:00010000:1.0:1746065188.163612:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a96d80 00000100:00100000:0.0:1746065188.165550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.165621:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263086592 00000100:00100000:1.0:1746065188.165627:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263086592 00002000:00100000:1.0:1746065188.165652:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1130496->1134591) req@ffff880094a97100 x1830881263086592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.165660:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a97100 with x1830881263086592 ext(1130496->1134591) 00002000:00010000:1.0:1746065188.165663:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a97100 00000100:00100000:1.0:1746065188.165692:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8232 00000100:00100000:1.0:1746065188.165699:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263086592:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065188.165845:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263086592:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 146us (299us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065188.165851:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8232 00002000:00100000:1.0:1746065188.165856:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1130496->1134591) req@ffff880094a97100 x1830881263086592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.165862:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a97100 with x1830881263086592 ext(1130496->1134591) 00002000:00010000:1.0:1746065188.165864:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a97100 00000100:00100000:0.0:1746065188.167332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.167406:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263086848 00000100:00100000:3.0:1746065188.167411:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263086848 00000100:00100000:3.0:1746065188.167450:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4269 00000100:00100000:3.0:1746065188.167456:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:31824:x1830881263086848:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065188.167665:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:31824:x1830881263086848:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 209us (335us total) trans 8589944213 rc 0/0 00000100:00100000:3.0:1746065188.167671:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4269 00000100:00100000:0.0:1746065188.234923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.235019:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263087104 00000100:00100000:3.0:1746065188.235026:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263087104 00000100:00100000:3.0:1746065188.235079:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9974 00000100:00100000:3.0:1746065188.235086:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:31828:x1830881263087104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.235107:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.235122:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4fcffb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c3d expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.235207:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235217:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235227:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235238:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235243:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235248:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235331:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fd010 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235338:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fd010 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235344:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fd010 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065188.235350:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065188.235418:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235424:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235429:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235434:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a210a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.235439:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235444:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235454:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065188.235456:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.235460:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235464:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210a00/0x14b4f8542d4fd002 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235493:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235497:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235501:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235505:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a210000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.235507:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235511:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235516:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:3.0:1746065188.235518:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.235520:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235525:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a210000/0x14b4f8542d4fd009 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.235556:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a596d400/0x14b4f8542d4fcffb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c3d expref: 15 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.236101:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fd010 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c3d expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.236108:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.236111:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065188.236113:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a211800, rc 0) 00000100:00100000:3.0:1746065188.237216:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:31828:x1830881263087104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2128us (2298us total) trans 8589944214 rc 0/0 00000100:00100000:3.0:1746065188.237223:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9974 00000100:00100000:0.0:1746065188.241913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.244002:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263087232 00000100:00100000:2.0:1746065188.244013:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263087232 00000100:00100000:2.0:1746065188.244067:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 761 00000100:00100000:2.0:1746065188.244075:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263087232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.244088:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.244108:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a211800/0x14b4f8542d4fd010 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c3d expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.244132:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065188.244136:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.246901:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263087232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2818us (4986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.246911:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 761 00000100:00100000:0.0:1746065188.253425:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.253464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.254099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.256846:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263087616 00000100:00100000:2.0:1746065188.256856:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263087616 00002000:00100000:2.0:1746065188.256895:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (0->1015807) req@ffff880094a96a00 x1830881263087616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.256904:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96a00 with x1830881263087616 ext(0->1015807) 00002000:00010000:2.0:1746065188.256912:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a96a00 00000100:00100000:2.0:1746065188.256931:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263087872 00000100:00100000:2.0:1746065188.256933:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263087872 00002000:00100000:2.0:1746065188.256942:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1376256->2097151) req@ffff880094a95500 x1830881263087872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.256948:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95500 with x1830881263087872 ext(1376256->2097151) 00002000:00010000:2.0:1746065188.256951:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a95500 00000100:00100000:2.0:1746065188.256957:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263087744 00000100:00100000:2.0:1746065188.256958:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263087744 00002000:00100000:2.0:1746065188.256965:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1134592->1638399) req@ffff88009b82c000 x1830881263087744/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.256970:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82c000 with x1830881263087744 ext(1134592->1638399) 00002000:00010000:2.0:1746065188.256972:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82c000 00000100:00100000:2.0:1746065188.256992:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8233 00000100:00100000:2.0:1746065188.256998:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263087616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.258002:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8234 00000100:00100000:2.0:1746065188.258007:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8235 00000100:00100000:1.0:1746065188.258011:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881263087872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.258012:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881263087744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065188.269551:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.269871:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263087744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11856us (15771us total) trans 0 rc 503808/503808 00000100:00100000:0.0:1746065188.269883:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8235 00002000:00100000:0.0:1746065188.269895:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1134592->1638399) req@ffff88009b82c000 x1830881263087744/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 503808/503808 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.269904:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82c000 with x1830881263087744 ext(1134592->1638399) 00002000:00010000:0.0:1746065188.269909:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82c000 00000100:00100000:2.0:1746065188.270232:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263087616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13234us (16814us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746065188.270238:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8233 00002000:00100000:2.0:1746065188.270242:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (0->1015807) req@ffff880094a96a00 x1830881263087616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.270249:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96a00 with x1830881263087616 ext(0->1015807) 00002000:00010000:2.0:1746065188.270252:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a96a00 00000100:00100000:3.0:1746065188.270943:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263088128 00000100:00100000:3.0:1746065188.270950:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263088128 00000100:00100000:3.0:1746065188.270983:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14631 00000100:00100000:3.0:1746065188.270989:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31820:x1830881263088128:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065188.271000:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.271014:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c44 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.271038:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.271045:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.271050:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.271052:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.271055:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2965504->3145727] (req 2965504->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.271079:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.271090:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 27 pid: 9716 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065188.271101:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260365312:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.271171:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.271178:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 26 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065188.271186:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260365440:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065188.271206:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.276338:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260365312:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065188.276353:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260365440:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.276380:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2965504->3145727] (req 2965504->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.276396:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210000, rc 0) 00000100:00100000:1.0:1746065188.276448:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263087872:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18436us (22980us total) trans 0 rc 720896/720896 00000100:00100000:1.0:1746065188.276457:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8234 00002000:00100000:1.0:1746065188.276465:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1376256->2097151) req@ffff880094a95500 x1830881263087872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 720896/720896 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.276473:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95500 with x1830881263087872 ext(1376256->2097151) 00002000:00010000:1.0:1746065188.276478:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a95500 00000100:00100000:3.0:1746065188.276557:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31820:x1830881263088128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5567us (7011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.276566:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14631 00000100:00100000:0.0:1746065188.277806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.278955:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263088256 00000100:00100000:2.0:1746065188.278964:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263088256 00010000:00010000:2.0:1746065188.278999:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 26 pid: 9716 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.279034:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7499 00000100:00100000:2.0:1746065188.279040:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263088256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.279052:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.279073:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 26 pid: 9716 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.279084:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 26 pid: 9716 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.279102:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e8600/0x14b4f8542d4fcef1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b80 expref: 26 pid: 9716 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.279122:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.279170:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263088256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 129us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.279176:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7499 00000100:00100000:0.0:1746065188.279527:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.279689:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263088384 00000100:00100000:3.0:1746065188.279693:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263088384 00010000:00010000:3.0:1746065188.279708:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 26 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065188.279724:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7500 00000100:00100000:3.0:1746065188.279728:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263088384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.279734:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.279742:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 26 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.279749:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 26 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.279770:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c765e00/0x14b4f8542d4fcece lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b95 expref: 26 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.279792:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.279794:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.279800:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.279806:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.279848:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.279859:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260365568:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.279916:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.284651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.284772:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263088640 00000100:00100000:1.0:1746065188.284779:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263088640 00002000:00100000:1.0:1746065188.284855:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2965504->2969599) req@ffff88009b82ca80 x1830881263088640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.284864:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82ca80 with x1830881263088640 ext(2965504->2969599) 00002000:00010000:1.0:1746065188.284869:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82ca80 00000100:00100000:1.0:1746065188.284889:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8236 00000100:00100000:1.0:1746065188.284897:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263088640:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065188.285062:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263088640:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 165us (418us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065188.285068:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8236 00002000:00100000:1.0:1746065188.285073:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2965504->2969599) req@ffff88009b82ca80 x1830881263088640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.285080:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82ca80 with x1830881263088640 ext(2965504->2969599) 00002000:00010000:1.0:1746065188.285083:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82ca80 00000100:00100000:3.0:1746065188.285180:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260365568:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.285197:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.285219:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263088384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5491us (5693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.285227:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7500 00000100:00100000:0.0:1746065188.286148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.287135:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263088768 00000100:00100000:3.0:1746065188.287143:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263088768 00000100:00100000:0.0:1746065188.287356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.287506:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14632 00000100:00100000:3.0:1746065188.287514:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:31828:x1830881263088768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.287529:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.287543:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c4b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.287565:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.287571:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065188.287572:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065188.287575:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.287598:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 24 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.287613:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 24 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.287624:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260365696:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065188.287690:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.287705:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089024 00000100:00100000:3.0:1746065188.287708:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089024 00000100:00100000:3.0:1746065188.287731:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9975 00000100:00100000:3.0:1746065188.287736:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:31831:x1830881263089024:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065188.287747:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.287771:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fd02c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c52 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.287868:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.287878:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.287887:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.287898:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.287903:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.287908:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288000:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fd041 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288008:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fd041 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288013:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fd041 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065188.288297:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065188.288365:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288370:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288375:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288379:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ccb800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.288382:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288387:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288395:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065188.288397:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.288400:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288404:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ccb800/0x14b4f8542d4fd033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288519:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288524:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288529:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288533:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cca800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.288535:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288539:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288545:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205e00) 00010000:00010000:3.0:1746065188.288547:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.288549:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288553:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cca800/0x14b4f8542d4fd03a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.288582:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7d7a00/0x14b4f8542d4fd02c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c52 expref: 16 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.288591:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fd041 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c52 expref: 15 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.288596:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.288598:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065188.288600:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bf400, rc 0) 00000100:00100000:3.0:1746065188.289472:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:31831:x1830881263089024:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1729us (2111us total) trans 8589944215 rc 0/0 00000100:00100000:3.0:1746065188.289480:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9975 00000100:00100000:1.0:1746065188.289830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.290093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.290164:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260365696:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.290183:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.290196:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a210a00, rc 0) 00000100:00100000:3.0:1746065188.290219:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:31828:x1830881263088768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2707us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065188.290225:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089280 00000100:00100000:3.0:1746065188.290226:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14632 00000100:00100000:0.0:1746065188.290230:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089280 00000100:00100000:3.0:1746065188.290236:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089152 00000100:00100000:3.0:1746065188.290238:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089152 00000100:00100000:3.0:1746065188.290253:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14633 00000100:00100000:3.0:1746065188.290258:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31820:x1830881263089152:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065188.290268:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.290280:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c59 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.290297:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.290304:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.290314:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.290315:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.290318:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->3964927] (req 3145728->3964927) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.290337:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.290345:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.290355:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260365824:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.290395:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.290401:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 22 pid: 8429 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.290408:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260365952:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065188.290421:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c000 going to sleep for 11 seconds 00002000:00100000:0.0:1746065188.290863:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2965504->3145727) req@ffff8800a002a680 x1830881263089280/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.290872:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a002a680 with x1830881263089280 ext(2965504->3145727) 00010000:00010000:0.0:1746065188.290878:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 25 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1746065188.290886:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 25 pid: 4544 timeout: 887 lvb_type: 0 00002000:00010000:0.0:1746065188.290892:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a002a680 00000100:00100000:0.0:1746065188.290911:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2510 00000100:00100000:0.0:1746065188.290917:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263089280:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065188.292284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.292418:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089408 00000100:00100000:3.0:1746065188.292423:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089408 00000100:00100000:3.0:1746065188.292453:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 762 00000100:00100000:3.0:1746065188.292458:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263089408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.292466:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.292485:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3bf400/0x14b4f8542d4fd041 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c52 expref: 15 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.292501:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.292504:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.292525:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263089408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.292531:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 762 00000100:00100000:2.0:1746065188.293263:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260365824:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.293274:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260365952:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.293295:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->3964927] (req 3145728->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.293307:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3bf600, rc 0) 00000100:00100000:2.0:1746065188.293348:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31820:x1830881263089152:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3089us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.293354:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14633 00000100:00100000:0.0:1746065188.295131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.295181:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089536 00000100:00100000:2.0:1746065188.295187:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089536 00010000:00010000:2.0:1746065188.295210:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.295245:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7501 00000100:00100000:2.0:1746065188.295251:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263089536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.295261:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.295275:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.295285:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.295302:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca400/0x14b4f8542d4fcf8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c05 expref: 31 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.295326:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.295353:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263089536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.295359:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7501 00000100:00100000:1.0:1746065188.296468:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263089280:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5549us (6372us total) trans 17179873616 rc 0/0 00000100:00100000:1.0:1746065188.296476:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2510 00002000:00100000:1.0:1746065188.296484:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2965504->3145727) req@ffff8800a002a680 x1830881263089280/t17179873616(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.296492:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a002a680 with x1830881263089280 ext(2965504->3145727) 00010000:00010000:1.0:1746065188.296498:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 27 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065188.296507:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 27 pid: 4544 timeout: 887 lvb_type: 0 00002000:00010000:1.0:1746065188.296513:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a002a680 00000100:00100000:0.0:1746065188.298226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.298283:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089664 00000100:00100000:3.0:1746065188.298289:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089664 00010000:00010000:3.0:1746065188.298314:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 23 pid: 8429 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.298342:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7502 00000100:00100000:3.0:1746065188.298347:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263089664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.298358:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.298374:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 23 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.298382:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 23 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.298400:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e3e8e00/0x14b4f8542d4fcf76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bf0 expref: 23 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.298423:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.298425:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.298432:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.298440:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.298467:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.298484:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260366080:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.298547:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.306344:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260366080:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.306363:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.306410:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263089664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8061us (8187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.306420:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7502 00000100:00100000:0.0:1746065188.307060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.307098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.307180:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263090048 00000100:00100000:1.0:1746065188.307187:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263090048 00002000:00100000:1.0:1746065188.307225:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3960832->3964927) req@ffff88009b82df80 x1830881263090048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.307234:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82df80 with x1830881263090048 ext(3960832->3964927) 00002000:00010000:1.0:1746065188.307238:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b82df80 00000100:00100000:3.0:1746065188.307275:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263089792 00000100:00100000:3.0:1746065188.307279:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263089792 00010000:00010000:3.0:1746065188.307297:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 27 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.307300:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8237 00000100:00100000:1.0:1746065188.307307:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263090048:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065188.307477:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7503 00000100:00100000:3.0:1746065188.307483:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263089792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.307492:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065188.307505:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065187 -> 1746065189 00002000:00010000:3.0:1746065188.307508:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065187 -> 1746065189 00010000:00010000:3.0:1746065188.307512:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 27 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.307522:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 27 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.307530:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263090048:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 222us (429us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065188.307538:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8237 00010000:00010000:3.0:1746065188.307540:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a210000/0x14b4f8542d4fd01e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c44 expref: 27 pid: 4544 timeout: 887 lvb_type: 0 00002000:00100000:1.0:1746065188.307544:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3960832->3964927) req@ffff88009b82df80 x1830881263090048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746065188.307550:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:1.0:1746065188.307550:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82df80 with x1830881263090048 ext(3960832->3964927) 00010000:00010000:3.0:1746065188.307552:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746065188.307553:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b82df80 00010000:00010000:3.0:1746065188.307557:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.307564:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.307586:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.307596:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260366208:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.307667:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.312161:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260366208:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.312184:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.312238:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263089792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4753us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.312248:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7503 00000100:00100000:0.0:1746065188.313149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.313237:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263090304 00000100:00100000:3.0:1746065188.313242:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263090304 00000100:00100000:3.0:1746065188.313811:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9976 00000100:00100000:3.0:1746065188.313848:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31834:x1830881263090304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.313869:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.313885:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c60 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.313976:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.313988:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.313998:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314011:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314015:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314020:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314100:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd06b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314107:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd06b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314112:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd06b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065188.314120:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065188.314191:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314197:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314202:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314207:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801355a2400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.314211:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314216:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314223:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065188.314226:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.314229:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314233:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd05d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314250:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314254:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314259:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314266:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801355a2600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.314268:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314272:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314277:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:3.0:1746065188.314279:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.314281:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314284:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd064 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.314309:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c60 expref: 257 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.314316:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd06b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c60 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.314320:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.314321:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065188.314322:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355a2800, rc 0) 00000100:00100000:3.0:1746065188.314359:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31834:x1830881263090304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 513us (1212us total) trans 8589944216 rc 0/0 00000100:00100000:3.0:1746065188.314365:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9976 00000100:00100000:0.0:1746065188.315704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.316076:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263090560 00000100:00100000:1.0:1746065188.316083:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263090560 00002000:00100000:1.0:1746065188.316114:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009b82e680 x1830881263090560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.316123:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82e680 with x1830881263090560 ext(2097152->3145727) 00002000:00010000:1.0:1746065188.316127:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82e680 00000100:00100000:1.0:1746065188.316812:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8238 00000100:00100000:1.0:1746065188.316841:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263090560:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065188.316951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.316981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.317036:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263090688 00000100:00100000:3.0:1746065188.317188:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263090688 00000100:00100000:3.0:1746065188.317220:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 763 00000100:00100000:3.0:1746065188.317225:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1959:x1830881263090688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.317234:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.317252:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd06b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c60 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.317265:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.317268:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.317304:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1959:x1830881263090688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.317309:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 763 00000100:00100000:0.0:1746065188.319858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.319896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.319923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.319984:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263090816 00000100:00100000:3.0:1746065188.319992:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263090816 00000100:00100000:3.0:1746065188.320024:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263090944 00000100:00100000:3.0:1746065188.320026:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263090944 00000100:00100000:3.0:1746065188.320036:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091072 00000100:00100000:3.0:1746065188.320037:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091072 00000100:00100000:3.0:1746065188.320060:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091200 00000100:00100000:3.0:1746065188.320062:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091200 00000100:00100000:3.0:1746065188.320080:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14634 00000100:00100000:3.0:1746065188.320087:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263090816:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065188.320087:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14635 00000100:00100000:0.0:1746065188.320094:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263090944:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.320102:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065188.320103:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.320115:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801355a3000/0x14b4f8542d4fd080 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c67 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.320115:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa400/0x14b4f8542d4fd079 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c6e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.320156:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260366464:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065188.320156:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260366336:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065188.320238:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.320251:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.320266:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14636 00000100:00100000:3.0:1746065188.320271:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263091072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.320277:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.320284:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801355a3600/0x14b4f8542d4fd087 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c75 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.320304:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260366592:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065188.320325:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.320336:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14637 00000100:00100000:3.0:1746065188.320340:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263091200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.320344:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.320349:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c7c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.320358:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.320360:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.320367:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.320384:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.320393:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355a3c00, rc 0) 00000100:00100000:3.0:1746065188.320413:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263091200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.320419:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14637 00002000:00010000:3.0:1746065188.322520:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime: 1746065188 -> 1746065189 00002000:00010000:3.0:1746065188.322527:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime: 1746065186 -> 1746065189 00002000:00010000:3.0:1746065188.322530:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime: 1746065188 -> 1746065189 00000100:00100000:3.0:1746065188.322550:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260366464:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065188.322574:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801355a3000/0x14b4f8542d4fd080 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c67 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.322585:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801355a3000/0x14b4f8542d4fd080 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c67 expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.322595:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355a3000, rc 0) 00000100:00100000:3.0:1746065188.322639:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263090816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2552us (5655us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065188.322647:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14634 00002000:00010000:2.0:1746065188.322803:0:2463:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime: 1746065188 -> 1746065189 00002000:00010000:2.0:1746065188.322806:0:2463:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime: 1746065188 -> 1746065189 00000100:00100000:2.0:1746065188.322848:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260366592:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065188.322863:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801355a3600/0x14b4f8542d4fd087 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c75 expref: 30 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.322872:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801355a3600/0x14b4f8542d4fd087 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c75 expref: 30 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.322887:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355a3600, rc 0) 00000100:00100000:2.0:1746065188.322914:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263091072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2642us (3017us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065188.322920:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14636 00002000:00010000:1.0:1746065188.323218:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime: 1746065188 -> 1746065189 00002000:00010000:1.0:1746065188.323222:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime: 1746065188 -> 1746065189 00000100:00100000:1.0:1746065188.323232:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260366336:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065188.323247:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa400/0x14b4f8542d4fd079 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c6e expref: 28 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.323256:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f8aa400/0x14b4f8542d4fd079 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c6e expref: 28 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.323481:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8aa400, rc 0) 00000100:00100000:1.0:1746065188.323506:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263090944:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3412us (3656us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.323512:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14635 00000100:00100000:1.0:1746065188.326747:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263090560:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9898us (11038us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065188.326767:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8238 00002000:00100000:1.0:1746065188.326779:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009b82e680 x1830881263090560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.326789:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82e680 with x1830881263090560 ext(2097152->3145727) 00002000:00010000:1.0:1746065188.326794:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82e680 00000100:00100000:0.0:1746065188.332901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.332975:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.333017:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091328 00000100:00100000:2.0:1746065188.333026:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091328 00000100:00100000:2.0:1746065188.333064:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091456 00000100:00100000:2.0:1746065188.333066:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091456 00000100:00100000:2.0:1746065188.333080:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14638 00000100:00100000:2.0:1746065188.333086:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31834:x1830881263091328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.333100:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.333112:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c83 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.333135:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.333141:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.333142:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.333146:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 31 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.333170:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065188.333173:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14639 00010000:00010000:2.0:1746065188.333180:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 22 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.333181:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:31828:x1830881263091456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.333189:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065188.333190:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260366720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065188.333196:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c8a expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.333210:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.333216:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065188.333217:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065188.333219:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.333232:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 31 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.333257:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065188.333331:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 31 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.333339:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a002ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260366848:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065188.333362:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.336582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.336620:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260366720:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.336644:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 31 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065188.336649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065188.336657:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdca800, rc 0) 00000100:00100000:3.0:1746065188.336694:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091712 00000100:00100000:3.0:1746065188.336699:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091712 00000100:00100000:1.0:1746065188.336716:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a002ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260366848:192.168.202.46@tcp:104: 00002000:00100000:3.0:1746065188.336730:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3964927) req@ffff880136978000 x1830881263091712/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065188.336731:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065188.336739:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136978000 with x1830881263091712 ext(3145728->3964927) 00010000:00010000:1.0:1746065188.336741:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4f2200, rc 0) 00010000:00010000:3.0:1746065188.336744:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 32 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.336753:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 32 pid: 4544 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746065188.336768:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136978000 00000100:00100000:1.0:1746065188.336779:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:31828:x1830881263091456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3600us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.336783:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091584 00000100:00100000:3.0:1746065188.336786:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091584 00000100:00100000:1.0:1746065188.336786:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14639 00002000:00100000:3.0:1746065188.336798:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (1015808->1048575) req@ffff880136978380 x1830881263091584/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.336804:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136978380 with x1830881263091584 ext(1015808->1048575) 00010000:00010000:3.0:1746065188.336808:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 23 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.336830:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2511 00010000:00010000:3.0:1746065188.336833:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 23 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.336837:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881263091712:12345-192.168.202.46@tcp:4:cat.0 00002000:00010000:3.0:1746065188.336839:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136978380 00000100:00100000:3.0:1746065188.336857:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2512 00000100:00100000:3.0:1746065188.336862:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263091584:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065188.337038:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31834:x1830881263091328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3951us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.337043:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14638 00000100:00100000:3.0:1746065188.341034:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:1959:x1830881263091584:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4163us (4376us total) trans 21474840892 rc 0/0 00000100:00100000:3.0:1746065188.341044:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2512 00002000:00100000:3.0:1746065188.341054:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (1015808->1048575) req@ffff880136978380 x1830881263091584/t21474840892(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.341062:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136978380 with x1830881263091584 ext(1015808->1048575) 00010000:00010000:3.0:1746065188.341071:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 25 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.341081:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 25 pid: 4544 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746065188.341087:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136978380 00000100:00100000:0.0:1746065188.349248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.351138:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263091840 00000100:00100000:2.0:1746065188.351149:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263091840 00010000:00010000:2.0:1746065188.351186:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 25 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.351227:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7504 00000100:00100000:2.0:1746065188.351235:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1959:x1830881263091840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.351246:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.351267:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 25 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.351276:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 25 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.351296:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdcb000/0x14b4f8542d4fcff4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1015808->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c36 expref: 25 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.351313:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.351315:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.351322:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 32 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.351329:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 32 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.351356:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 32 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.351367:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260366976:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.351437:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.354622:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260366976:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.354639:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.354689:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136978700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263091840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3454us (5449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.354698:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7504 00000100:00100000:0.0:1746065188.358249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.358303:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263092096 00000100:00100000:3.0:1746065188.358311:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263092096 00002000:00100000:3.0:1746065188.358343:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880136978a80 x1830881263092096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.358351:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136978a80 with x1830881263092096 ext(0->1048575) 00002000:00010000:3.0:1746065188.358356:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136978a80 00000100:00100000:3.0:1746065188.358370:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8239 00000100:00100000:3.0:1746065188.358376:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263092096:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.360385:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263091712:12345-192.168.202.46@tcp:4:cat.0 Request processed in 23542us (23803us total) trans 21474840893 rc 0/0 00000100:00100000:1.0:1746065188.360395:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2511 00002000:00100000:1.0:1746065188.360404:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3964927) req@ffff880136978000 x1830881263091712/t21474840893(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.360412:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136978000 with x1830881263091712 ext(3145728->3964927) 00010000:00010000:1.0:1746065188.360420:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 35 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065188.360433:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 35 pid: 4544 timeout: 887 lvb_type: 0 00002000:00010000:1.0:1746065188.361180:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136978000 00000100:00100000:3.0:1746065188.369736:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263092096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11347us (11483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065188.369750:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8239 00002000:00100000:3.0:1746065188.369768:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880136978a80 x1830881263092096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.369776:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136978a80 with x1830881263092096 ext(0->1048575) 00002000:00010000:3.0:1746065188.369781:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136978a80 00000100:00100000:0.0:1746065188.373280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.373336:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263092224 00000100:00100000:2.0:1746065188.373344:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263092224 00010000:00010000:2.0:1746065188.373379:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 33 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.373415:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7505 00000100:00100000:2.0:1746065188.373422:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263092224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.373433:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065188.373447:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065188 -> 1746065189 00002000:00010000:2.0:1746065188.373449:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065188 -> 1746065189 00010000:00010000:2.0:1746065188.373455:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 33 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.373465:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 33 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.373483:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f3bf600/0x14b4f8542d4fd04f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c59 expref: 33 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.373513:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.373515:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.373521:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.373529:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.373558:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.373568:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260367104:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.373643:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.375307:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260367104:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.375329:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.375370:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263092224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1947us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.375379:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7505 00000100:00100000:0.0:1746065188.384152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.384185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.384226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.384368:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263092864 00000100:00100000:2.0:1746065188.384375:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263092864 00000100:00100000:2.0:1746065188.384408:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14640 00000100:00100000:2.0:1746065188.384415:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31834:x1830881263092864:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.384429:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.384444:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c91 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.384467:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.384473:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.384475:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.384478:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.384502:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 25 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.384512:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 25 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.384523:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260367232:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.384580:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.384644:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263092608 00000100:00100000:3.0:1746065188.384648:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263092608 00002000:00100000:3.0:1746065188.384671:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880136978e00 x1830881263092608/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.384679:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136978e00 with x1830881263092608 ext(3145728->4194303) 00002000:00010000:3.0:1746065188.384682:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136978e00 00000100:00100000:3.0:1746065188.384694:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263092736 00000100:00100000:3.0:1746065188.384696:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263092736 00002000:00100000:3.0:1746065188.384714:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880136979180 x1830881263092736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.384720:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136979180 with x1830881263092736 ext(3145728->4194303) 00002000:00010000:3.0:1746065188.384723:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136979180 00000100:00100000:3.0:1746065188.384735:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8240 00000100:00100000:3.0:1746065188.384740:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263092608:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.385148:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8241 00000100:00100000:1.0:1746065188.385155:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263092736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.386517:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260367232:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.386538:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.386556:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdcb200, rc 0) 00000100:00100000:2.0:1746065188.386596:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31834:x1830881263092864:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2181us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.386601:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14640 00000100:00100000:0.0:1746065188.386787:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.387003:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263092992 00000100:00100000:2.0:1746065188.387008:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263092992 00002000:00100000:2.0:1746065188.387031:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880136979880 x1830881263092992/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 504/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.387038:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136979880 with x1830881263092992 ext(1048576->2097151) 00010000:00010000:2.0:1746065188.387042:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 28 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.387051:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 28 pid: 9716 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746065188.387056:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136979880 00000100:00100000:2.0:1746065188.387071:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2513 00000100:00100000:2.0:1746065188.387076:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263092992:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065188.396029:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263092608:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11279us (11875us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065188.396040:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8240 00002000:00100000:3.0:1746065188.396049:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880136978e00 x1830881263092608/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.396059:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136978e00 with x1830881263092608 ext(3145728->4194303) 00002000:00010000:3.0:1746065188.396064:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136978e00 00000100:00100000:0.0:1746065188.407349:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263092736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22185us (23153us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065188.407360:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8241 00002000:00100000:0.0:1746065188.407371:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880136979180 x1830881263092736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.407379:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136979180 with x1830881263092736 ext(3145728->4194303) 00002000:00010000:0.0:1746065188.407383:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136979180 00000100:00100000:2.0:1746065188.410644:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263092992:12345-192.168.202.46@tcp:4:cat.0 Request processed in 23560us (23850us total) trans 17179873617 rc 0/0 00000100:00100000:2.0:1746065188.410653:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2513 00002000:00100000:2.0:1746065188.410661:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880136979880 x1830881263092992/t17179873617(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 504/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.410674:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136979880 with x1830881263092992 ext(1048576->2097151) 00010000:00010000:2.0:1746065188.410683:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 28 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.410695:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 28 pid: 9716 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746065188.410701:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136979880 00000100:00100000:0.0:1746065188.413721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.413812:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093120 00000100:00100000:2.0:1746065188.413833:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093120 00000100:00100000:2.0:1746065188.413867:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14641 00000100:00100000:2.0:1746065188.413919:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+24:31831:x1830881263093120:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065188.413935:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.413949:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c98 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.413973:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.413981:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.413986:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.413988:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.413991:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->1630207] (req 1048576->1630207) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 25 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.414019:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 31 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.414028:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 31 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.414039:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260367360:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.418504:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 25 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.418522:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 25 pid: 8427 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.418535:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260367488:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065188.419076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.419111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.419147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.419173:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093504 00000100:00100000:0.0:1746065188.419179:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093504 00000100:00100000:0.0:1746065188.419207:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093376 00000100:00100000:0.0:1746065188.419209:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093376 00000100:00100000:0.0:1746065188.419223:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14642 00000100:00100000:0.0:1746065188.419229:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013697a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+28:1958:x1830881263093504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065188.419240:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065188.419254:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9000/0x14b4f8542d4fd0b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ca6 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065188.419286:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013697aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260367616:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065188.419327:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.419372:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14643 00000100:00100000:0.0:1746065188.419378:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013697a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263093376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065188.419385:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065188.419393:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60c9f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.419403:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065188.419405:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065188.419412:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065188.419424:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065188.419432:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdefe00, rc 0) 00000100:00100000:0.0:1746065188.419453:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013697a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881263093376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 75us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065188.419458:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14643 00000100:00100000:3.0:1746065188.419689:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093248 00000100:00100000:3.0:1746065188.419693:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093248 00010000:00010000:3.0:1746065188.419709:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.419728:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7506 00000100:00100000:3.0:1746065188.419733:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263093248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.419740:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.419766:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.419774:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.419787:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.419789:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.419794:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 27 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.419800:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 27 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.419839:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 27 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.419847:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260367744:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.419872:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.420114:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.421551:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260367360:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065188.421845:0:9716:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88013697aa00 x1830881260367616) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1746065188.421869:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9800/0x14b4f8542d4fcf53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1638400->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bcd expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.422057:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013697aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260367616:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065188.422079:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9000/0x14b4f8542d4fd0b1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ca6 expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.422089:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcc9000/0x14b4f8542d4fd0b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ca6 expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.422096:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcc9000, rc 0) 00000100:00100000:1.0:1746065188.422134:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013697a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+28:1958:x1830881263093504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2905us (3022us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.422141:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14642 00000100:00100000:3.0:1746065188.423635:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260367744:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.423649:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.423673:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263093248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3940us (4599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.423681:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7506 00000100:00100000:2.0:1746065188.423858:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260367488:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.423876:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->1630207] (req 1048576->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 26 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.423886:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355a2c00, rc 0) 00000100:00100000:2.0:1746065188.423903:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+26:31831:x1830881263093120:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10030us (10189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.423912:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14641 00000100:00100000:0.0:1746065188.427560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.428327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.428539:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093760 00000100:00100000:3.0:1746065188.428547:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093760 00010000:00010000:3.0:1746065188.428584:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 26 pid: 8427 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065188.428621:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7507 00000100:00100000:3.0:1746065188.428629:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013697ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263093760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.428643:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.428665:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 26 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.428679:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 26 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.428701:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4fcec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b72 expref: 26 pid: 8427 timeout: 887 lvb_type: 1 00010000:00010000:3.0:1746065188.428727:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.428775:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013697ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263093760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 146us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.428780:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7507 00000100:00100000:2.0:1746065188.429401:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263093632 00000100:00100000:2.0:1746065188.429405:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263093632 00010000:00010000:2.0:1746065188.429419:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 32 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.429434:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7508 00000100:00100000:2.0:1746065188.429439:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013697b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263093632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.429445:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.429454:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 32 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.429462:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 32 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.429473:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c764000/0x14b4f8542d4fcec7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b87 expref: 32 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.429494:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.429495:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.429500:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 24 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.429507:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 24 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.429531:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 24 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.429541:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260367872:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.429581:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dbbbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065188.429853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.430181:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263094016 00000100:00100000:2.0:1746065188.430184:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263094016 00002000:00100000:2.0:1746065188.430208:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a002ad80 x1830881263094016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.430216:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a002ad80 with x1830881263094016 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.430220:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a002ad80 00000100:00100000:2.0:1746065188.430485:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8242 00000100:00100000:2.0:1746065188.430494:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263094016:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.431286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.431384:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263094272 00000100:00100000:0.0:1746065188.431388:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263094272 00002000:00100000:0.0:1746065188.431406:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8800a002a300 x1830881263094272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.431413:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a002a300 with x1830881263094272 ext(4194304->5013503) 00002000:00010000:0.0:1746065188.431417:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a002a300 00000100:00100000:0.0:1746065188.432851:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8243 00000100:00100000:0.0:1746065188.432860:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a002a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263094272:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.436017:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260367872:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.436034:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.437635:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013697b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263093632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8190us (9304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.437645:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7508 00000100:00100000:0.0:1746065188.437944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.438252:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263094528 00000100:00100000:2.0:1746065188.438259:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263094528 00000100:00100000:2.0:1746065188.438881:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9977 00000100:00100000:2.0:1746065188.438888:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013697b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:31837:x1830881263094528:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065188.438909:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.438924:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd0bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cad expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.439014:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439026:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439035:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439202:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439210:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439216:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439311:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd0d4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439319:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439325:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065188.439332:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065188.439397:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439403:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439409:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439417:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801355a2200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065188.439420:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439426:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439441:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065188.439444:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065188.439447:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439451:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2200/0x14b4f8542d4fd0c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439474:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439479:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439483:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439486:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801355a2400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065188.439488:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439493:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439499:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801356ed600) 00010000:00010000:2.0:1746065188.439500:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065188.439503:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439506:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2400/0x14b4f8542d4fd0cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065188.439535:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2600/0x14b4f8542d4fd0bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cad expref: 258 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.439545:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cad expref: 257 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.439551:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065188.439552:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065188.439554:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355a2800, rc 0) 00000100:00100000:2.0:1746065188.440779:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013697b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31837:x1830881263094528:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1887us (2831us total) trans 8589944217 rc 0/0 00000100:00100000:2.0:1746065188.440788:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9977 00000100:00100000:3.0:1746065188.440872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.441254:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263094784 00000100:00100000:2.0:1746065188.441261:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263094784 00002000:00100000:2.0:1746065188.441452:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1626112->1630207) req@ffff88012e8b4e00 x1830881263094784/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.441462:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4e00 with x1830881263094784 ext(1626112->1630207) 00002000:00010000:2.0:1746065188.441466:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4e00 00000100:00100000:2.0:1746065188.441490:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8244 00000100:00100000:2.0:1746065188.441496:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263094784:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.441955:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263094784:12345-192.168.202.46@tcp:3:cat.0 Request processed in 457us (1080us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065188.441964:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8244 00002000:00100000:2.0:1746065188.441969:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1626112->1630207) req@ffff88012e8b4e00 x1830881263094784/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.441976:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4e00 with x1830881263094784 ext(1626112->1630207) 00002000:00010000:2.0:1746065188.441979:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4e00 00000100:00100000:2.0:1746065188.444208:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263094016:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13709us (14349us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.444214:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8242 00002000:00100000:2.0:1746065188.444220:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a002ad80 x1830881263094016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.444227:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a002ad80 with x1830881263094016 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.444231:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a002ad80 00000100:00100000:1.0:1746065188.444513:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a002a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263094272:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11654us (13227us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065188.444519:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8243 00002000:00100000:1.0:1746065188.444525:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8800a002a300 x1830881263094272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.444531:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a002a300 with x1830881263094272 ext(4194304->5013503) 00002000:00010000:1.0:1746065188.444535:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a002a300 00000100:00100000:0.0:1746065188.445779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.445833:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263095040 00000100:00100000:0.0:1746065188.445839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.445840:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263095040 00000100:00100000:3.0:1746065188.445866:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4270 00000100:00100000:3.0:1746065188.445872:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013697b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31837:x1830881263095040:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065188.445877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.445973:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263095168 00000100:00100000:2.0:1746065188.445976:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263095168 00000100:00100000:2.0:1746065188.446000:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 764 00000100:00100000:2.0:1746065188.446005:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013697bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1961:x1830881263095168:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.446014:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.446031:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801355a2800/0x14b4f8542d4fd0d4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cad expref: 258 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.446043:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065188.446046:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.446067:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013697bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1961:x1830881263095168:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 62us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.446075:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 764 00000100:00100000:0.0:1746065188.446165:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263095424 00000100:00100000:0.0:1746065188.446169:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263095424 00000100:00100000:0.0:1746065188.446219:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4271 00000100:00100000:0.0:1746065188.446225:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013697aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:31831:x1830881263095424:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065188.446352:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013697aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:31831:x1830881263095424:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 126us (474us total) trans 8589944218 rc 0/0 00000100:00100000:0.0:1746065188.446357:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4271 00000100:00100000:3.0:1746065188.446532:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013697b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31837:x1830881263095040:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 659us (754us total) trans 8589944219 rc 0/0 00000100:00100000:3.0:1746065188.446538:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4270 00000100:00100000:0.0:1746065188.449537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.450998:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263095552 00000100:00100000:2.0:1746065188.451010:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263095552 00000100:00100000:2.0:1746065188.451058:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14644 00000100:00100000:2.0:1746065188.451067:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881263095552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.451084:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.451101:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cb4 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.451125:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.451127:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.451136:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 28 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.451162:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 28 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.451173:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801355a2000, rc 0) 00000100:00100000:2.0:1746065188.451225:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+28:1958:x1830881263095552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 158us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.451231:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14644 00000100:00100000:0.0:1746065188.456617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.456722:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263095680 00000100:00100000:1.0:1746065188.456732:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263095680 00000100:00100000:1.0:1746065188.456804:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14645 00000100:00100000:1.0:1746065188.456847:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31834:x1830881263095680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.456870:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.456892:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cbb expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.456928:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.456936:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065188.456939:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065188.456942:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.456974:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.456994:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 27 pid: 8429 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.457007:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0029c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260368000:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065188.457116:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.460229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.460350:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263095936 00000100:00100000:3.0:1746065188.460357:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263095936 00000100:00100000:3.0:1746065188.460890:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4272 00000100:00100000:3.0:1746065188.460898:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:31828:x1830881263095936:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065188.462044:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:31828:x1830881263095936:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1143us (1817us total) trans 8589944220 rc 0/0 00000100:00100000:3.0:1746065188.462055:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4272 00000100:00100000:0.0:1746065188.466715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.466810:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096064 00000100:00100000:2.0:1746065188.466841:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096064 00002000:00100000:2.0:1746065188.466882:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094090700 x1830881263096064/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 504/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.466892:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090700 with x1830881263096064 ext(1048576->2097151) 00010000:00010000:2.0:1746065188.466903:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 28 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.466917:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 28 pid: 8429 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746065188.466923:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094090700 00000100:00100000:2.0:1746065188.466972:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2514 00000100:00100000:2.0:1746065188.466981:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263096064:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065188.467190:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0029c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260368000:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065188.467215:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.467229:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50bb800, rc 0) 00000100:00100000:1.0:1746065188.467794:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:31834:x1830881263095680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10982us (11187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065188.467800:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14645 00000100:00100000:2.0:1746065188.481059:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263096064:12345-192.168.202.46@tcp:4:cat.0 Request processed in 14066us (14339us total) trans 17179873618 rc 0/0 00000100:00100000:2.0:1746065188.481072:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2514 00002000:00100000:2.0:1746065188.481084:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094090700 x1830881263096064/t17179873618(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 504/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.481094:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090700 with x1830881263096064 ext(1048576->2097151) 00010000:00010000:2.0:1746065188.481106:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 30 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.481121:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 30 pid: 8429 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746065188.481128:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094090700 00000100:00100000:0.0:1746065188.486431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.486577:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096192 00000100:00100000:3.0:1746065188.486586:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096192 00010000:00010000:3.0:1746065188.486626:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 30 pid: 8429 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.486683:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7509 00000100:00100000:3.0:1746065188.486691:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263096192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.486704:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.486721:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 30 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.486732:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 30 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.486751:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e3e9c00/0x14b4f8542d4fcf61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bdb expref: 30 pid: 8429 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.486783:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.486785:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.486792:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.486800:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.486854:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.486866:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260368128:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.487893:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.493904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.494175:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096448 00000100:00100000:2.0:1746065188.494183:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096448 00002000:00100000:2.0:1746065188.494227:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094090e00 x1830881263096448/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.494242:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090e00 with x1830881263096448 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.494247:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094090e00 00000100:00100000:3.0:1746065188.494380:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260368128:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.494394:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.494438:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881263096192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7747us (8017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.494447:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7509 00000100:00100000:2.0:1746065188.494595:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8245 00000100:00100000:2.0:1746065188.494603:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263096448:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.507317:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263096448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12701us (13410us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.507331:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8245 00002000:00100000:2.0:1746065188.507348:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094090e00 x1830881263096448/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.507357:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090e00 with x1830881263096448 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.507363:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094090e00 00000100:00100000:0.0:1746065188.513461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.513864:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096576 00000100:00100000:1.0:1746065188.513871:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096576 00000100:00100000:1.0:1746065188.513914:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14646 00000100:00100000:1.0:1746065188.513920:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31834:x1830881263096576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.513935:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.513954:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cc2 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.513982:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 24 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.513993:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065188.513995:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065188.513998:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.514021:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 24 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.514031:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 24 pid: 2463 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.514042:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0029c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260368256:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065188.514143:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.517030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.517310:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0029c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260368256:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065188.517341:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.517357:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013507be00, rc 0) 00000100:00100000:1.0:1746065188.517423:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31834:x1830881263096576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3500us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065188.517430:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14646 00000100:00100000:2.0:1746065188.517543:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096704 00000100:00100000:2.0:1746065188.517551:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096704 00002000:00100000:2.0:1746065188.517591:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1630207) req@ffff880094091500 x1830881263096704/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.517600:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091500 with x1830881263096704 ext(1048576->1630207) 00010000:00010000:2.0:1746065188.517607:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 25 pid: 2463 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.517619:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 25 pid: 2463 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746065188.517625:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094091500 00000100:00100000:2.0:1746065188.517647:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2515 00000100:00100000:2.0:1746065188.517655:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263096704:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065188.529424:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881263096704:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11757us (12390us total) trans 21474840894 rc 0/0 00000100:00100000:2.0:1746065188.529435:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2515 00002000:00100000:2.0:1746065188.529447:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1630207) req@ffff880094091500 x1830881263096704/t21474840894(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.529457:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091500 with x1830881263096704 ext(1048576->1630207) 00010000:00010000:2.0:1746065188.529466:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 27 pid: 2463 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.529480:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 27 pid: 2463 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746065188.529486:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094091500 00000100:00100000:0.0:1746065188.531403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.531583:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096832 00000100:00100000:3.0:1746065188.531591:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096832 00010000:00010000:3.0:1746065188.531620:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 27 pid: 2463 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.531656:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7510 00000100:00100000:3.0:1746065188.531663:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881263096832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.531675:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065188.531690:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065188 -> 1746065189 00002000:00010000:3.0:1746065188.531693:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065188 -> 1746065189 00010000:00010000:3.0:1746065188.531697:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 27 pid: 2463 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.531707:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 27 pid: 2463 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.531727:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801355a2c00/0x14b4f8542d4fd0aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1630207) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c98 expref: 27 pid: 2463 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.531768:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.531770:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.531776:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.531783:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.531842:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.531853:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260368384:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.531925:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.535060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.535101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.535161:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263097216 00000100:00100000:2.0:1746065188.535168:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263097216 00002000:00100000:2.0:1746065188.535207:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880094091f80 x1830881263097216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.535216:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091f80 with x1830881263097216 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.535221:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094091f80 00000100:00100000:2.0:1746065188.535245:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8246 00000100:00100000:2.0:1746065188.535252:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263097216:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065188.535321:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260368384:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.535335:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.535373:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263096832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3710us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.535381:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7510 00000100:00100000:1.0:1746065188.535454:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263096960 00000100:00100000:1.0:1746065188.535458:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263096960 00000100:00100000:1.0:1746065188.535492:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14647 00000100:00100000:1.0:1746065188.535502:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:31837:x1830881263096960:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065188.535511:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.535524:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cc9 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.535543:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.535551:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 30 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.535556:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.535557:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.535560:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3493888->4194303] (req 3493888->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.535580:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 30 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.535588:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 30 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746065188.535597:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0029c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260368512:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065188.535647:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.535654:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 28 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.535665:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0029500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260368640:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065188.536383:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.538712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.539212:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0029c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260368512:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065188.539223:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0029500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260368640:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065188.539257:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3493888->4194303] (req 3493888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.539272:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013507b400, rc 0) 00000100:00100000:1.0:1746065188.539303:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31837:x1830881263096960:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3804us (4249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065188.539309:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14647 00000100:00100000:2.0:1746065188.539524:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263097344 00000100:00100000:2.0:1746065188.539531:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263097344 00010000:00010000:2.0:1746065188.539561:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 30 pid: 8851 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.540088:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7511 00000100:00100000:2.0:1746065188.540096:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263097344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.540107:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.540124:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 30 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.540133:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 30 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.540151:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801355a3c00/0x14b4f8542d4fd08e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c7c expref: 30 pid: 8851 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.540750:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.540884:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263097344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 786us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.540890:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7511 00000100:00100000:2.0:1746065188.541861:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263097216:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 6607us (6756us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.541869:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8246 00002000:00100000:2.0:1746065188.541878:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880094091f80 x1830881263097216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.541886:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091f80 with x1830881263097216 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.541890:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094091f80 00000100:00100000:0.0:1746065188.542047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.542084:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263097472 00000100:00100000:2.0:1746065188.542090:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263097472 00010000:00010000:2.0:1746065188.542110:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 29 pid: 4544 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.542139:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7512 00000100:00100000:2.0:1746065188.542146:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1959:x1830881263097472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.542156:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.542173:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 29 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.542182:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 29 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.542199:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a210a00/0x14b4f8542d4fd025 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c4b expref: 29 pid: 4544 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.542208:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.542210:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.542215:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.542222:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.542249:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.542258:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260368768:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.542316:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.544591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.544639:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263097728 00000100:00100000:3.0:1746065188.544645:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263097728 00000100:00100000:0.0:1746065188.544663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065188.544685:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3493888->3497983) req@ffff880094092680 x1830881263097728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.544694:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094092680 with x1830881263097728 ext(3493888->3497983) 00002000:00010000:3.0:1746065188.544698:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094092680 00000100:00100000:3.0:1746065188.544713:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8247 00000100:00100000:3.0:1746065188.544719:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263097728:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065188.544744:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260368768:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.544773:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.544804:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263097472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2658us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.544811:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7512 00000100:00100000:3.0:1746065188.544864:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263097728:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 146us (280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065188.544870:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8247 00002000:00100000:3.0:1746065188.544874:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3493888->3497983) req@ffff880094092680 x1830881263097728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.544880:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094092680 with x1830881263097728 ext(3493888->3497983) 00000100:00100000:1.0:1746065188.544880:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263097856 00002000:00010000:3.0:1746065188.544883:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094092680 00000100:00100000:1.0:1746065188.544884:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263097856 00000100:00100000:1.0:1746065188.544911:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14648 00000100:00100000:1.0:1746065188.544914:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31834:x1830881263097856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.544921:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.544933:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cd0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.544958:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.544960:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.544966:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.544983:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.544991:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013507b600, rc 0) 00000100:00100000:1.0:1746065188.545025:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31834:x1830881263097856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 108us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065188.545030:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14648 00000100:00100000:0.0:1746065188.550947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.550990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.551022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.551060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.551147:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263098112 00000100:00100000:2.0:1746065188.551155:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263098112 00002000:00100000:2.0:1746065188.551191:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094092d80 x1830881263098112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.551200:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094092d80 with x1830881263098112 ext(2097152->3145727) 00002000:00010000:2.0:1746065188.551204:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094092d80 00000100:00100000:1.0:1746065188.551206:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263098368 00000100:00100000:1.0:1746065188.551209:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263098368 00000100:00100000:2.0:1746065188.551217:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263098624 00000100:00100000:2.0:1746065188.551218:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263098624 00002000:00100000:1.0:1746065188.551223:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094093100 x1830881263098368/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.551227:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094093480 x1830881263098624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.551229:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093100 with x1830881263098368 ext(3145728->4194303) 00002000:00010000:1.0:1746065188.551232:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094093100 00002000:00100000:2.0:1746065188.551233:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093480 with x1830881263098624 ext(2097152->3145727) 00002000:00010000:2.0:1746065188.551235:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094093480 00000100:00100000:1.0:1746065188.551251:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263098752 00000100:00100000:1.0:1746065188.551253:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263098752 00000100:00100000:2.0:1746065188.551255:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8248 00000100:00100000:2.0:1746065188.551261:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263098112:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:1.0:1746065188.551262:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3493887) req@ffff880094093800 x1830881263098752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.551267:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093800 with x1830881263098752 ext(3145728->3493887) 00002000:00010000:1.0:1746065188.551269:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094093800 00000100:00100000:1.0:1746065188.551279:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8249 00000100:00100000:1.0:1746065188.551282:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263098368:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065188.551288:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8250 00000100:00100000:3.0:1746065188.551295:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881263098624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.551312:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8251 00000100:00100000:1.0:1746065188.551316:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263098752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.558413:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263098752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7087us (7342us total) trans 0 rc 348160/348160 00000100:00100000:1.0:1746065188.558424:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8251 00002000:00100000:1.0:1746065188.558434:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3493887) req@ffff880094093800 x1830881263098752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 348160/348160 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.558443:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093800 with x1830881263098752 ext(3145728->3493887) 00002000:00010000:1.0:1746065188.558448:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094093800 00000100:00100000:2.0:1746065188.560614:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263098112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9346us (9667us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.560624:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8248 00002000:00100000:2.0:1746065188.560632:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094092d80 x1830881263098112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.560646:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094092d80 with x1830881263098112 ext(2097152->3145727) 00002000:00010000:2.0:1746065188.560650:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094092d80 00000100:00100000:3.0:1746065188.568511:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263098624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17205us (17476us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065188.568524:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8250 00002000:00100000:3.0:1746065188.568541:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094093480 x1830881263098624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.568551:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093480 with x1830881263098624 ext(2097152->3145727) 00002000:00010000:3.0:1746065188.568558:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094093480 00000100:00100000:0.0:1746065188.569260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.569313:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263099008 00000100:00100000:3.0:1746065188.569321:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263099008 00000100:00100000:3.0:1746065188.569358:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14649 00000100:00100000:3.0:1746065188.569364:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31837:x1830881263099008:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065188.569378:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.569395:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cd7 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.569424:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.569432:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.569438:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.569440:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.569444:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4210687] (req 4194304->4210687) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 36 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.569475:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.569487:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 36 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.569500:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260368896:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.569570:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 25 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.569579:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 25 pid: 25185 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.569586:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260369024:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065188.569604:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.569998:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263098368:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18712us (19005us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.570011:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8249 00002000:00100000:2.0:1746065188.570018:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094093100 x1830881263098368/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.570025:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093100 with x1830881263098368 ext(3145728->4194303) 00010000:00010000:2.0:1746065188.570031:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 35 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.570040:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 35 pid: 9716 timeout: 887 lvb_type: 0 00002000:00010000:2.0:1746065188.570046:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094093100 00000100:00100000:3.0:1746065188.574691:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260368896:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065188.574704:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260369024:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.574738:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4210687] (req 4194304->4210687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 34 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.574769:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5a9800, rc 0) 00000100:00100000:3.0:1746065188.574842:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31837:x1830881263099008:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5476us (5583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.574850:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14649 00000100:00100000:0.0:1746065188.575088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.575236:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263099136 00000100:00100000:2.0:1746065188.575243:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263099136 00010000:00010000:2.0:1746065188.575267:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 26 pid: 25185 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.575287:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7513 00000100:00100000:2.0:1746065188.575293:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263099136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.575303:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.575319:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 26 pid: 25185 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.575329:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 26 pid: 25185 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.575351:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4f2200/0x14b4f8542d4fd09c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c8a expref: 26 pid: 25185 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.575383:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.575405:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263099136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.575416:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7513 00000100:00100000:0.0:1746065188.576265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.576315:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263099264 00000100:00100000:3.0:1746065188.576318:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263099264 00000100:00100000:3.0:1746065188.576369:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14650 00000100:00100000:3.0:1746065188.576375:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31834:x1830881263099264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.576386:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.576395:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cde expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.576407:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.576409:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.576414:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 35 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.576425:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 35 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.576440:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5a9200, rc 0) 00000100:00100000:3.0:1746065188.576599:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31834:x1830881263099264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 223us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.576603:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14650 00000100:00100000:0.0:1746065188.582131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.582185:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.582200:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263099392 00000100:00100000:3.0:1746065188.582239:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263099648 00000100:00100000:3.0:1746065188.582250:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263099648 00002000:00100000:3.0:1746065188.582286:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800a0144380 x1830881263099648/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.582299:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0144380 with x1830881263099648 ext(3145728->4194303) 00002000:00010000:3.0:1746065188.582304:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0144380 00000100:00100000:3.0:1746065188.582325:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8252 00000100:00100000:3.0:1746065188.582336:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263099648:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.583126:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263099392 00010000:00010000:2.0:1746065188.583143:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 37 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.583176:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7514 00000100:00100000:2.0:1746065188.583182:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881263099392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.583190:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.583590:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 37 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.583602:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 37 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.583623:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013507b600/0x14b4f8542d4fd0fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd0 expref: 37 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.584683:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.584687:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.584695:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 36 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.584704:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 36 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.584738:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 36 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.584750:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260369152:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.584834:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.589180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.589300:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263099904 00000100:00100000:3.0:1746065188.589307:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263099904 00000100:00100000:3.0:1746065188.589342:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9978 00000100:00100000:3.0:1746065188.589348:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:31841:x1830881263099904:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065188.589367:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.589381:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9600/0x14b4f8542d4fd113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ce5 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.589462:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589472:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589483:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589493:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589497:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589501:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589575:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8c00/0x14b4f8542d4fd128 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589582:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8c00/0x14b4f8542d4fd128 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589587:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8c00/0x14b4f8542d4fd128 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065188.589594:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065188.589660:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589665:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589671:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589675:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5a9400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.589679:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589686:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589694:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065188.589696:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.589700:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.589704:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9400/0x14b4f8542d4fd11a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000100:00100000:2.0:1746065188.590559:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260369152:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.590575:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.590611:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263099392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7429us (8497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.590619:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7514 00000100:00100000:0.0:1746065188.591467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.591488:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100160 00000100:00100000:0.0:1746065188.591492:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100160 00002000:00100000:0.0:1746065188.591523:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4206592->4210687) req@ffff8800a0144a80 x1830881263100160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.591531:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0144a80 with x1830881263100160 ext(4206592->4210687) 00002000:00010000:0.0:1746065188.591535:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0144a80 00010000:00010000:3.0:1746065188.591575:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.591582:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.591588:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.591593:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5a8e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.591595:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.591601:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.591611:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205200) 00000100:00100000:0.0:1746065188.591612:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8253 00010000:00010000:3.0:1746065188.591614:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.591616:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065188.591618:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263100160:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065188.591621:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8e00/0x14b4f8542d4fd121 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.591665:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9600/0x14b4f8542d4fd113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ce5 expref: 19 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.591675:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8c00/0x14b4f8542d4fd128 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ce5 expref: 18 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065188.591736:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263100160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 119us (270us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065188.591742:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8253 00002000:00100000:0.0:1746065188.591747:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4206592->4210687) req@ffff8800a0144a80 x1830881263100160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.591762:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0144a80 with x1830881263100160 ext(4206592->4210687) 00002000:00010000:0.0:1746065188.591765:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0144a80 00010000:00010000:3.0:1746065188.592054:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.592056:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065188.592058:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5a8c00, rc 0) 00000100:00100000:3.0:1746065188.592090:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:31841:x1830881263099904:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2742us (2917us total) trans 8589944221 rc 0/0 00000100:00100000:3.0:1746065188.592096:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9978 00000100:00100000:3.0:1746065188.592310:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263099648:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9978us (10123us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065188.592316:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8252 00002000:00100000:3.0:1746065188.592321:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800a0144380 x1830881263099648/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.592327:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0144380 with x1830881263099648 ext(3145728->4194303) 00002000:00010000:3.0:1746065188.592330:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0144380 00000100:00100000:0.0:1746065188.600560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.600598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.600620:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100672 00000100:00100000:3.0:1746065188.600628:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100672 00000100:00100000:0.0:1746065188.600629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.600664:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9979 00000100:00100000:3.0:1746065188.600671:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:31844:x1830881263100672:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065188.600681:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100288 00000100:00100000:2.0:1746065188.600685:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100288 00010000:00010000:3.0:1746065188.600690:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.600704:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9000/0x14b4f8542d4fd136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cf3 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.600707:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 765 00000100:00100000:2.0:1746065188.600711:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263100288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.600721:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.600737:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8c00/0x14b4f8542d4fd128 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ce5 expref: 20 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.600766:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065188.600770:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065188.600801:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00000100:00100000:2.0:1746065188.600803:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263100288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.600808:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 765 00010000:00010000:3.0:1746065188.600811:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.600835:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.600846:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.600851:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.600860:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.600944:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8600/0x14b4f8542d4fd14b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.600952:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8600/0x14b4f8542d4fd14b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601431:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8600/0x14b4f8542d4fd14b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065188.601441:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065188.601510:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601516:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601525:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601529:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5a8a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.601532:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601538:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601545:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065188.601547:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.601551:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601555:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8a00/0x14b4f8542d4fd13d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601563:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601568:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601572:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601576:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5a8800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.601578:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601582:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601590:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205e00) 00010000:00010000:3.0:1746065188.601591:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.601593:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601597:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8800/0x14b4f8542d4fd144 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.601628:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a9000/0x14b4f8542d4fd136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cf3 expref: 20 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.601638:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8600/0x14b4f8542d4fd14b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cf3 expref: 19 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.601643:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.601645:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065188.601646:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5a8600, rc 0) 00000100:00100000:2.0:1746065188.603105:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100416 00000100:00100000:2.0:1746065188.603112:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100416 00000100:00100000:2.0:1746065188.603144:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14651 00000100:00100000:2.0:1746065188.603150:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263100416:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.603162:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.603173:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc42800/0x14b4f8542d4fd159 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cec expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.603211:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260369280:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065188.604417:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.605009:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+19:31844:x1830881263100672:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4334us (4452us total) trans 8589944222 rc 0/0 00000100:00100000:3.0:1746065188.605018:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9979 00002000:00010000:2.0:1746065188.606421:0:2463:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065188 -> 1746065189 00000100:00100000:0.0:1746065188.606421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.606438:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260369280:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065188.606439:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100800 00000100:00100000:0.0:1746065188.606443:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100800 00010000:00010000:2.0:1746065188.606460:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc42800/0x14b4f8542d4fd159 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cec expref: 35 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.606470:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc42800/0x14b4f8542d4fd159 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cec expref: 35 pid: 2463 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065188.606471:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 766 00000100:00100000:0.0:1746065188.606477:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263100800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.606479:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc42800, rc 0) 00010000:00010000:0.0:1746065188.606485:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065188.606499:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5a8600/0x14b4f8542d4fd14b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cf3 expref: 19 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.606505:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263100416:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3356us (5875us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065188.606511:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14651 00010000:00010000:0.0:1746065188.606519:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065188.606522:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065188.606535:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263100800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065188.606541:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 766 00000100:00100000:0.0:1746065188.606653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.606744:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263101056 00000100:00100000:2.0:1746065188.606747:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263101056 00000100:00100000:2.0:1746065188.606785:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14652 00000100:00100000:2.0:1746065188.606791:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263101056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.606801:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.606810:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d01 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.606876:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.606879:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.606885:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 26 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.606897:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 26 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.606905:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc42a00, rc 0) 00000100:00100000:2.0:1746065188.606959:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263101056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 168us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.606964:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14652 00000100:00100000:0.0:1746065188.607100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.607149:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263100928 00000100:00100000:3.0:1746065188.607152:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263100928 00000100:00100000:0.0:1746065188.607189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.607219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.607225:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263101184 00000100:00100000:1.0:1746065188.607228:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263101184 00000100:00100000:1.0:1746065188.607243:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263101312 00000100:00100000:1.0:1746065188.607244:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263101312 00000100:00100000:1.0:1746065188.607256:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14653 00000100:00100000:3.0:1746065188.607259:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14654 00000100:00100000:1.0:1746065188.607260:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263101184:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065188.607264:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263101312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.607266:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.607269:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.607273:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6be00/0x14b4f8542d4fd167 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d08 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.607276:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5a8400/0x14b4f8542d4fd16e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d0f expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.607299:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260369536:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065188.607299:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0029500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260369408:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065188.607345:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14655 00000100:00100000:0.0:1746065188.607350:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881263100928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065188.607356:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065188.607362:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60cfa expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.607371:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065188.607373:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065188.607377:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 31 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065188.607386:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 31 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065188.607392:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c764000, rc 0) 00000100:00100000:3.0:1746065188.607444:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.607519:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881263100928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 168us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065188.607524:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14655 00000100:00100000:1.0:1746065188.607585:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.609720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:2.0:1746065188.609811:0:2463:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065187 -> 1746065189 00000100:00100000:2.0:1746065188.609843:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260369536:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065188.609866:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5a8400/0x14b4f8542d4fd16e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d0f expref: 30 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.609881:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5a8400/0x14b4f8542d4fd16e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d0f expref: 30 pid: 2463 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065188.609888:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263101568 00010000:00010000:2.0:1746065188.609889:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5a8400, rc 0) 00000100:00100000:3.0:1746065188.609892:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263101568 00000100:00100000:2.0:1746065188.609915:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263101312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2650us (2695us total) trans 0 rc 301/301 00002000:00100000:3.0:1746065188.609916:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4210688->5013503) req@ffff8800a0146a00 x1830881263101568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065188.609921:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14654 00002000:00100000:3.0:1746065188.609924:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0146a00 with x1830881263101568 ext(4210688->5013503) 00002000:00010000:3.0:1746065188.609928:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0146a00 00000100:00100000:3.0:1746065188.609946:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8254 00000100:00100000:3.0:1746065188.609952:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263101568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.610128:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0029500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260369408:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065188.610142:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6be00/0x14b4f8542d4fd167 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d08 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.610150:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6be00/0x14b4f8542d4fd167 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d08 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.610165:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1c6be00, rc 0) 00000100:00100000:1.0:1746065188.610181:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263101184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2921us (2993us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.610211:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14653 00000100:00100000:3.0:1746065188.614635:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263101568:12345-192.168.202.46@tcp:3:cat.0 Request processed in 4675us (4910us total) trans 0 rc 802816/802816 00000100:00100000:3.0:1746065188.614646:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8254 00002000:00100000:3.0:1746065188.614655:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4210688->5013503) req@ffff8800a0146a00 x1830881263101568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.614664:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0146a00 with x1830881263101568 ext(4210688->5013503) 00002000:00010000:3.0:1746065188.614668:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0146a00 00000100:00100000:0.0:1746065188.619369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.619724:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263101696 00000100:00100000:1.0:1746065188.619798:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263101696 00000100:00100000:1.0:1746065188.619882:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14656 00000100:00100000:1.0:1746065188.619889:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263101696:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.619903:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.619919:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b600/0x14b4f8542d4fd17c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d16 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065188.619964:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0029500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260369664:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065188.620723:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.622219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.622313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.622396:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263101952 00000100:00100000:2.0:1746065188.622402:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263101952 00002000:00100000:2.0:1746065188.622433:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff8800a0147100 x1830881263101952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.622440:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0147100 with x1830881263101952 ext(0->1048575) 00002000:00010000:2.0:1746065188.622444:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0147100 00000100:00100000:2.0:1746065188.622458:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263102208 00000100:00100000:2.0:1746065188.622460:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263102208 00002000:00100000:2.0:1746065188.622470:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a0147480 x1830881263102208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.622475:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0147480 with x1830881263102208 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.622477:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0147480 00000100:00100000:2.0:1746065188.622502:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8255 00000100:00100000:2.0:1746065188.622507:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263101952:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.622558:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8256 00000100:00100000:1.0:1746065188.622566:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881263102208:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.624201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.625034:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0029500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260369664:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065188.625061:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b600/0x14b4f8542d4fd17c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d16 expref: 35 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.625073:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b600/0x14b4f8542d4fd17c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d16 expref: 35 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.625096:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1c6b600, rc 0) 00000100:00100000:1.0:1746065188.625125:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263101696:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5236us (5765us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.625131:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14656 00000100:00100000:3.0:1746065188.625225:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263102464 00000100:00100000:3.0:1746065188.625230:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263102464 00002000:00100000:3.0:1746065188.625258:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8800a0029c00 x1830881263102464/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.625267:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0029c00 with x1830881263102464 ext(1048576->2097151) 00002000:00010000:3.0:1746065188.625271:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0029c00 00000100:00100000:3.0:1746065188.625297:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8257 00000100:00100000:3.0:1746065188.625303:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881263102464:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.625904:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.625985:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263102720 00000100:00100000:2.0:1746065188.625989:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263102720 00002000:00100000:2.0:1746065188.626010:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800a0029500 x1830881263102720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.626017:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0029500 with x1830881263102720 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.626020:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0029500 00000100:00100000:2.0:1746065188.626032:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8258 00000100:00100000:2.0:1746065188.626037:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263102720:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065188.631247:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881263102208:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8671us (8922us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.631257:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8256 00000100:00100000:0.0:1746065188.631257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:2.0:1746065188.631267:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800a0147480 x1830881263102208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.631275:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0147480 with x1830881263102208 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.631281:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0147480 00000100:00100000:1.0:1746065188.631320:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263102848 00000100:00100000:1.0:1746065188.631326:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263102848 00000100:00100000:1.0:1746065188.631355:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14657 00000100:00100000:1.0:1746065188.631359:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263102848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.631371:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.631384:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd183 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d1d expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065188.631417:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a002aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260369792:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065188.631484:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.638257:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263101952:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15740us (16033us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.638268:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8255 00002000:00100000:2.0:1746065188.638277:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff8800a0147100 x1830881263101952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.638286:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0147100 with x1830881263101952 ext(0->1048575) 00002000:00010000:2.0:1746065188.638291:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0147100 00000100:00100000:3.0:1746065188.638726:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263102464:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13421us (14527us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065188.638733:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8257 00002000:00100000:3.0:1746065188.638738:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8800a0029c00 x1830881263102464/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.638745:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0029c00 with x1830881263102464 ext(1048576->2097151) 00002000:00010000:3.0:1746065188.638748:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0029c00 00000100:00100000:1.0:1746065188.642461:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a002aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260369792:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065188.642494:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd183 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d1d expref: 35 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.642506:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd183 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d1d expref: 35 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.642648:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596cc00, rc 0) 00000100:00100000:2.0:1746065188.642951:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263102720:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16909us (17042us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065188.642951:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263102848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11589us (11692us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.642959:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14657 00000100:00100000:2.0:1746065188.642961:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8258 00002000:00100000:2.0:1746065188.642971:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800a0029500 x1830881263102720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.642980:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0029500 with x1830881263102720 ext(1048576->2097151) 00002000:00010000:2.0:1746065188.642984:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0029500 00000100:00100000:0.0:1746065188.656648:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.656694:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.656767:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263102976 00000100:00100000:1.0:1746065188.656776:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263102976 00000100:00100000:1.0:1746065188.656835:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14658 00000100:00100000:1.0:1746065188.656843:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263102976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.656857:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.656886:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f08d800/0x14b4f8542d4fd18a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d24 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065188.656930:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a002aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260369920:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065188.656994:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.657046:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263103232 00000100:00100000:3.0:1746065188.657054:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263103232 00000100:00100000:3.0:1746065188.657078:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4273 00000100:00100000:3.0:1746065188.657082:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b51f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31834:x1830881263103232:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065188.657225:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b51f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31834:x1830881263103232:12345-192.168.202.46@tcp:35:cat.0 Request processed in 141us (530us total) trans 8589944223 rc 0/0 00000100:00100000:3.0:1746065188.657231:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4273 00000100:00100000:0.0:1746065188.665721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.665872:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263103360 00000100:00100000:2.0:1746065188.665880:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263103360 00000100:00100000:2.0:1746065188.665916:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14659 00000100:00100000:2.0:1746065188.665922:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+29:1958:x1830881263103360:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.665938:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.665953:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc43600/0x14b4f8542d4fd191 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d2b expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065188.665992:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a002aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260369920:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065188.665997:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260370048:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065188.666018:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f08d800/0x14b4f8542d4fd18a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d24 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.666037:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f08d800/0x14b4f8542d4fd18a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d24 expref: 27 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.666054:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f08d800, rc 0) 00000100:00100000:2.0:1746065188.666067:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065188.666095:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263102976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9252us (9455us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.666101:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14658 00000100:00100000:2.0:1746065188.667214:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260370048:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065188.667232:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc43600/0x14b4f8542d4fd191 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d2b expref: 30 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.667241:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc43600/0x14b4f8542d4fd191 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d2b expref: 30 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.669839:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc43600, rc 0) 00000100:00100000:2.0:1746065188.669915:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+29:1958:x1830881263103360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3988us (4201us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065188.669923:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14659 00000100:00100000:0.0:1746065188.672640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.672742:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263103488 00000100:00100000:2.0:1746065188.672751:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263103488 00000100:00100000:1.0:1746065188.674023:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14660 00000100:00100000:1.0:1746065188.674034:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+26:31844:x1830881263103488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.674051:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.674066:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d32 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.674089:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.674090:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.674096:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.674107:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.674115:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a596cc00, rc 0) 00000100:00100000:1.0:1746065188.674160:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:31844:x1830881263103488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 129us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065188.674166:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14660 00000100:00100000:0.0:1746065188.676694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.676951:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263103616 00000100:00100000:2.0:1746065188.676959:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263103616 00000100:00100000:2.0:1746065188.676996:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14661 00000100:00100000:2.0:1746065188.677003:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+29:31841:x1830881263103616:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065188.677016:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.677030:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d39 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.677052:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.677059:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 30 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.677065:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.677066:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.677069:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 30 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.677098:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 30 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.677109:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 30 pid: 4544 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.677119:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260370176:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065188.677218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065188.677283:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.677291:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 28 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.677298:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260370304:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.677328:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.677389:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263103872 00000100:00100000:3.0:1746065188.677393:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263103872 00002000:00100000:3.0:1746065188.677418:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880129b50a80 x1830881263103872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.677426:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b50a80 with x1830881263103872 ext(2097152->3145727) 00002000:00010000:3.0:1746065188.677429:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b50a80 00000100:00100000:3.0:1746065188.677442:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8259 00000100:00100000:3.0:1746065188.677447:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263103872:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065188.681619:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260370176:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.681632:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260370304:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.681661:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 30 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.681676:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc43e00, rc 0) 00000100:00100000:2.0:1746065188.681726:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+30:31841:x1830881263103616:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4722us (5037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.681733:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14661 00000100:00100000:0.0:1746065188.683316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.683383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.683444:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104000 00000100:00100000:2.0:1746065188.683449:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104000 00010000:00010000:2.0:1746065188.683473:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 29 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.683498:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104128 00000100:00100000:2.0:1746065188.683499:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104128 00010000:00010000:2.0:1746065188.683506:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 30 pid: 4544 timeout: 887 lvb_type: 1 00000100:00100000:2.0:1746065188.683525:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7515 00000100:00100000:2.0:1746065188.683530:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263104000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.683542:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.683558:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 29 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.683566:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 29 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.683583:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50bb800/0x14b4f8542d4fd0e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cbb expref: 29 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.683595:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.683618:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881263104000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.683624:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7515 00000100:00100000:2.0:1746065188.683636:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7516 00000100:00100000:2.0:1746065188.683641:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881263104128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.683647:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.683654:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 30 pid: 4544 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.683662:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 30 pid: 4544 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.683672:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c764000/0x14b4f8542d4fd175 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cfa expref: 30 pid: 4544 timeout: 887 lvb_type: 1 00010000:00010000:2.0:1746065188.683690:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.683692:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.683697:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.683704:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.683731:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.683741:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260370432:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.683799:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.685016:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263103872:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 7566us (7795us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065188.685025:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8259 00002000:00100000:3.0:1746065188.685033:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880129b50a80 x1830881263103872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.685045:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b50a80 with x1830881263103872 ext(2097152->3145727) 00002000:00010000:3.0:1746065188.685049:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b50a80 00000100:00100000:3.0:1746065188.685292:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260370432:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.685304:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.685322:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263104128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1681us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.685329:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7516 00000100:00100000:0.0:1746065188.685732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.685865:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104384 00000100:00100000:3.0:1746065188.685871:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104384 00002000:00100000:3.0:1746065188.685896:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1687552->1691647) req@ffff880129b51180 x1830881263104384/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.685903:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b51180 with x1830881263104384 ext(1687552->1691647) 00002000:00010000:3.0:1746065188.685907:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b51180 00000100:00100000:3.0:1746065188.685951:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8260 00000100:00100000:3.0:1746065188.685958:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263104384:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065188.686213:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263104384:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 255us (481us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065188.686218:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8260 00002000:00100000:3.0:1746065188.686223:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1687552->1691647) req@ffff880129b51180 x1830881263104384/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.686229:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b51180 with x1830881263104384 ext(1687552->1691647) 00002000:00010000:3.0:1746065188.686232:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b51180 00000100:00100000:0.0:1746065188.688672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.688946:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104512 00000100:00100000:2.0:1746065188.688953:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104512 00000100:00100000:2.0:1746065188.689397:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14662 00000100:00100000:2.0:1746065188.689406:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+29:31844:x1830881263104512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.689422:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.689438:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d40 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.689465:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.689473:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.689476:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.689479:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 30 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.689508:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.689519:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 27 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.689531:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260370560:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.689611:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.690992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.691238:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104640 00000100:00100000:1.0:1746065188.691244:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104640 00000100:00100000:1.0:1746065188.691278:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14663 00000100:00100000:1.0:1746065188.691285:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:31841:x1830881263104640:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065188.691299:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.691314:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d47 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.691334:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.691346:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 28 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.691352:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.691354:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.691357:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->1314815] (req 1048576->1314815) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.691378:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 28 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.691387:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 28 pid: 2463 timeout: 887 lvb_type: 1 00000100:00100000:1.0:1746065188.691395:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a002aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260370688:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065188.691466:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.691474:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 33 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1746065188.691482:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a002b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260370816:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065188.691499:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.691644:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260370560:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.691665:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 30 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.691675:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc42800, rc 0) 00000100:00100000:2.0:1746065188.691693:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+30:31844:x1830881263104512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2289us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.691699:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14662 00000100:00100000:0.0:1746065188.691712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.691769:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104768 00000100:00100000:3.0:1746065188.691773:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104768 00002000:00100000:3.0:1746065188.691795:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3493888->4194303) req@ffff880129b51c00 x1830881263104768/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.691804:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b51c00 with x1830881263104768 ext(3493888->4194303) 00010000:00010000:3.0:1746065188.691809:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 28 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.691900:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 28 pid: 9716 timeout: 887 lvb_type: 0 00002000:00010000:3.0:1746065188.691906:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129b51c00 00000100:00100000:3.0:1746065188.691931:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2516 00000100:00100000:3.0:1746065188.691937:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263104768:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065188.695392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.695440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.695513:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263104896 00000100:00100000:3.0:1746065188.695521:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263104896 00010000:00010000:3.0:1746065188.695553:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 34 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1746065188.695576:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263105024 00000100:00100000:3.0:1746065188.695578:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263105024 00010000:00010000:3.0:1746065188.695587:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 29 pid: 2463 timeout: 887 lvb_type: 1 00000100:00100000:3.0:1746065188.695614:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7517 00000100:00100000:3.0:1746065188.695620:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263104896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.695631:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.695650:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 34 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.695659:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 34 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1746065188.695688:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7518 00000100:00100000:0.0:1746065188.695695:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881263105024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065188.695702:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065188.695881:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a002aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260370688:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.695893:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013507be00/0x14b4f8542d4fd0f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc2 expref: 34 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.695919:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a002b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260370816:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.696164:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065188.696197:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 29 pid: 2463 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746065188.696207:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 29 pid: 2463 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746065188.696219:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc42a00/0x14b4f8542d4fd160 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d01 expref: 29 pid: 2463 timeout: 887 lvb_type: 1 00010000:00010000:0.0:1746065188.696240:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065188.696242:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065188.696248:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.696255:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.696266:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.696275:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c813200, rc 0) 00010000:00010000:0.0:1746065188.696277:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065188.696287:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260370944:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.696330:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263104896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 709us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.696337:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7517 00000100:00100000:2.0:1746065188.696444:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+28:31841:x1830881263104640:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5159us (5456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.696450:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14663 00000100:00100000:0.0:1746065188.696473:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.700506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.701265:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263105280 00000100:00100000:2.0:1746065188.701272:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263105280 00000100:00100000:3.0:1746065188.701278:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263104768:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9340us (9565us total) trans 17179873619 rc 0/0 00000100:00100000:3.0:1746065188.701287:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2516 00002000:00100000:3.0:1746065188.701296:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3493888->4194303) req@ffff880129b51c00 x1830881263104768/t17179873619(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.701299:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1310720->1314815) req@ffff880129b52300 x1830881263105280/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.701304:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b51c00 with x1830881263104768 ext(3493888->4194303) 00002000:00100000:2.0:1746065188.701305:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b52300 with x1830881263105280 ext(1310720->1314815) 00002000:00010000:2.0:1746065188.701308:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b52300 00010000:00010000:3.0:1746065188.701311:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1746065188.701323:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.701329:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8261 00002000:00010000:3.0:1746065188.701333:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129b51c00 00000100:00100000:2.0:1746065188.701333:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263105280:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065188.701422:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260370944:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065188.701444:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065188.701462:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263105024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5768us (6022us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065188.701469:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7518 00000100:00100000:2.0:1746065188.701588:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881263105280:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 254us (1090us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065188.701594:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8261 00002000:00100000:2.0:1746065188.701599:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1310720->1314815) req@ffff880129b52300 x1830881263105280/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.701605:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b52300 with x1830881263105280 ext(1310720->1314815) 00002000:00010000:2.0:1746065188.701607:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b52300 00000100:00100000:0.0:1746065188.704607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.704655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.704669:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263105536 00000100:00100000:1.0:1746065188.704677:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263105536 00000100:00100000:2.0:1746065188.704732:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263105664 00000100:00100000:2.0:1746065188.704735:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263105664 00010000:00010000:2.0:1746065188.704768:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1746065188.704806:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7519 00000100:00100000:2.0:1746065188.704813:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263105664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.704848:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.704865:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.704875:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.704895:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013507b400/0x14b4f8542d4fd0f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cc9 expref: 30 pid: 9716 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1746065188.704918:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.704920:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.704928:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.704936:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.704965:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.704976:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260371072:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.705049:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065188.705214:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4274 00000100:00100000:1.0:1746065188.705222:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:31841:x1830881263105536:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065188.705382:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+19:31841:x1830881263105536:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 160us (781us total) trans 8589944224 rc 0/0 00000100:00100000:1.0:1746065188.705388:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4274 00000100:00100000:2.0:1746065188.710005:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260371072:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.710028:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.710073:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263105664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5259us (5416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.710082:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7519 00000100:00100000:0.0:1746065188.714669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.714706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.714773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.714811:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263105920 00000100:00100000:3.0:1746065188.714842:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263105920 00002000:00100000:3.0:1746065188.714879:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880129b52d80 x1830881263105920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.714893:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b52d80 with x1830881263105920 ext(2097152->3145727) 00002000:00010000:3.0:1746065188.714897:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b52d80 00000100:00100000:3.0:1746065188.714912:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263106048 00000100:00100000:3.0:1746065188.714914:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263106048 00002000:00100000:3.0:1746065188.714923:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880129b53100 x1830881263106048/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065188.714924:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263106432 00000100:00100000:2.0:1746065188.714928:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263106432 00002000:00100000:3.0:1746065188.714929:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b53100 with x1830881263106048 ext(3145728->4194303) 00002000:00010000:3.0:1746065188.714931:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b53100 00002000:00100000:2.0:1746065188.714941:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880129b53480 x1830881263106432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065188.714942:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8262 00002000:00100000:2.0:1746065188.714947:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b53480 with x1830881263106432 ext(3145728->4194303) 00000100:00100000:3.0:1746065188.714948:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881263105920:12345-192.168.202.46@tcp:3:multiop.0 00002000:00010000:2.0:1746065188.714949:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b53480 00000100:00100000:2.0:1746065188.714973:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8263 00000100:00100000:2.0:1746065188.714978:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881263106048:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065188.715971:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8264 00000100:00100000:2.0:1746065188.715978:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263106432:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065188.725186:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881263106048:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10200us (10471us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.725196:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8263 00002000:00100000:2.0:1746065188.725205:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880129b53100 x1830881263106048/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.725213:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b53100 with x1830881263106048 ext(3145728->4194303) 00002000:00010000:2.0:1746065188.725218:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b53100 00000100:00100000:0.0:1746065188.731507:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.733135:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263106688 00000100:00100000:3.0:1746065188.733146:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263106688 00000100:00100000:3.0:1746065188.733549:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9980 00000100:00100000:3.0:1746065188.733558:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31850:x1830881263106688:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065188.733578:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.733592:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba800/0x14b4f8542d4fd1b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d4e expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.733681:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733692:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733702:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733715:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733720:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733724:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733840:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba600/0x14b4f8542d4fd1c9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733848:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba600/0x14b4f8542d4fd1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733853:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba600/0x14b4f8542d4fd1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065188.733860:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065188.733931:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733937:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733941:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733949:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50bb600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.733952:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733957:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733966:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065188.733969:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.733972:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.733977:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb600/0x14b4f8542d4fd1bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.734004:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.734008:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.734012:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.734015:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a50ba200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.734017:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.734021:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.734027:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205200) 00010000:00010000:3.0:1746065188.734028:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.734031:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.734034:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba200/0x14b4f8542d4fd1c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.734065:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba800/0x14b4f8542d4fd1b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d4e expref: 261 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.734074:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba600/0x14b4f8542d4fd1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d4e expref: 260 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.734080:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.734081:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065188.734083:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50ba600, rc 0) 00000100:00100000:3.0:1746065188.734125:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:31850:x1830881263106688:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 569us (2624us total) trans 8589944225 rc 0/0 00000100:00100000:3.0:1746065188.734131:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9980 00000100:00100000:2.0:1746065188.739223:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263106432:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 23238us (24442us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065188.739236:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8264 00002000:00100000:2.0:1746065188.739246:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880129b53480 x1830881263106432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.739255:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b53480 with x1830881263106432 ext(3145728->4194303) 00002000:00010000:2.0:1746065188.739260:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b53480 00000100:00100000:3.0:1746065188.739337:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881263105920:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 24387us (24674us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065188.739345:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8262 00002000:00100000:3.0:1746065188.739351:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880129b52d80 x1830881263105920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.739357:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b52d80 with x1830881263105920 ext(2097152->3145727) 00002000:00010000:3.0:1746065188.739361:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b52d80 00000100:00100000:0.0:1746065188.741328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.741695:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263106944 00000100:00100000:3.0:1746065188.741703:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263106944 00000100:00100000:3.0:1746065188.741734:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4275 00000100:00100000:3.0:1746065188.741740:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:31850:x1830881263106944:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065188.742603:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31850:x1830881263106944:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 860us (1277us total) trans 8589944226 rc 0/0 00000100:00100000:3.0:1746065188.742610:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4275 00000100:00100000:0.0:1746065188.744283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.750123:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107072 00000100:00100000:2.0:1746065188.750133:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107072 00000100:00100000:2.0:1746065188.750178:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 767 00000100:00100000:2.0:1746065188.750184:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1958:x1830881263107072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.750194:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.750215:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50ba600/0x14b4f8542d4fd1c9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d4e expref: 261 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.750231:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065188.750234:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.750276:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1958:x1830881263107072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 92us (5997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.750281:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 767 00000100:00100000:0.0:1746065188.751916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.755006:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107200 00000100:00100000:3.0:1746065188.755018:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107200 00000100:00100000:3.0:1746065188.755057:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14664 00000100:00100000:3.0:1746065188.755064:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263107200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.755084:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.755099:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50baa00/0x14b4f8542d4fd1d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d55 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.755142:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371200:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065188.755236:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.760548:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371200:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065188.760584:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50baa00/0x14b4f8542d4fd1d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d55 expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.760599:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50baa00/0x14b4f8542d4fd1d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d55 expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.761251:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50baa00, rc 0) 00000100:00100000:3.0:1746065188.763895:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263107200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8820us (11977us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065188.763906:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14664 00000100:00100000:0.0:1746065188.767579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.768099:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107328 00000100:00100000:2.0:1746065188.768109:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107328 00000100:00100000:2.0:1746065188.768154:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14665 00000100:00100000:2.0:1746065188.768163:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:31844:x1830881263107328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.768180:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.768197:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d5c expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.768228:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 32 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.768235:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.768237:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.768240:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.768268:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 32 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.768279:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 32 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065188.768291:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371328:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.768399:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.771479:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371328:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065188.771669:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 28 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.771684:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc42600, rc 0) 00000100:00100000:2.0:1746065188.774499:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+28:31844:x1830881263107328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6325us (6917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.774510:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14665 00000100:00100000:1.0:1746065188.776927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.777007:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107456 00000100:00100000:3.0:1746065188.777015:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107456 00002000:00100000:3.0:1746065188.777053:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4210687) req@ffff88012dc4b050 x1830881263107456/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 16872/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.777062:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc4b050 with x1830881263107456 ext(4194304->4210687) 00010000:00010000:3.0:1746065188.777070:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 33 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.777082:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 33 pid: 2463 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065188.777088:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc4b050 00000100:00100000:3.0:1746065188.777240:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2517 00000100:00100000:3.0:1746065188.777247:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263107456:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065188.778265:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263107456:12345-192.168.202.46@tcp:4:cat.0 Request processed in 1015us (1341us total) trans 21474840895 rc 0/0 00000100:00100000:3.0:1746065188.778272:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2517 00002000:00100000:3.0:1746065188.778278:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4210687) req@ffff88012dc4b050 x1830881263107456/t21474840895(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 16872/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.778285:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc4b050 with x1830881263107456 ext(4194304->4210687) 00010000:00010000:3.0:1746065188.778290:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.778300:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065188.778310:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc4b050 00000100:00100000:0.0:1746065188.786786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.787023:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107584 00000100:00100000:3.0:1746065188.787033:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107584 00010000:00010000:3.0:1746065188.787068:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065188.787393:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7520 00000100:00100000:3.0:1746065188.787401:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263107584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.787415:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.787437:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.787448:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.787470:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9800/0x14b4f8542d4fd105 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4210687) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cd7 expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.790021:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.790025:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.790037:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.790045:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.790088:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.790100:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260371456:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.794805:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.795084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.795192:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107712 00000100:00100000:0.0:1746065188.795198:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107712 00000100:00100000:0.0:1746065188.795230:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14666 00000100:00100000:0.0:1746065188.795237:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31850:x1830881263107712:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065188.795252:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065188.795274:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d63 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.795298:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 36 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.795305:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.795312:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.795317:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065188.795320:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065188.795323:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.795347:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.795357:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 27 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065188.795366:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094090380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371584:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065188.795430:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 27 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.795436:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 27 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065188.795443:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094090700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371712:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065188.795459:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 36 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065188.795465:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 36 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065188.795471:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094090e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371840:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065188.795482:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.797864:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260371456:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.797880:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.797927:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263107584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 10525us (11149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.797936:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7520 00000100:00100000:0.0:1746065188.798307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.798350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.798401:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263108096 00000100:00100000:2.0:1746065188.798406:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263108096 00002000:00100000:2.0:1746065188.798436:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094091f80 x1830881263108096/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.798444:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091f80 with x1830881263108096 ext(4194304->5013503) 00010000:00010000:2.0:1746065188.798451:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 28 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065188.798460:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 28 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:2.0:1746065188.798466:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094091f80 00000100:00100000:2.0:1746065188.798479:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2518 00000100:00100000:2.0:1746065188.798484:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263108096:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065188.799075:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094090380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371584:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065188.799082:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094090700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371712:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065188.799088:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094090e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260371840:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065188.799107:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 35 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.799119:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1c6b800, rc 0) 00000100:00100000:1.0:1746065188.799144:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31850:x1830881263107712:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3907us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065188.799149:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14666 00000100:00100000:3.0:1746065188.799214:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263107840 00000100:00100000:3.0:1746065188.799218:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263107840 00010000:00010000:3.0:1746065188.799232:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 30 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065188.799252:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7521 00000100:00100000:3.0:1746065188.799257:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263107840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.799265:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.799277:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 30 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.799285:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 30 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.799308:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a596cc00/0x14b4f8542d4fd198 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d32 expref: 30 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.799333:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.799349:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881263107840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 92us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.799354:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7521 00000100:00100000:0.0:1746065188.799467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.799559:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263108224 00000100:00100000:3.0:1746065188.799562:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263108224 00010000:00010000:3.0:1746065188.799573:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065188.799590:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7522 00000100:00100000:3.0:1746065188.799595:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263108224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.799602:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.799609:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.799616:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.799627:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5a9200/0x14b4f8542d4fd10c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cde expref: 35 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.799635:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.799652:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263108224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.799659:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7522 00000100:00100000:2.0:1746065188.804467:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263108096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5970us (6104us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065188.804478:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2518 00002000:00100000:2.0:1746065188.804487:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094091f80 x1830881263108096/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.804496:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091f80 with x1830881263108096 ext(4194304->5013503) 00010000:00010000:2.0:1746065188.804503:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 27 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065188.804516:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 27 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:2.0:1746065188.804526:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094091f80 00000100:00100000:0.0:1746065188.807401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.807695:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263108352 00000100:00100000:1.0:1746065188.807702:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263108352 00000100:00100000:1.0:1746065188.807761:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14667 00000100:00100000:1.0:1746065188.807768:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263108352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.807784:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.807799:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009373f200/0x14b4f8542d4fd1ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d6a expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.807851:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.807860:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009373f200/0x14b4f8542d4fd1ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d6a expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.807869:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009373f200/0x14b4f8542d4fd1ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d6a expref: 28 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.807889:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009373f200, rc 0) 00000100:00100000:1.0:1746065188.807924:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263108352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 156us (530us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.807929:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14667 00000100:00100000:0.0:1746065188.810114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.810483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.810567:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263108608 00000100:00100000:2.0:1746065188.810573:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263108608 00000100:00100000:2.0:1746065188.810616:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14668 00000100:00100000:2.0:1746065188.810622:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+27:31844:x1830881263108608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.810634:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.810647:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d71 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.810663:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.810665:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.810672:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.810684:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.810694:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908d0400, rc 0) 00000100:00100000:2.0:1746065188.810735:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+28:31844:x1830881263108608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.810741:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14668 00000100:00100000:3.0:1746065188.810745:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263108480 00000100:00100000:3.0:1746065188.810748:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263108480 00010000:00010000:3.0:1746065188.810775:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 28 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065188.810800:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7523 00000100:00100000:2.0:1746065188.810805:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263108480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.810838:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.810856:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 28 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065188.810866:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 28 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065188.810879:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc42600/0x14b4f8542d4fd1de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d5c expref: 28 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065188.810894:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.810895:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.810899:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.810905:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.810928:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065188.810938:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260371968:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065188.810983:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.813799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.813992:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260371968:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065188.814007:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065188.814338:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263108736 00000100:00100000:1.0:1746065188.814344:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263108736 00000100:00100000:1.0:1746065188.814374:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14669 00000100:00100000:1.0:1746065188.814380:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263108736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.814391:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.814403:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009373f000/0x14b4f8542d4fd1fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d78 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.814423:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009373f000/0x14b4f8542d4fd1fa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d78 expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.814432:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009373f000/0x14b4f8542d4fd1fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d78 expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.814440:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009373f000, rc 0) 00000100:00100000:2.0:1746065188.814785:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263108480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3978us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.814793:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7523 00000100:00100000:0.0:1746065188.814936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.815254:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263108736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 873us (1459us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.815259:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14669 00000100:00100000:2.0:1746065188.815394:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263108992 00000100:00100000:2.0:1746065188.815398:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263108992 00002000:00100000:2.0:1746065188.815419:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3244032->3248127) req@ffff880094093100 x1830881263108992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.815428:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093100 with x1830881263108992 ext(3244032->3248127) 00002000:00010000:2.0:1746065188.815432:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094093100 00000100:00100000:2.0:1746065188.815458:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8265 00000100:00100000:2.0:1746065188.815467:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263108992:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065188.815589:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263108992:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 124us (653us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065188.815594:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8265 00002000:00100000:2.0:1746065188.815599:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3244032->3248127) req@ffff880094093100 x1830881263108992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.815606:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093100 with x1830881263108992 ext(3244032->3248127) 00002000:00010000:2.0:1746065188.815608:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094093100 00000100:00100000:3.0:1746065188.821857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.821921:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263109248 00000100:00100000:0.0:1746065188.821930:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263109248 00002000:00100000:0.0:1746065188.821965:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88012e8b6a00 x1830881263109248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.821976:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6a00 with x1830881263109248 ext(5009408->5013503) 00002000:00010000:0.0:1746065188.821981:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b6a00 00000100:00100000:0.0:1746065188.822010:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8266 00000100:00100000:0.0:1746065188.822017:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263109248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065188.822167:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263109248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 150us (317us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065188.822173:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8266 00002000:00100000:0.0:1746065188.822178:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88012e8b6a00 x1830881263109248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.822184:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6a00 with x1830881263109248 ext(5009408->5013503) 00002000:00010000:0.0:1746065188.822187:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b6a00 00000100:00100000:0.0:1746065188.823929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.823999:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263109504 00000100:00100000:2.0:1746065188.824005:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263109504 00002000:00100000:2.0:1746065188.824029:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3792896->3796991) req@ffff880094090a80 x1830881263109504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.824037:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090a80 with x1830881263109504 ext(3792896->3796991) 00002000:00010000:2.0:1746065188.824041:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094090a80 00000100:00100000:2.0:1746065188.824053:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8267 00000100:00100000:2.0:1746065188.824057:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263109504:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065188.824788:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263109504:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 728us (861us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065188.824798:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8267 00002000:00100000:2.0:1746065188.824803:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3792896->3796991) req@ffff880094090a80 x1830881263109504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/4536 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065188.824810:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090a80 with x1830881263109504 ext(3792896->3796991) 00002000:00010000:2.0:1746065188.824813:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094090a80 00000100:00100000:0.0:1746065188.830379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.830909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.832068:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263109760 00000100:00100000:1.0:1746065188.832076:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263109760 00000100:00100000:1.0:1746065188.832128:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9981 00000100:00100000:1.0:1746065188.832136:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:31852:x1830881263109760:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065188.832155:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.832169:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ee00/0x14b4f8542d4fd201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d7f expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.832253:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.832264:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.832272:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.832282:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.832286:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.832291:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065188.832636:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110016 00000100:00100000:3.0:1746065188.832640:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110016 00000100:00100000:3.0:1746065188.832668:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4276 00000100:00100000:3.0:1746065188.832674:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:31844:x1830881263110016:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065188.832844:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:31844:x1830881263110016:12345-192.168.202.46@tcp:35:cat.0 Request processed in 169us (1935us total) trans 8589944227 rc 0/0 00000100:00100000:3.0:1746065188.832850:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4276 00010000:00010000:1.0:1746065188.833609:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e800/0x14b4f8542d4fd216 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.833620:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e800/0x14b4f8542d4fd216 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.833627:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e800/0x14b4f8542d4fd216 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065188.833635:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065188.833684:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.833689:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.833694:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.833699:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009373ec00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065188.833702:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.833707:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.833716:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065188.833718:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065188.833722:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.833729:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ec00/0x14b4f8542d4fd208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.835501:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.835519:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.835524:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.835529:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009373ea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065188.835532:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.835538:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.835550:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5a36c00) 00010000:00010000:1.0:1746065188.835553:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065188.835556:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.835560:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ea00/0x14b4f8542d4fd20f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.835612:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009373ee00/0x14b4f8542d4fd201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d7f expref: 23 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.835623:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e800/0x14b4f8542d4fd216 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d7f expref: 22 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.835634:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065188.835636:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065188.835638:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009373e800, rc 0) 00000100:00100000:1.0:1746065188.835697:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:31852:x1830881263109760:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3561us (5326us total) trans 8589944228 rc 0/0 00000100:00100000:1.0:1746065188.835704:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9981 00000100:00100000:0.0:1746065188.839577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.839731:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110144 00000100:00100000:2.0:1746065188.839740:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110144 00000100:00100000:2.0:1746065188.839806:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 768 00000100:00100000:2.0:1746065188.839840:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263110144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065188.839852:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065188.839872:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e800/0x14b4f8542d4fd216 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d7f expref: 22 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.839892:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065188.839896:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065188.839927:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263110144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 115us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.839932:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 768 00000100:00100000:0.0:1746065188.889169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.890498:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110400 00000100:00100000:1.0:1746065188.890507:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110400 00000100:00100000:1.0:1746065188.890566:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9982 00000100:00100000:1.0:1746065188.890574:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:31857:x1830881263110400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.890594:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.890610:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e600/0x14b4f8542d4fd224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d86 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.890701:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890712:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890722:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890733:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890738:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890747:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890889:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373f600/0x14b4f8542d4fd239 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890897:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009373f600/0x14b4f8542d4fd239 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890902:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009373f600/0x14b4f8542d4fd239 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065188.890910:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065188.890978:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890984:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890990:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.890995:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009373e400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065188.890998:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891003:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891013:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065188.891015:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065188.891018:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891026:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e400/0x14b4f8542d4fd22b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891045:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891050:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891054:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891058:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009373e200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065188.891060:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891064:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891069:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5a36c00) 00010000:00010000:1.0:1746065188.891071:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065188.891073:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891077:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e200/0x14b4f8542d4fd232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065188.891107:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009373e600/0x14b4f8542d4fd224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d86 expref: 263 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.891116:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009373f600/0x14b4f8542d4fd239 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d86 expref: 262 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.891125:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065188.891127:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065188.891129:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009373f600, rc 0) 00000100:00100000:1.0:1746065188.891171:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:31857:x1830881263110400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 597us (2011us total) trans 8589944229 rc 0/0 00000100:00100000:1.0:1746065188.891176:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9982 00000100:00100000:0.0:1746065188.895993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.896026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.896053:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110528 00000100:00100000:1.0:1746065188.896061:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110528 00000100:00100000:1.0:1746065188.896108:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14670 00000100:00100000:1.0:1746065188.896116:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263110528:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.896130:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.896144:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009373f400/0x14b4f8542d4fd247 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d8d expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065188.896187:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260372096:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065188.896453:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065188.898621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.898688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.898722:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.898743:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110784 00000100:00100000:1.0:1746065188.898748:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110784 00000100:00100000:1.0:1746065188.898784:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110912 00000100:00100000:1.0:1746065188.898786:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110912 00000100:00100000:1.0:1746065188.899006:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111040 00000100:00100000:1.0:1746065188.899010:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111040 00000100:00100000:0.0:1746065188.899045:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14671 00000100:00100000:0.0:1746065188.899053:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263110784:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065188.899169:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14672 00000100:00100000:2.0:1746065188.899181:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14673 00000100:00100000:2.0:1746065188.899186:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263111040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.899194:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.899209:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60da2 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.899232:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.899234:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065188.899241:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.899255:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065188.899264:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908d0c00, rc 0) 00010000:00010000:0.0:1746065188.899484:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065188.899494:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6a800/0x14b4f8542d4fd255 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d94 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065188.899528:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260372224:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065188.899567:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.899665:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263110656 00000100:00100000:3.0:1746065188.899672:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263110656 00000100:00100000:3.0:1746065188.899715:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 769 00000100:00100000:3.0:1746065188.899720:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1958:x1830881263110656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.899735:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.899762:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009373f600/0x14b4f8542d4fd239 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d86 expref: 262 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.899782:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.899788:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.899810:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1958:x1830881263110656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (3780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.899838:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 769 00000100:00100000:3.0:1746065188.899897:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263110912:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.899903:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.899912:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fd25c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60d9b expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.899929:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fd25c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d9b expref: 37 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.899943:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50bac00/0x14b4f8542d4fd25c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d9b expref: 37 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065188.899950:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50bac00, rc 0) 00000100:00100000:3.0:1746065188.899972:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263110912:12345-192.168.202.46@tcp:101:cat.0 Request processed in 798us (1285us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065188.899982:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14672 00000100:00100000:2.0:1746065188.900017:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263111040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 112us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.900023:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14673 00000100:00100000:1.0:1746065188.902383:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260372096:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065188.902412:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009373f400/0x14b4f8542d4fd247 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d8d expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.902423:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009373f400/0x14b4f8542d4fd247 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d8d expref: 31 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.902446:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009373f400, rc 0) 00000100:00100000:1.0:1746065188.902488:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263110528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6373us (6502us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.902494:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14670 00002000:00010000:0.0:1746065188.903903:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065187 -> 1746065189 00000100:00100000:0.0:1746065188.903918:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260372224:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065188.903937:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6a800/0x14b4f8542d4fd255 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d94 expref: 35 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065188.903946:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6a800/0x14b4f8542d4fd255 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d94 expref: 35 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065188.903957:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1c6a800, rc 0) 00000100:00100000:0.0:1746065188.903986:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263110784:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4934us (5368us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065188.903991:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14671 00000100:00100000:0.0:1746065188.913197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065188.913782:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111168 00000100:00100000:2.0:1746065188.913790:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111168 00000100:00100000:2.0:1746065188.913871:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14674 00000100:00100000:2.0:1746065188.913878:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31857:x1830881263111168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.913894:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.913908:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60da9 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.913932:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.913938:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.913940:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.913943:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.913967:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.913978:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 29 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065188.913988:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260372352:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.914064:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065188.917915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.917974:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111296 00000100:00100000:3.0:1746065188.917982:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111296 00000100:00100000:2.0:1746065188.918006:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260372352:192.168.202.46@tcp:104: 00002000:00100000:3.0:1746065188.918017:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1687552->2097151) req@ffff880094a94e00 x1830881263111296/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.918025:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94e00 with x1830881263111296 ext(1687552->2097151) 00010000:00010000:2.0:1746065188.918027:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.918030:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 30 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065188.918039:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908d1200, rc 0) 00010000:00010000:3.0:1746065188.918040:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 30 pid: 2463 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065188.918045:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a94e00 00000100:00100000:3.0:1746065188.918058:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2519 00000100:00100000:3.0:1746065188.918064:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1958:x1830881263111296:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065188.918079:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31857:x1830881263111168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4202us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065188.918085:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14674 00000100:00100000:3.0:1746065188.931671:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:1958:x1830881263111296:12345-192.168.202.46@tcp:4:cat.0 Request processed in 13598us (13755us total) trans 17179873620 rc 0/0 00000100:00100000:3.0:1746065188.931684:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2519 00002000:00100000:3.0:1746065188.931695:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1687552->2097151) req@ffff880094a94e00 x1830881263111296/t17179873620(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.931704:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94e00 with x1830881263111296 ext(1687552->2097151) 00010000:00010000:3.0:1746065188.931712:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 32 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.931727:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 32 pid: 2463 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065188.931733:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a94e00 00000100:00100000:0.0:1746065188.939733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.939813:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111424 00000100:00100000:3.0:1746065188.939834:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111424 00010000:00010000:3.0:1746065188.939864:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 32 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065188.939889:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7524 00000100:00100000:3.0:1746065188.939895:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263111424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.939909:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.939928:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 32 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.939938:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 32 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.939955:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc43e00/0x14b4f8542d4fd19f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d39 expref: 32 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065188.939970:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.939972:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065188.939978:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.939985:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.940008:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065188.940018:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260372480:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065188.940089:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065188.947938:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260372480:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065188.947954:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.947989:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263111424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8094us (8263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.947998:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7524 00000100:00100000:0.0:1746065188.949518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.949592:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111680 00000100:00100000:3.0:1746065188.949602:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111680 00002000:00100000:3.0:1746065188.949636:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094a96300 x1830881263111680/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065188.949644:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96300 with x1830881263111680 ext(1048576->2097151) 00002000:00010000:3.0:1746065188.949648:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a96300 00000100:00100000:3.0:1746065188.949663:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8268 00000100:00100000:3.0:1746065188.949669:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263111680:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065188.963668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.963810:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263111936 00000100:00100000:3.0:1746065188.963844:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263111936 00000100:00100000:3.0:1746065188.964862:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9983 00000100:00100000:3.0:1746065188.964869:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:31862:x1830881263111936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065188.964887:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.964901:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d600/0x14b4f8542d4fd26a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60db0 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.964976:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.964986:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.964993:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965003:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965008:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065188.965009:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263111680:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15340us (15495us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746065188.965013:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065188.965018:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8268 00002000:00100000:1.0:1746065188.965025:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094a96300 x1830881263111680/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.965033:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96300 with x1830881263111680 ext(1048576->2097151) 00002000:00010000:1.0:1746065188.965037:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a96300 00010000:00010000:3.0:1746065188.965095:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd27f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965103:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd27f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965108:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd27f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065188.965115:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065188.965178:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965184:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965189:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965193:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f74da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.965196:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965201:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965209:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065188.965212:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.965215:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965219:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd271 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965230:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965233:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965237:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965241:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f74dc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.965243:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965247:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965252:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205200) 00010000:00010000:3.0:1746065188.965254:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.965256:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965259:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd278 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.965287:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d600/0x14b4f8542d4fd26a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60db0 expref: 24 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.965300:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd27f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60db0 expref: 23 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.965305:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.965307:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065188.965309:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f74de00, rc 0) 00000100:00100000:3.0:1746065188.965328:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:31862:x1830881263111936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 460us (1671us total) trans 8589944230 rc 0/0 00000100:00100000:3.0:1746065188.965334:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9983 00000100:00100000:0.0:1746065188.971243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.971300:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263112192 00000100:00100000:3.0:1746065188.971308:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263112192 00000100:00100000:3.0:1746065188.971354:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9984 00000100:00100000:3.0:1746065188.971361:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31860:x1830881263112192:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065188.971379:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065188.971394:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd28d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60db7 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.971480:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971490:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971499:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971509:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971518:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971523:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971601:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2a2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971608:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971613:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065188.971620:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065188.971679:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971685:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971690:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971695:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f74da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.971698:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971703:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971711:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065188.971713:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.971717:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971721:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971744:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065188.971744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065188.971749:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971762:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971766:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f74d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065188.971768:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971772:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971778:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:3.0:1746065188.971779:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065188.971781:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971785:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d200/0x14b4f8542d4fd29b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065188.971812:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74dc00/0x14b4f8542d4fd28d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60db7 expref: 264 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.971841:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60db7 expref: 263 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.971846:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.971848:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065188.971850:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f74d800, rc 0) 00000100:00100000:0.0:1746065188.971869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.971881:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:31860:x1830881263112192:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 521us (649us total) trans 8589944231 rc 0/0 00000100:00100000:3.0:1746065188.971886:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9984 00000100:00100000:1.0:1746065188.971983:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263112320 00000100:00100000:1.0:1746065188.971990:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263112320 00000100:00100000:1.0:1746065188.972023:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263112448 00000100:00100000:1.0:1746065188.972027:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263112448 00000100:00100000:1.0:1746065188.972697:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14675 00000100:00100000:1.0:1746065188.972703:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881263112320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.972712:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.972721:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60dbe expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.972737:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.972739:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065188.972744:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.972763:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.972770:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c812200, rc 0) 00000100:00100000:1.0:1746065188.972792:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881263112320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 89us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065188.972797:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14675 00000100:00100000:1.0:1746065188.972809:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14676 00000100:00100000:1.0:1746065188.972830:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263112448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065188.972836:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065188.972844:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c813c00/0x14b4f8542d4fd2b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60dc5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065188.972857:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c813c00/0x14b4f8542d4fd2b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dc5 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.972864:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c813c00/0x14b4f8542d4fd2b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dc5 expref: 28 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065188.972872:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c813c00, rc 0) 00000100:00100000:1.0:1746065188.972885:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263112448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 72us (1018us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065188.972890:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14676 00000100:00100000:0.0:1746065188.972966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.972998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.973078:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263112576 00000100:00100000:3.0:1746065188.973083:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263112576 00000100:00100000:3.0:1746065188.973106:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 770 00000100:00100000:3.0:1746065188.973111:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263112576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.973118:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.973129:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd27f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60db0 expref: 23 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.973138:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.973141:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.973155:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263112576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 44us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.973160:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 770 00000100:00100000:2.0:1746065188.973925:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263112704 00000100:00100000:2.0:1746065188.973933:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263112704 00000100:00100000:2.0:1746065188.973976:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14677 00000100:00100000:2.0:1746065188.973983:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31857:x1830881263112704:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065188.973995:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065188.974005:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60dcc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.974028:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.974035:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.974036:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065188.974039:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.974064:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 26 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065188.974076:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 26 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065188.974087:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260372608:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065188.974154:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065188.979985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.980093:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260372608:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065188.980116:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.980136:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908d1600, rc 0) 00000100:00100000:2.0:1746065188.980150:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065188.980171:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31857:x1830881263112704:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6188us (7171us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.980177:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14677 00000100:00100000:3.0:1746065188.980202:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263113088 00000100:00100000:3.0:1746065188.980207:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263113088 00000100:00100000:3.0:1746065188.980233:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 771 00000100:00100000:3.0:1746065188.980239:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1959:x1830881263113088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065188.980248:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065188.980265:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2a2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60db7 expref: 263 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065188.980276:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065188.980279:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065188.980295:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:1959:x1830881263113088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065188.980300:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 771 00000100:00100000:0.0:1746065188.981257:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263112960 00000100:00100000:0.0:1746065188.981264:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263112960 00000100:00100000:0.0:1746065188.981296:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4277 00000100:00100000:0.0:1746065188.981303:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:31860:x1830881263112960:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065188.981508:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:31860:x1830881263112960:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 204us (1531us total) trans 8589944232 rc 0/0 00000100:00100000:0.0:1746065188.981515:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4277 00000100:00100000:3.0:1746065188.981646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065188.982084:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263113216 00000100:00100000:0.0:1746065188.982089:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263113216 00002000:00100000:0.0:1746065188.982119:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1314815) req@ffff88012e8b5180 x1830881263113216/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065188.982129:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5180 with x1830881263113216 ext(1048576->1314815) 00010000:00010000:0.0:1746065188.982137:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 27 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065188.982148:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 27 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:0.0:1746065188.982154:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b5180 00000100:00100000:0.0:1746065188.982178:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2520 00000100:00100000:0.0:1746065188.982186:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881263113216:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065188.989960:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+29:1959:x1830881263113216:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7764us (8305us total) trans 21474840896 rc 0/0 00000100:00100000:1.0:1746065188.989972:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2520 00002000:00100000:1.0:1746065188.989984:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1314815) req@ffff88012e8b5180 x1830881263113216/t21474840896(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/448 e 0 to 0 dl 1746065199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.989992:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5180 with x1830881263113216 ext(1048576->1314815) 00010000:00010000:1.0:1746065188.990001:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 29 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065188.990015:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 29 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:1.0:1746065188.990021:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b5180 00000100:00100000:0.0:1746065188.990152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065188.990688:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263113472 00000100:00100000:1.0:1746065188.990694:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263113472 00002000:00100000:1.0:1746065188.990726:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094a95500 x1830881263113472/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/0 e 0 to 0 dl 1746065199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065188.990734:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95500 with x1830881263113472 ext(1048576->2097151) 00002000:00010000:1.0:1746065188.990737:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a95500 00000100:00100000:1.0:1746065188.991300:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8269 00000100:00100000:1.0:1746065188.991310:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881263113472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.001014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.001436:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263113600 00000100:00100000:0.0:1746065189.001443:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263113600 00010000:00010000:0.0:1746065189.001478:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 29 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065189.001501:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7525 00000100:00100000:0.0:1746065189.001508:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+29:1958:x1830881263113600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065189.001519:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065189.001541:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 29 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.001552:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 29 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.001571:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c813200/0x14b4f8542d4fd1ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d47 expref: 29 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.001588:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065189.001590:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065189.001596:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.001604:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.001638:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065189.001650:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260372736:192.168.202.46@tcp:105: 00000100:00080000:1.0:1746065189.001743:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065189.002033:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881263113472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10723us (11881us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065189.002042:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8269 00002000:00100000:1.0:1746065189.002051:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094a95500 x1830881263113472/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:104/0 lens 488/440 e 0 to 0 dl 1746065199 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.002060:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95500 with x1830881263113472 ext(1048576->2097151) 00002000:00010000:1.0:1746065189.002064:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a95500 00000100:00100000:0.0:1746065189.002310:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d23c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065189.007996:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065189.012914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.012951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.012985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.013007:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263114112 00000100:00100000:1.0:1746065189.013013:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263114112 00002000:00100000:1.0:1746065189.013050:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880129b0c380 x1830881263114112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.013059:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c380 with x1830881263114112 ext(1048576->2097151) 00002000:00010000:1.0:1746065189.013064:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0c380 00000100:00100000:1.0:1746065189.013081:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8270 00000100:00100000:1.0:1746065189.013088:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263114112:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.014948:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263113728 00000100:00100000:3.0:1746065189.014956:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263113728 00000100:00100000:3.0:1746065189.014982:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263113856 00000100:00100000:3.0:1746065189.014984:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263113856 00000100:00100000:3.0:1746065189.015010:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14678 00000100:00100000:3.0:1746065189.015016:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:31862:x1830881263113728:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.015027:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.015041:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60dd3 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.015058:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.015060:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.015066:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.015077:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.015085:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f74de00, rc 0) 00000100:00100000:3.0:1746065189.015111:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+30:31862:x1830881263113728:12345-192.168.202.46@tcp:101:cat.0 Request processed in 96us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.015117:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14678 00000100:00100000:3.0:1746065189.015127:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14679 00000100:00100000:3.0:1746065189.015131:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+32:31852:x1830881263113856:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065189.015136:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.015142:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60dda expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.015153:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 33 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.015160:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 30 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.015164:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.015166:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.015168:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.015189:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 30 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.015198:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 30 pid: 21998 timeout: 888 lvb_type: 1 00000100:00100000:3.0:1746065189.015207:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260372864:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.015244:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 33 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.015251:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 33 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.015257:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260372992:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.015270:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.015350:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260372736:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.015366:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.015387:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+29:1958:x1830881263113600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 13880us (14383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.015394:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7525 00000100:00080000:1.0:1746065189.016925:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065189.021189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.021335:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263114240 00000100:00100000:2.0:1746065189.021342:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263114240 00000100:00100000:2.0:1746065189.021373:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14680 00000100:00100000:2.0:1746065189.021378:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:31860:x1830881263114240:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.021392:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.021404:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60de1 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.021426:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.021427:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.021432:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 38 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.021443:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 38 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.021451:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908d1400, rc 0) 00000100:00100000:2.0:1746065189.021493:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:31860:x1830881263114240:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.021498:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14680 00000100:00100000:3.0:1746065189.023563:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260372864:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065189.025348:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263114112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12252us (12354us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065189.025358:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8270 00002000:00100000:1.0:1746065189.025368:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880129b0c380 x1830881263114112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.025376:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c380 with x1830881263114112 ext(1048576->2097151) 00002000:00010000:1.0:1746065189.025382:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0c380 00000100:00100000:0.0:1746065189.025717:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.025766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.025911:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260372992:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.025935:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3272704->4194303] (req 3272704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.025948:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f74d800, rc 0) 00000100:00100000:3.0:1746065189.025969:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+33:31852:x1830881263113856:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10837us (13017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.025975:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14679 00000100:00100000:0.0:1746065189.026531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.026551:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263114624 00000100:00100000:0.0:1746065189.026557:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263114624 00002000:00100000:0.0:1746065189.026588:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880094a97b80 x1830881263114624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.026596:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a97b80 with x1830881263114624 ext(1048576->2097151) 00002000:00010000:0.0:1746065189.026599:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a97b80 00000100:00100000:0.0:1746065189.026627:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263114880 00000100:00100000:0.0:1746065189.026629:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263114880 00002000:00100000:0.0:1746065189.026639:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2514944->2519039) req@ffff880094a94700 x1830881263114880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.026645:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94700 with x1830881263114880 ext(2514944->2519039) 00002000:00010000:0.0:1746065189.026647:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a94700 00000100:00100000:0.0:1746065189.026658:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8271 00000100:00100000:0.0:1746065189.026665:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263114624:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065189.026847:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8272 00000100:00100000:2.0:1746065189.026847:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263114368 00000100:00100000:2.0:1746065189.026851:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263114368 00000100:00100000:3.0:1746065189.026852:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263114880:12345-192.168.202.46@tcp:3:multiop.0 00010000:00010000:2.0:1746065189.026870:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 31 pid: 21998 timeout: 888 lvb_type: 1 00000100:00100000:2.0:1746065189.026887:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7526 00000100:00100000:2.0:1746065189.026890:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263114368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.026898:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.026914:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 31 pid: 21998 timeout: 888 lvb_type: 1 00010000:00010000:2.0:1746065189.026923:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 31 pid: 21998 timeout: 888 lvb_type: 1 00010000:00010000:2.0:1746065189.026942:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800908d0c00/0x14b4f8542d4fd24e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da2 expref: 31 pid: 21998 timeout: 888 lvb_type: 1 00000100:00100000:3.0:1746065189.026948:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263114880:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 96us (418us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065189.026953:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8272 00002000:00100000:3.0:1746065189.026958:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2514944->2519039) req@ffff880094a94700 x1830881263114880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746065189.026962:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065189.026964:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94700 with x1830881263114880 ext(2514944->2519039) 00002000:00010000:3.0:1746065189.026966:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a94700 00000100:00100000:2.0:1746065189.026978:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263114368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.026983:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7526 00000100:00100000:0.0:1746065189.032452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.033004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.033093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.033165:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263115264 00000100:00100000:3.0:1746065189.033172:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263115264 00000100:00100000:2.0:1746065189.033478:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263115008 00000100:00100000:2.0:1746065189.033482:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263115008 00010000:00010000:2.0:1746065189.033502:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 33 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.033527:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7527 00000100:00100000:2.0:1746065189.033534:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263115008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.033545:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.033566:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 33 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.033579:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 33 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.033606:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc42800/0x14b4f8542d4fd1a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d40 expref: 33 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.033627:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.033628:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.033633:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.033640:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.033667:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.033678:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260373120:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.033738:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.034005:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263115136 00000100:00100000:3.0:1746065189.034009:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263115136 00000100:00100000:1.0:1746065189.034063:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14681 00000100:00100000:1.0:1746065189.034073:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263115264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.034084:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.034092:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f25a600/0x14b4f8542d4fd2da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60def expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065189.034118:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260373248:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065189.034144:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.034236:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14682 00000100:00100000:2.0:1746065189.034243:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263115136:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.034250:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.034258:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800908d0200/0x14b4f8542d4fd2e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60de8 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.034272:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800908d0200/0x14b4f8542d4fd2e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de8 expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.034284:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0200/0x14b4f8542d4fd2e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de8 expref: 37 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.034291:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908d0200, rc 0) 00000100:00100000:2.0:1746065189.034309:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263115136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 67us (1217us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.034353:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14682 00000100:00100000:1.0:1746065189.037330:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263114624:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10658us (11556us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065189.037339:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8271 00002000:00100000:1.0:1746065189.037349:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880094a97b80 x1830881263114624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.037358:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a97b80 with x1830881263114624 ext(1048576->2097151) 00002000:00010000:1.0:1746065189.037363:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a97b80 00000100:00100000:2.0:1746065189.038927:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260373120:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.038944:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.038974:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881263115008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5439us (6529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.038983:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7527 00000100:00100000:0.0:1746065189.039291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.039419:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260373248:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065189.039440:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f25a600/0x14b4f8542d4fd2da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60def expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.039451:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f25a600/0x14b4f8542d4fd2da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60def expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.039463:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25a600, rc 0) 00000100:00100000:1.0:1746065189.039484:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263115264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5412us (6480us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065189.039490:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14681 00000100:00100000:2.0:1746065189.040041:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263115520 00000100:00100000:2.0:1746065189.040047:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263115520 00002000:00100000:2.0:1746065189.040073:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3272704->3276799) req@ffff880094093800 x1830881263115520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.040080:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093800 with x1830881263115520 ext(3272704->3276799) 00002000:00010000:2.0:1746065189.040084:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094093800 00000100:00100000:2.0:1746065189.040099:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8273 00000100:00100000:2.0:1746065189.040105:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881263115520:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065189.040219:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881263115520:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 115us (929us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065189.040224:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8273 00002000:00100000:2.0:1746065189.040229:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3272704->3276799) req@ffff880094093800 x1830881263115520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.040235:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093800 with x1830881263115520 ext(3272704->3276799) 00002000:00010000:2.0:1746065189.040237:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094093800 00000100:00100000:2.0:1746065189.040276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.040420:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263115776 00000100:00100000:1.0:1746065189.040424:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263115776 00002000:00100000:1.0:1746065189.040441:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2916352->2920447) req@ffff8800900c3100 x1830881263115776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.040448:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c3100 with x1830881263115776 ext(2916352->2920447) 00002000:00010000:1.0:1746065189.040451:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c3100 00000100:00100000:1.0:1746065189.040959:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8274 00000100:00100000:1.0:1746065189.040967:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263115776:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065189.041383:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263115776:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 415us (1104us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065189.041389:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8274 00002000:00100000:1.0:1746065189.041394:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2916352->2920447) req@ffff8800900c3100 x1830881263115776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.041401:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c3100 with x1830881263115776 ext(2916352->2920447) 00002000:00010000:1.0:1746065189.041404:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c3100 00000100:00100000:0.0:1746065189.049979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.050024:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.050147:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263115904 00000100:00100000:1.0:1746065189.050154:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263115904 00000100:00100000:1.0:1746065189.051205:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116032 00000100:00100000:1.0:1746065189.051210:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116032 00000100:00100000:2.0:1746065189.051264:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14683 00000100:00100000:2.0:1746065189.051275:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+29:31862:x1830881263115904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.051290:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.051304:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60df6 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.051328:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.051333:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065189.051335:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065189.051337:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.051360:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.051370:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 36 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.051380:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260373376:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.051443:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.052516:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14684 00000100:00100000:3.0:1746065189.052525:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:31857:x1830881263116032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.052533:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.052541:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60dfd expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.052556:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065189.052559:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 37 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.052568:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 37 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.052576:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f74da00, rc 0) 00000100:00100000:3.0:1746065189.052598:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:31857:x1830881263116032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 76us (2573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.052603:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14684 00000100:00100000:2.0:1746065189.053664:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260373376:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.053682:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.053691:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908d0800, rc 0) 00000100:00100000:2.0:1746065189.053725:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+30:31862:x1830881263115904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2454us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.053730:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14683 00000100:00100000:2.0:1746065189.057045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.057170:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116160 00000100:00100000:3.0:1746065189.057177:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116160 00002000:00100000:3.0:1746065189.057213:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2514944->3796991) req@ffff8800900c2300 x1830881263116160/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 504/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.057222:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c2300 with x1830881263116160 ext(2514944->3796991) 00010000:00010000:3.0:1746065189.057235:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 37 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.057247:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 37 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065189.057252:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900c2300 00000100:00100000:3.0:1746065189.057285:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2521 00000100:00100000:3.0:1746065189.057292:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881263116160:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065189.057859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.057927:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116288 00000100:00100000:2.0:1746065189.057931:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116288 00000100:00100000:2.0:1746065189.057953:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14685 00000100:00100000:2.0:1746065189.057958:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+30:31852:x1830881263116288:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.057967:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.057978:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e04 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.057997:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 31 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.058004:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065189.058006:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065189.058008:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->4284415] (req 4194304->4284415) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.058030:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 31 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.058039:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.058049:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260373504:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.058114:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.062664:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260373504:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.062692:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->4284415] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.062706:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800908d0e00, rc 0) 00000100:00100000:3.0:1746065189.062743:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+31:31852:x1830881263116288:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4783us (4884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.062761:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14685 00000100:00100000:0.0:1746065189.063128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.063183:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116416 00000100:00100000:2.0:1746065189.063188:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116416 00010000:00010000:2.0:1746065189.063206:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.063367:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7528 00000100:00100000:2.0:1746065189.063373:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881263116416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.063383:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.063398:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.063407:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.063428:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0400/0x14b4f8542d4fd1f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3796992->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d71 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.063576:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.063876:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263116416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 502us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.063885:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7528 00000100:00100000:3.0:1746065189.073691:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881263116160:12345-192.168.202.46@tcp:4:cat.0 Request processed in 16382us (16634us total) trans 21474840897 rc 0/0 00000100:00100000:3.0:1746065189.073701:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2521 00002000:00100000:3.0:1746065189.073710:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2514944->3796991) req@ffff8800900c2300 x1830881263116160/t21474840897(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 504/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.073719:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c2300 with x1830881263116160 ext(2514944->3796991) 00010000:00010000:3.0:1746065189.073733:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 39 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.073746:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 39 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065189.073764:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900c2300 00000100:00100000:0.0:1746065189.079791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.079956:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116544 00000100:00100000:2.0:1746065189.079963:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116544 00010000:00010000:2.0:1746065189.079994:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 39 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.080403:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7529 00000100:00100000:2.0:1746065189.080411:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881263116544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.080425:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065189.080441:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065189 -> 1746065190 00002000:00010000:2.0:1746065189.080444:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065189 -> 1746065190 00010000:00010000:2.0:1746065189.080449:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 39 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.080461:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 39 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.080479:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800908d1400/0x14b4f8542d4fd2d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2514944->3244031] (req 2514944->2920447) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60de1 expref: 39 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.080986:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.080988:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.080995:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.081002:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.081009:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.081010:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.081013:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 38 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.081019:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 38 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.081023:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.081024:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.081027:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.081033:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.081057:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.081067:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260373632:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065189.098451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065189.098872:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 38 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.098887:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260373760:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.098967:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 29 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.098976:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260373888:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.098993:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.099880:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260373632:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065189.099965:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263116800 00000100:00100000:3.0:1746065189.099971:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263116800 00002000:00100000:3.0:1746065189.100000:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4280320->4284415) req@ffff880129b0ed80 x1830881263116800/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.100008:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ed80 with x1830881263116800 ext(4280320->4284415) 00002000:00010000:3.0:1746065189.100012:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0ed80 00000100:00100000:3.0:1746065189.100940:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8275 00000100:00100000:3.0:1746065189.100948:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263116800:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.101582:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263116800:12345-192.168.202.46@tcp:3:cat.0 Request processed in 632us (3135us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065189.101593:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8275 00002000:00100000:3.0:1746065189.101600:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4280320->4284415) req@ffff880129b0ed80 x1830881263116800/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.101607:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ed80 with x1830881263116800 ext(4280320->4284415) 00002000:00010000:3.0:1746065189.101611:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0ed80 00000100:00100000:2.0:1746065189.102061:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260373760:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.102068:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260373888:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.102084:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.102298:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263116544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 21888us (22513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.102305:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7529 00000100:00100000:0.0:1746065189.105154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.105228:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263117056 00000100:00100000:3.0:1746065189.105234:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263117056 00002000:00100000:3.0:1746065189.105266:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094093b80 x1830881263117056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.105274:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093b80 with x1830881263117056 ext(2097152->3145727) 00002000:00010000:3.0:1746065189.105278:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094093b80 00000100:00100000:3.0:1746065189.105301:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8276 00000100:00100000:3.0:1746065189.105307:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263117056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.109481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.112847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.112999:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263117568 00000100:00100000:1.0:1746065189.113008:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263117568 00002000:00100000:1.0:1746065189.113046:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094091880 x1830881263117568/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.113062:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091880 with x1830881263117568 ext(2097152->3145727) 00002000:00010000:1.0:1746065189.113067:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094091880 00000100:00100000:1.0:1746065189.113100:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8277 00000100:00100000:1.0:1746065189.113106:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881263117568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.117088:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263117440 00000100:00100000:3.0:1746065189.117100:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263117440 00002000:00100000:3.0:1746065189.117142:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094092300 x1830881263117440/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.117150:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094092300 with x1830881263117440 ext(2097152->3145727) 00002000:00010000:3.0:1746065189.117156:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094092300 00000100:00100000:3.0:1746065189.117174:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8278 00000100:00100000:3.0:1746065189.117180:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881263117440:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.118437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.118544:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263117824 00000100:00100000:2.0:1746065189.118549:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263117824 00000100:00100000:2.0:1746065189.118580:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4278 00000100:00100000:2.0:1746065189.118586:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:31852:x1830881263117824:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065189.118783:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:31852:x1830881263117824:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 196us (348us total) trans 8589944233 rc 0/0 00000100:00100000:2.0:1746065189.118789:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4278 00000100:00080000:1.0:1746065189.118975:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065189.121301:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263117056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15988us (16145us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.121313:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8276 00002000:00100000:3.0:1746065189.121322:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094093b80 x1830881263117056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.121331:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093b80 with x1830881263117056 ext(2097152->3145727) 00002000:00010000:3.0:1746065189.121335:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094093b80 00000100:00100000:2.0:1746065189.139112:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881263117568:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25994us (29626us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.139125:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8277 00002000:00100000:2.0:1746065189.139137:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094091880 x1830881263117568/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.139147:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091880 with x1830881263117568 ext(2097152->3145727) 00002000:00010000:2.0:1746065189.139153:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094091880 00000100:00100000:0.0:1746065189.140035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.140131:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263117952 00000100:00100000:3.0:1746065189.140138:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263117952 00000100:00100000:3.0:1746065189.140164:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14686 00000100:00100000:3.0:1746065189.140169:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31857:x1830881263117952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.140180:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.140193:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e0b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.140212:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.140219:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065189.140220:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065189.140223:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.140246:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.140256:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 31 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.140270:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260374016:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.140349:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.142521:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881263117440:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25328us (29672us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.142530:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8278 00002000:00100000:2.0:1746065189.142540:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094092300 x1830881263117440/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.142549:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094092300 with x1830881263117440 ext(2097152->3145727) 00002000:00010000:2.0:1746065189.142553:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094092300 00000100:00100000:0.0:1746065189.143919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.143985:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260374016:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.144007:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.144022:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880137397600, rc 0) 00000100:00100000:3.0:1746065189.144054:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31857:x1830881263117952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3884us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.144061:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14686 00000100:00100000:2.0:1746065189.144114:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263118080 00000100:00100000:2.0:1746065189.144120:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263118080 00002000:00100000:2.0:1746065189.144148:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3272704->4194303) req@ffff880094093480 x1830881263118080/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.144155:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093480 with x1830881263118080 ext(3272704->4194303) 00010000:00010000:2.0:1746065189.144159:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 32 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.144169:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 32 pid: 25185 timeout: 888 lvb_type: 0 00002000:00010000:2.0:1746065189.144174:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094093480 00000100:00100000:2.0:1746065189.144188:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2522 00000100:00100000:2.0:1746065189.144194:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263118080:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065189.150561:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.154868:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263118208 00000100:00100000:3.0:1746065189.154879:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263118208 00000100:00100000:3.0:1746065189.154915:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14687 00000100:00100000:3.0:1746065189.154922:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+34:31862:x1830881263118208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.154939:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.154953:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e12 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.154972:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065189.154976:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 35 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.154985:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 35 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.154998:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880137397c00, rc 0) 00000100:00100000:3.0:1746065189.155048:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+35:31862:x1830881263118208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 126us (4499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.155054:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14687 00000100:00100000:2.0:1746065189.159563:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+35:1959:x1830881263118080:12345-192.168.202.46@tcp:4:cat.0 Request processed in 15360us (15639us total) trans 17179873621 rc 0/0 00000100:00100000:2.0:1746065189.159574:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2522 00002000:00100000:2.0:1746065189.159584:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3272704->4194303) req@ffff880094093480 x1830881263118080/t17179873621(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.159592:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094093480 with x1830881263118080 ext(3272704->4194303) 00010000:00010000:2.0:1746065189.159600:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 35 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.159611:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 35 pid: 25185 timeout: 888 lvb_type: 0 00002000:00010000:2.0:1746065189.159617:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094093480 00000100:00100000:0.0:1746065189.166395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.166953:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263118336 00000100:00100000:2.0:1746065189.166962:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263118336 00010000:00010000:2.0:1746065189.166990:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 35 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.167014:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7530 00000100:00100000:2.0:1746065189.167020:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+35:1958:x1830881263118336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.167031:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065189.167045:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065189 -> 1746065190 00002000:00010000:2.0:1746065189.167048:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065189 -> 1746065190 00010000:00010000:2.0:1746065189.167052:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 35 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.167061:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 35 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.167085:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f74d800/0x14b4f8542d4fd2cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dda expref: 35 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.169380:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.169386:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.169396:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.169406:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.169415:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.169415:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.169418:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 34 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.169424:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 34 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.169456:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 34 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.169467:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260374144:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.169567:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 30 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.169578:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260374272:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.169595:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.179673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.179783:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260374144:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065189.179792:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260374272:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065189.179811:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065189.179879:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:1958:x1830881263118336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 12858us (13492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.179889:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7530 00000100:00100000:3.0:1746065189.180085:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263118592 00000100:00100000:3.0:1746065189.180090:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263118592 00000100:00080000:1.0:1746065189.180354:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065189.180747:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9985 00000100:00100000:3.0:1746065189.180763:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:31866:x1830881263118592:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065189.180785:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.180801:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880137397e00/0x14b4f8542d4fd30b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e19 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.180905:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.180917:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.180926:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.180938:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.180943:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.180948:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181048:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880137396e00/0x14b4f8542d4fd320 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181056:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880137396e00/0x14b4f8542d4fd320 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181062:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880137396e00/0x14b4f8542d4fd320 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065189.181070:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065189.181144:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181151:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181155:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181159:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880137397200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065189.181162:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181167:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181176:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065189.181178:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065189.181181:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181185:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880137397200/0x14b4f8542d4fd312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181212:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181217:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181220:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181224:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880137397000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065189.181226:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181230:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181236:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205200) 00010000:00010000:3.0:1746065189.181238:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065189.181240:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181244:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880137397000/0x14b4f8542d4fd319 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.181275:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880137397e00/0x14b4f8542d4fd30b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e19 expref: 266 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.181284:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880137396e00/0x14b4f8542d4fd320 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e19 expref: 265 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.181290:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.181292:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065189.181294:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880137396e00, rc 0) 00000100:00100000:3.0:1746065189.181325:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:31866:x1830881263118592:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 563us (1659us total) trans 8589944234 rc 0/0 00000100:00100000:3.0:1746065189.181330:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9985 00000100:00100000:1.0:1746065189.183044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.183413:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263118848 00000100:00100000:3.0:1746065189.183420:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263118848 00002000:00100000:3.0:1746065189.183454:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880129b0df80 x1830881263118848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.183463:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0df80 with x1830881263118848 ext(2097152->3145727) 00002000:00010000:3.0:1746065189.183467:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0df80 00000100:00100000:3.0:1746065189.183483:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8279 00000100:00100000:3.0:1746065189.183489:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263118848:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.192603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.192688:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263118976 00000100:00100000:2.0:1746065189.192695:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263118976 00000100:00100000:2.0:1746065189.192736:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 772 00000100:00100000:2.0:1746065189.192743:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1960:x1830881263118976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.193909:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.193934:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880137396e00/0x14b4f8542d4fd320 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e19 expref: 265 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.193951:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.193955:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.193993:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1960:x1830881263118976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1250us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.193999:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 772 00000100:00100000:2.0:1746065189.195209:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263118848:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11716us (12166us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.195217:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8279 00002000:00100000:2.0:1746065189.195225:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880129b0df80 x1830881263118848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.195234:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0df80 with x1830881263118848 ext(2097152->3145727) 00002000:00010000:2.0:1746065189.195238:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0df80 00000100:00100000:0.0:1746065189.195856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.195876:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263119232 00000100:00100000:0.0:1746065189.195882:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263119232 00000100:00100000:0.0:1746065189.195919:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4279 00000100:00100000:0.0:1746065189.195925:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b51d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:31866:x1830881263119232:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065189.196074:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b51d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:31866:x1830881263119232:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 149us (219us total) trans 8589944235 rc 0/0 00000100:00100000:0.0:1746065189.196079:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4279 00000100:00100000:0.0:1746065189.196165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.196413:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263119488 00000100:00100000:2.0:1746065189.196417:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263119488 00002000:00100000:2.0:1746065189.196435:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880130446d80 x1830881263119488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.196442:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446d80 with x1830881263119488 ext(2097152->3145727) 00002000:00010000:2.0:1746065189.196445:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130446d80 00000100:00100000:2.0:1746065189.196454:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8280 00000100:00100000:2.0:1746065189.196458:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263119488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.204809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.204917:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263119616 00000100:00100000:1.0:1746065189.204924:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263119616 00000100:00100000:1.0:1746065189.205015:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14688 00000100:00100000:1.0:1746065189.205022:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+30:31862:x1830881263119616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.205035:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.205048:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e20 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.205070:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.205077:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065189.205079:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065189.205082:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.205105:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.205118:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 37 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.205127:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260374400:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065189.206657:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.209983:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263119488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13517us (13810us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.209993:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8280 00002000:00100000:2.0:1746065189.210002:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880130446d80 x1830881263119488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.210011:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446d80 with x1830881263119488 ext(2097152->3145727) 00002000:00010000:2.0:1746065189.210015:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130446d80 00000100:00100000:0.0:1746065189.211408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.211523:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260374400:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065189.211549:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.211564:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ce200, rc 0) 00000100:00100000:1.0:1746065189.211594:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+31:31862:x1830881263119616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6572us (6793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.211601:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14688 00000100:00100000:2.0:1746065189.212574:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263119744 00000100:00100000:2.0:1746065189.212581:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263119744 00010000:00010000:2.0:1746065189.212609:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 38 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.212877:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7531 00000100:00100000:2.0:1746065189.212884:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263119744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.212895:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.212915:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 38 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.212925:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 38 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.212951:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1c6b800/0x14b4f8542d4fd1e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3244032->3796991] (req 3244032->3796991) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60d63 expref: 38 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.213359:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.213361:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.213368:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.213374:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.213408:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.213418:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260374528:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.213988:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.214193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.214336:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263119872 00000100:00100000:1.0:1746065189.214341:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263119872 00000100:00100000:1.0:1746065189.214366:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14689 00000100:00100000:1.0:1746065189.214371:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:31857:x1830881263119872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.214382:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.214393:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e27 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.214410:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.214411:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.214415:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.214429:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.214436:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ce400, rc 0) 00000100:00100000:1.0:1746065189.214460:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:31857:x1830881263119872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.214466:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14689 00000100:00100000:2.0:1746065189.215972:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260374528:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.215990:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.216030:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263119744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3145us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.216039:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7531 00000100:00100000:0.0:1746065189.220459:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.220761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.221041:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120384 00000100:00100000:2.0:1746065189.221049:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120384 00002000:00100000:2.0:1746065189.221083:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880130447100 x1830881263120384/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.221098:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447100 with x1830881263120384 ext(3145728->4194303) 00002000:00010000:2.0:1746065189.221103:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130447100 00000100:00100000:2.0:1746065189.221282:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120256 00000100:00100000:2.0:1746065189.221285:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120256 00002000:00100000:2.0:1746065189.221300:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880130444a80 x1830881263120256/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.221307:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444a80 with x1830881263120256 ext(3145728->4194303) 00002000:00010000:2.0:1746065189.221310:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130444a80 00000100:00100000:1.0:1746065189.221363:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8281 00000100:00100000:1.0:1746065189.221371:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:1959:x1830881263120384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.221889:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8282 00000100:00100000:2.0:1746065189.221895:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263120256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.224416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.224461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.224539:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120640 00000100:00100000:1.0:1746065189.224546:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120640 00002000:00100000:1.0:1746065189.224583:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880130447480 x1830881263120640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.224593:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447480 with x1830881263120640 ext(3145728->4194303) 00002000:00010000:1.0:1746065189.224598:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130447480 00000100:00100000:1.0:1746065189.224614:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263120896 00000100:00100000:1.0:1746065189.224616:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263120896 00002000:00100000:1.0:1746065189.224627:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880130444000 x1830881263120896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.224633:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444000 with x1830881263120896 ext(3145728->4194303) 00002000:00010000:1.0:1746065189.224636:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130444000 00000100:00100000:1.0:1746065189.224647:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8283 00000100:00100000:1.0:1746065189.224653:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263120640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.225698:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8284 00000100:00100000:3.0:1746065189.225707:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263120896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.233436:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263120256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11528us (12663us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.233449:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8282 00002000:00100000:3.0:1746065189.233460:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880130444a80 x1830881263120256/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.233470:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444a80 with x1830881263120256 ext(3145728->4194303) 00002000:00010000:3.0:1746065189.233476:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130444a80 00000100:00100000:2.0:1746065189.241102:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:1959:x1830881263120384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19724us (20643us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.241112:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8281 00002000:00100000:2.0:1746065189.241123:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880130447100 x1830881263120384/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.241130:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447100 with x1830881263120384 ext(3145728->4194303) 00002000:00010000:2.0:1746065189.241135:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130447100 00000100:00100000:1.0:1746065189.245048:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263120640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20386us (20630us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065189.245057:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8283 00002000:00100000:1.0:1746065189.245067:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880130447480 x1830881263120640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.245075:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447480 with x1830881263120640 ext(3145728->4194303) 00002000:00010000:1.0:1746065189.245082:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130447480 00000100:00100000:3.0:1746065189.247892:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263120896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22179us (23422us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.247905:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8284 00002000:00100000:3.0:1746065189.247915:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880130444000 x1830881263120896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.247924:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444000 with x1830881263120896 ext(3145728->4194303) 00002000:00010000:3.0:1746065189.247929:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130444000 00000100:00100000:0.0:1746065189.251561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.251700:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263121024 00000100:00100000:3.0:1746065189.251714:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263121024 00000100:00100000:3.0:1746065189.251779:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14690 00000100:00100000:3.0:1746065189.251787:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263121024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.251802:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.251841:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c813400/0x14b4f8542d4fd33c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e2e expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.251893:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260374656:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065189.252143:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.260117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:3.0:1746065189.260629:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065189 -> 1746065190 00000100:00100000:3.0:1746065189.260669:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260374656:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065189.260723:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c813400/0x14b4f8542d4fd33c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e2e expref: 32 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.260740:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c813400/0x14b4f8542d4fd33c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e2e expref: 32 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.260777:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c813400, rc 0) 00000100:00100000:3.0:1746065189.260872:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263121024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9084us (9329us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065189.260882:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14690 00000100:00100000:3.0:1746065189.260919:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263121152 00000100:00100000:3.0:1746065189.260926:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263121152 00000100:00100000:3.0:1746065189.260961:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14691 00000100:00100000:3.0:1746065189.260967:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263121152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.260982:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.260994:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c813a00/0x14b4f8542d4fd343 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e35 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.261794:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260374784:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065189.264512:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.267423:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.267490:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263121536 00000100:00100000:2.0:1746065189.267498:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263121536 00000100:00100000:2.0:1746065189.267549:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9986 00000100:00100000:2.0:1746065189.267556:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:31868:x1830881263121536:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.267580:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.267596:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93800/0x14b4f8542d4fd34a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e3c expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.267688:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267700:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267709:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267721:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267726:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267732:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267861:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93e00/0x14b4f8542d4fd35f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267870:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93e00/0x14b4f8542d4fd35f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267875:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93e00/0x14b4f8542d4fd35f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065189.267883:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065189.267952:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267958:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267967:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267972:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe93a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065189.267975:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267980:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267988:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065189.267991:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065189.267994:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.267999:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.268016:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.268020:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.268025:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.268029:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe93c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065189.268031:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.268035:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.268044:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880129881a00) 00010000:00010000:2.0:1746065189.268045:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065189.268047:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.268052:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd358 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.268079:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93800/0x14b4f8542d4fd34a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e3c expref: 26 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.268088:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93e00/0x14b4f8542d4fd35f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e3c expref: 25 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.268093:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.268095:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065189.268097:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe93e00, rc 0) 00000100:00100000:2.0:1746065189.268145:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:31868:x1830881263121536:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 589us (731us total) trans 8589944236 rc 0/0 00000100:00100000:2.0:1746065189.268151:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9986 00000100:00100000:0.0:1746065189.269591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.269641:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263121664 00000100:00100000:3.0:1746065189.269647:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263121664 00002000:00100000:3.0:1746065189.269674:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4284416->5013503) req@ffff880130444380 x1830881263121664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.269684:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444380 with x1830881263121664 ext(4284416->5013503) 00002000:00010000:3.0:1746065189.269688:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130444380 00000100:00100000:3.0:1746065189.269713:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8285 00000100:00100000:3.0:1746065189.269718:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263121664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.270391:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260374784:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065189.270414:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c813a00/0x14b4f8542d4fd343 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e35 expref: 39 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.270424:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c813a00/0x14b4f8542d4fd343 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e35 expref: 39 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.270436:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c813a00, rc 0) 00000100:00100000:2.0:1746065189.270466:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263121152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9500us (10362us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.270472:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14691 00000100:00100000:0.0:1746065189.270580:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.270645:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263121792 00000100:00100000:2.0:1746065189.270649:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263121792 00000100:00100000:2.0:1746065189.270671:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 773 00000100:00100000:2.0:1746065189.270675:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263121792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.272014:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.272036:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93e00/0x14b4f8542d4fd35f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e3c expref: 25 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.272050:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.272053:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.272091:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881263121792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1414us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.272098:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 773 00000100:00100000:0.0:1746065189.275009:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.275250:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263121920 00000100:00100000:2.0:1746065189.275259:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263121920 00000100:00100000:2.0:1746065189.275315:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14692 00000100:00100000:2.0:1746065189.275323:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:31857:x1830881263121920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.275340:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.275361:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e43 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.275400:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.275409:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065189.275410:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065189.275414:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 39 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.275445:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.275458:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 32 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.275470:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260374912:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.275558:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.278653:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260374912:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.278690:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 39 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.278713:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe93400, rc 0) 00000100:00100000:3.0:1746065189.278769:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:31857:x1830881263121920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3445us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.278778:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14692 00000100:00100000:2.0:1746065189.282908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.282982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.283577:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263121664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13856us (13987us total) trans 0 rc 729088/729088 00000100:00100000:3.0:1746065189.283587:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8285 00002000:00100000:3.0:1746065189.283598:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4284416->5013503) req@ffff880130444380 x1830881263121664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 729088/729088 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.283605:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130444380 with x1830881263121664 ext(4284416->5013503) 00010000:00010000:3.0:1746065189.283614:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.283626:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065189.283633:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130444380 00000100:00100000:2.0:1746065189.284533:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122048 00000100:00100000:2.0:1746065189.284542:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122048 00000100:00100000:2.0:1746065189.284645:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14693 00000100:00100000:2.0:1746065189.284652:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+31:31868:x1830881263122048:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.284665:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.284676:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e4a expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.284705:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.284713:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 38 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.284719:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065189.284721:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065189.284724:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2371584->2609151] (req 2371584->2609151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.284758:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 38 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.284931:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122176 00000100:00100000:3.0:1746065189.284935:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122176 00002000:00100000:3.0:1746065189.284957:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4284415) req@ffff8800900c1f80 x1830881263122176/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.284964:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1f80 with x1830881263122176 ext(4194304->4284415) 00010000:00010000:3.0:1746065189.284968:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 33 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.285188:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 38 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.285192:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 33 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065189.285198:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900c1f80 00000100:00100000:2.0:1746065189.285200:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260375040:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.285406:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2523 00000100:00100000:3.0:1746065189.285412:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263122176:12345-192.168.202.46@tcp:4:multiop.0 00010000:00010000:2.0:1746065189.285532:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 34 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.285540:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 34 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.285548:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260375168:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.285569:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.288068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.288278:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122304 00000100:00100000:1.0:1746065189.288287:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122304 00000100:00100000:1.0:1746065189.288333:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14694 00000100:00100000:1.0:1746065189.288341:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+35:1959:x1830881263122304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.288355:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.288371:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a62e200/0x14b4f8542d4fd37b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e51 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065189.288418:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260375296:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065189.288489:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.289526:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+37:1960:x1830881263122176:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 4111us (6540us total) trans 21474840898 rc 0/0 00000100:00100000:3.0:1746065189.289535:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2523 00002000:00100000:3.0:1746065189.289544:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4284415) req@ffff8800900c1f80 x1830881263122176/t21474840898(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.289552:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1f80 with x1830881263122176 ext(4194304->4284415) 00010000:00010000:3.0:1746065189.289559:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 37 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.289569:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 37 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065189.289575:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900c1f80 00000100:00100000:3.0:1746065189.290555:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260375040:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.290565:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260375168:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.290585:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2371584->2609151] (req 2371584->2609151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 36 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.290597:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe93c00, rc 0) 00000100:00100000:3.0:1746065189.291230:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+36:31868:x1830881263122048:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6575us (8326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.291238:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14693 00000100:00100000:0.0:1746065189.292454:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.292489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.292514:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122560 00000100:00100000:2.0:1746065189.292521:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122560 00010000:00010000:2.0:1746065189.292549:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 39 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.292581:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122432 00000100:00100000:2.0:1746065189.292583:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122432 00010000:00010000:2.0:1746065189.292593:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 36 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.292608:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7532 00000100:00100000:1.0:1746065189.292610:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260375296:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065189.292614:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263122560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.292625:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.292634:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 11 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 39 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.292634:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a62e200/0x14b4f8542d4fd37b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 11 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e51 expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.292643:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 39 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.292683:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7533 00000100:00100000:3.0:1746065189.292690:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+36:1958:x1830881263122432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.292696:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.292778:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a62e200/0x14b4f8542d4fd37b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 11 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e51 expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.292784:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f74da00/0x14b4f8542d4fd2ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 12 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dfd expref: 39 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.292788:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a62e200, rc 0) 00010000:00010000:2.0:1746065189.292797:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065189.292869:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 35 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.292878:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 35 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.292890:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0800/0x14b4f8542d4fd2e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60df6 expref: 35 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.292903:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.292941:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263122560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 326us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.292944:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+34:1959:x1830881263122304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4604us (4885us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.292947:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7532 00000100:00100000:1.0:1746065189.292949:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14694 00000100:00100000:3.0:1746065189.293299:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881263122432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 609us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.293304:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7533 00000100:00100000:0.0:1746065189.294890:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.294968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.295039:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122688 00000100:00100000:3.0:1746065189.295046:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122688 00010000:00010000:3.0:1746065189.295074:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 33 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.295104:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7534 00000100:00100000:3.0:1746065189.295110:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263122688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.295121:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.295140:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 33 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.295151:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 33 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.295171:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800908d0e00/0x14b4f8542d4fd2f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e04 expref: 33 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.295186:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.295188:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.295195:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.295204:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.295212:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.295213:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.295216:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.295222:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.295252:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.295264:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260375424:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065189.295365:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 37 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.295373:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260375552:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065189.295392:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065189.295539:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263122816 00000100:00100000:1.0:1746065189.295545:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263122816 00000100:00100000:1.0:1746065189.296359:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14695 00000100:00100000:1.0:1746065189.296367:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+33:31862:x1830881263122816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.296380:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.296390:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e58 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.296405:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.296406:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.296411:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.296421:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.296428:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a62e600, rc 0) 00000100:00100000:1.0:1746065189.296450:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+34:31862:x1830881263122816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 84us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.296455:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14695 00000100:00100000:0.0:1746065189.298290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.298630:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260375424:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065189.298996:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260375552:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065189.299015:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.299053:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263122688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3942us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.299062:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7534 00000100:00100000:2.0:1746065189.299200:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263123072 00000100:00100000:2.0:1746065189.299205:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263123072 00002000:00100000:2.0:1746065189.299233:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2371584->2375679) req@ffff88009c7ace00 x1830881263123072/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.299242:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ace00 with x1830881263123072 ext(2371584->2375679) 00002000:00010000:2.0:1746065189.299246:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ace00 00000100:00100000:2.0:1746065189.299259:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8286 00000100:00100000:2.0:1746065189.299263:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263123072:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.299404:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263123072:12345-192.168.202.46@tcp:3:cat.0 Request processed in 140us (1119us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065189.299409:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8286 00002000:00100000:2.0:1746065189.299414:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2371584->2375679) req@ffff88009c7ace00 x1830881263123072/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.299420:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ace00 with x1830881263123072 ext(2371584->2375679) 00002000:00010000:2.0:1746065189.299422:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ace00 00000100:00100000:0.0:1746065189.301149:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.304109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.304154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.304982:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263123456 00000100:00100000:2.0:1746065189.304991:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263123456 00000100:00100000:2.0:1746065189.305036:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263123584 00000100:00100000:2.0:1746065189.305039:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263123584 00000100:00100000:2.0:1746065189.305057:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14696 00000100:00100000:2.0:1746065189.305064:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881263123456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.305080:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.305095:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe92000/0x14b4f8542d4fd389 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e5f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.305123:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe92000/0x14b4f8542d4fd389 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e5f expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.305133:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe92000/0x14b4f8542d4fd389 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e5f expref: 34 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.305146:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe92000, rc 0) 00000100:00100000:2.0:1746065189.305189:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881263123456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 126us (1089us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.305194:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14696 00000100:00100000:2.0:1746065189.305205:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14697 00000100:00100000:2.0:1746065189.305209:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31866:x1830881263123584:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.305215:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.305224:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e66 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.305239:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.305246:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.305251:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.305252:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.305255:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2977792->3145727] (req 2977792->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.305280:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 33 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.305291:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 33 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.305302:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260375680:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.305354:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 32 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.305361:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 32 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.305367:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260375808:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.305381:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065189.305641:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263123328 00000100:00100000:1.0:1746065189.305646:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263123328 00002000:00100000:1.0:1746065189.305669:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009c7ac380 x1830881263123328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.305682:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac380 with x1830881263123328 ext(4194304->5013503) 00002000:00010000:1.0:1746065189.305686:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ac380 00000100:00100000:1.0:1746065189.305706:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8287 00000100:00100000:1.0:1746065189.305710:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263123328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.307087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.307910:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263123840 00000100:00100000:3.0:1746065189.307918:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263123840 00002000:00100000:3.0:1746065189.307953:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2605056->2609151) req@ffff88009c7afb80 x1830881263123840/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.307963:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7afb80 with x1830881263123840 ext(2605056->2609151) 00002000:00010000:3.0:1746065189.307968:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7afb80 00000100:00100000:3.0:1746065189.307988:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8288 00000100:00100000:3.0:1746065189.307995:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881263123840:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.308119:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881263123840:12345-192.168.202.46@tcp:3:cat.0 Request processed in 123us (1038us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065189.308124:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8288 00002000:00100000:3.0:1746065189.308129:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2605056->2609151) req@ffff88009c7afb80 x1830881263123840/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.308136:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7afb80 with x1830881263123840 ext(2605056->2609151) 00002000:00010000:3.0:1746065189.308139:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7afb80 00000100:00100000:0.0:1746065189.314351:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260375680:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.314365:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260375808:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065189.314390:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2977792->3145727] (req 2977792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.314406:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe92800, rc 0) 00000100:00100000:0.0:1746065189.314446:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31866:x1830881263123584:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9234us (10290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.314454:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14697 00000100:00100000:1.0:1746065189.314907:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263123328:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9195us (13766us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065189.314915:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8287 00002000:00100000:1.0:1746065189.314923:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009c7ac380 x1830881263123328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.314931:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac380 with x1830881263123328 ext(4194304->5013503) 00002000:00010000:1.0:1746065189.314935:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ac380 00000100:00100000:0.0:1746065189.317625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.317669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.317735:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263123968 00000100:00100000:3.0:1746065189.317742:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263123968 00010000:00010000:3.0:1746065189.317788:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 34 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.318203:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263124096 00000100:00100000:3.0:1746065189.318207:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263124096 00010000:00010000:3.0:1746065189.318222:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 32 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065189.319495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.319683:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7535 00000100:00100000:3.0:1746065189.319694:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263123968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.319706:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.319726:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 34 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.319739:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 34 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.319772:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880137397c00/0x14b4f8542d4fd304 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e12 expref: 34 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.319790:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.319958:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7536 00000100:00100000:1.0:1746065189.319967:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263124096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.319975:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.319985:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 32 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.319993:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 32 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.320004:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880137397600/0x14b4f8542d4fd2fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e0b expref: 32 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.320020:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.320022:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.320027:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.320034:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.320063:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065189.320074:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260375936:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065189.320138:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065189.320153:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263124352 00000100:00100000:1.0:1746065189.320157:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263124352 00002000:00100000:1.0:1746065189.320183:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88009c7ac000 x1830881263124352/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.320191:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac000 with x1830881263124352 ext(5009408->5013503) 00002000:00010000:1.0:1746065189.320195:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ac000 00000100:00100000:1.0:1746065189.320209:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8289 00000100:00100000:1.0:1746065189.320214:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263124352:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065189.320347:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263124352:12345-192.168.202.46@tcp:3:cat.0 Request processed in 133us (855us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065189.320353:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8289 00002000:00100000:1.0:1746065189.320359:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88009c7ac000 x1830881263124352/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.320365:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac000 with x1830881263124352 ext(5009408->5013503) 00002000:00010000:1.0:1746065189.320368:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ac000 00000100:00100000:0.0:1746065189.320614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.320692:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263123968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1001us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.320699:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7535 00000100:00100000:2.0:1746065189.320777:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263124608 00000100:00100000:2.0:1746065189.320782:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263124608 00000100:00100000:2.0:1746065189.320804:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4280 00000100:00100000:2.0:1746065189.320809:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+24:31868:x1830881263124608:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065189.320955:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+25:31868:x1830881263124608:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 145us (341us total) trans 8589944237 rc 0/0 00000100:00100000:2.0:1746065189.320961:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4280 00000100:00100000:0.0:1746065189.327779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.327836:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263124864 00000100:00100000:2.0:1746065189.327845:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263124864 00000100:00100000:2.0:1746065189.327900:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14698 00000100:00100000:2.0:1746065189.327907:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263124864:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.327929:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.327953:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd397 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e74 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065189.327975:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.328004:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260376064:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065189.328022:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.328072:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.328125:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263124736 00000100:00100000:3.0:1746065189.328128:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263124736 00000100:00100000:3.0:1746065189.328148:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14699 00000100:00100000:3.0:1746065189.328152:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263124736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.328158:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.328167:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd39e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e6d expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.328183:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd39e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e6d expref: 39 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.328192:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd39e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e6d expref: 39 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.328204:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec28600, rc 0) 00000100:00100000:0.0:1746065189.328429:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263125120 00000100:00100000:0.0:1746065189.328433:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263125120 00000100:00100000:0.0:1746065189.328455:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4281 00000100:00100000:0.0:1746065189.328459:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:31862:x1830881263125120:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065189.328631:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263124736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 476us (655us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065189.328636:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14699 00000100:00100000:1.0:1746065189.328696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.328916:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263125376 00000100:00100000:2.0:1746065189.328919:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263125376 00002000:00100000:2.0:1746065189.328937:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2977792->2981887) req@ffff880129b0f480 x1830881263125376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.328944:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f480 with x1830881263125376 ext(2977792->2981887) 00002000:00010000:2.0:1746065189.328948:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f480 00000100:00100000:2.0:1746065189.328958:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8290 00000100:00100000:2.0:1746065189.328961:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263125376:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065189.329088:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263125376:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 125us (393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065189.329094:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8290 00002000:00100000:2.0:1746065189.329098:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2977792->2981887) req@ffff880129b0f480 x1830881263125376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.329104:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f480 with x1830881263125376 ext(2977792->2981887) 00002000:00010000:2.0:1746065189.329106:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f480 00000100:00100000:0.0:1746065189.331309:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+26:31862:x1830881263125120:12345-192.168.202.46@tcp:35:cat.0 Request processed in 2840us (3277us total) trans 8589944238 rc 0/0 00000100:00100000:0.0:1746065189.331320:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4281 00000100:00100000:0.0:1746065189.331375:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260375936:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065189.331390:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065189.331408:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263124096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 11444us (13739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.331415:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7536 00002000:00010000:2.0:1746065189.333010:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065189 -> 1746065190 00000100:00100000:2.0:1746065189.333034:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260376064:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065189.333056:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd397 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e74 expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.333069:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe93a00/0x14b4f8542d4fd397 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e74 expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.333142:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe93a00, rc 0) 00000100:00100000:2.0:1746065189.333517:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263124864:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5607us (5956us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.333524:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14698 00000100:00100000:0.0:1746065189.335091:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.335166:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263125504 00000100:00100000:2.0:1746065189.335174:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263125504 00000100:00100000:2.0:1746065189.335218:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14700 00000100:00100000:2.0:1746065189.335226:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:31866:x1830881263125504:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.335242:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.335256:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e7b expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.335283:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 39 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.335292:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.335298:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.335304:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746065189.335306:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746065189.335309:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.335334:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 39 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.335345:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 39 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.335356:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260376192:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.335446:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 32 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.335455:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 32 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.335463:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260376320:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.335488:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 39 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.335497:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 39 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.335504:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260376448:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.335522:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.338610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.338959:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260376192:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.339116:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263125632 00000100:00100000:0.0:1746065189.339123:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263125632 00010000:00010000:0.0:1746065189.339155:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 40 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065189.339189:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7537 00000100:00100000:0.0:1746065189.339195:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1959:x1830881263125632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065189.339210:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065189.339230:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 40 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.339242:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 40 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.339264:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce400/0x14b4f8542d4fd335 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e27 expref: 40 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.339282:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065189.339336:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881263125632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 141us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.339342:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7537 00000100:00100000:2.0:1746065189.339558:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260376320:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.346211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.346319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.346462:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263125760 00000100:00100000:3.0:1746065189.346470:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263125760 00000100:00100000:3.0:1746065189.346513:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14701 00000100:00100000:3.0:1746065189.346521:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263125760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.346537:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.346551:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd3ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e82 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.346576:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd3ac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e82 expref: 40 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.346586:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd3ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e82 expref: 40 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.346598:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec28a00, rc 0) 00000100:00100000:3.0:1746065189.346633:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263125760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 113us (431us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065189.346638:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14701 00000100:00100000:2.0:1746065189.346808:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260376448:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.346843:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 38 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.346852:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe92e00, rc 0) 00000100:00100000:2.0:1746065189.346927:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:31866:x1830881263125504:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11702us (11842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.346932:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14700 00000100:00100000:0.0:1746065189.347096:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263125888 00000100:00100000:0.0:1746065189.347100:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263125888 00010000:00010000:0.0:1746065189.347116:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 33 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065189.347131:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7538 00000100:00100000:0.0:1746065189.347135:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263125888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065189.347142:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065189.347157:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 33 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.347165:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 33 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.347177:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ce200/0x14b4f8542d4fd32e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e20 expref: 33 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.347185:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065189.347201:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263125888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.347205:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7538 00000100:00100000:1.0:1746065189.360368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.360411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.360474:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263126272 00000100:00100000:2.0:1746065189.360482:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263126272 00010000:00010000:2.0:1746065189.360513:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 38 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.360540:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7539 00000100:00100000:2.0:1746065189.360547:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263126272:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.360560:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.360578:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 38 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.360589:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 38 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.360608:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93400/0x14b4f8542d4fd36d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2621440->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e43 expref: 38 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.360625:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.360627:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.360632:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.360639:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.360666:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.360678:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260376576:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065189.360788:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263126144 00000100:00100000:0.0:1746065189.360792:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263126144 00000100:00100000:0.0:1746065189.360839:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4282 00000100:00100000:0.0:1746065189.360845:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:31857:x1830881263126144:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065189.361470:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.361877:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:31857:x1830881263126144:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1030us (1516us total) trans 8589944239 rc 0/0 00000100:00100000:0.0:1746065189.361885:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4282 00000100:00100000:2.0:1746065189.366029:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260376576:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.366049:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.366097:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881263126272:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5549us (5684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.366106:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7539 00000100:00100000:0.0:1746065189.375878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.375961:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263126528 00000100:00100000:1.0:1746065189.375969:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263126528 00002000:00100000:1.0:1746065189.376007:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3665920->3670015) req@ffff88009c7af480 x1830881263126528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.376017:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af480 with x1830881263126528 ext(3665920->3670015) 00002000:00010000:1.0:1746065189.376023:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7af480 00000100:00100000:1.0:1746065189.376099:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8291 00000100:00100000:1.0:1746065189.376107:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263126528:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065189.376246:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263126528:12345-192.168.202.46@tcp:3:cat.0 Request processed in 140us (376us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065189.376252:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8291 00002000:00100000:1.0:1746065189.376256:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3665920->3670015) req@ffff88009c7af480 x1830881263126528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.376263:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af480 with x1830881263126528 ext(3665920->3670015) 00002000:00010000:1.0:1746065189.376266:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7af480 00000100:00100000:0.0:1746065189.391140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.391256:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263126656 00000100:00100000:3.0:1746065189.391264:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263126656 00000100:00100000:3.0:1746065189.391324:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9987 00000100:00100000:3.0:1746065189.391331:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:31872:x1830881263126656:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065189.391348:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.391362:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28e00/0x14b4f8542d4fd3b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e89 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.391415:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.391425:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.391433:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.391443:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.391447:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.391451:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.391538:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.391546:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 265 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.391553:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.391579:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 265 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.391590:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 265 pid: 14645 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.391605:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260376704:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.391673:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c240 going to sleep for 11 seconds 00000100:00080000:1.0:1746065189.392207:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065189.394728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.394871:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263126912 00000100:00100000:1.0:1746065189.394878:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263126912 00000100:00100000:1.0:1746065189.394925:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4283 00000100:00100000:1.0:1746065189.394931:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:31256:x1830881263126912:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065189.395093:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:31256:x1830881263126912:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 162us (371us total) trans 8589944240 rc 0/0 00000100:00100000:1.0:1746065189.395099:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4283 00000100:00100000:3.0:1746065189.396643:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260376704:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.396663:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065189.397763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.397958:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263127040 00000100:00100000:2.0:1746065189.397964:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263127040 00010000:00010000:2.0:1746065189.397991:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 267 pid: 14645 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.398145:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7540 00000100:00100000:2.0:1746065189.398150:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1960:x1830881263127040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.398161:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.398165:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 267 pid: 14645 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.398172:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 267 pid: 14645 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.398186:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094896400/0x14b4f8542d4fce9d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60b48 expref: 267 pid: 14645 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.398205:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.398208:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.398214:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.398218:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.398229:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.398261:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:1960:x1830881263127040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 110us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.398266:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7540 00010000:00010000:0.0:1746065189.398355:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398360:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065189.398394:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:0.0:1746065189.398398:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065189.398412:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398421:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398429:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398435:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398440:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398445:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec29000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065189.398448:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398457:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398466:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065189.398468:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065189.398471:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398475:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd3ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398496:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398501:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398506:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398510:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec29200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065189.398512:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398516:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398521:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205200) 00010000:00010000:0.0:1746065189.398523:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065189.398524:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398528:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd3c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.398554:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28e00/0x14b4f8542d4fd3b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.398565:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 7 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.398570:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065189.398571:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065189.398573:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29400, rc 0) 00000100:00100000:0.0:1746065189.398606:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31872:x1830881263126656:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 7275us (7925us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.398613:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9987 00000100:00100000:0.0:1746065189.402006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.402040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.402078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.402183:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263127168 00000100:00100000:2.0:1746065189.402191:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263127168 00000100:00100000:2.0:1746065189.402248:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263127296 00000100:00100000:2.0:1746065189.402251:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263127296 00000100:00100000:2.0:1746065189.402272:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263127424 00000100:00100000:2.0:1746065189.402274:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263127424 00000100:00100000:2.0:1746065189.402284:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14702 00000100:00080000:1.0:1746065189.402315:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065189.402318:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065189.402370:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881263127168:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065189.402386:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.402400:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e90 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.402421:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.402422:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.402430:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.402443:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.402452:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe92c00, rc 0) 00000100:00100000:3.0:1746065189.402453:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14703 00000100:00100000:3.0:1746065189.402459:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263127296:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065189.402466:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.402476:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e97 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.402485:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.402487:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065189.402488:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263127168:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 197us (491us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065189.402491:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065189.402494:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14702 00010000:00010000:3.0:1746065189.402499:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.402506:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29600, rc 0) 00000100:00100000:2.0:1746065189.402506:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14704 00000100:00100000:2.0:1746065189.402510:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263127424:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065189.402515:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065189.402519:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263127296:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 62us (479us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065189.402520:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60e9e expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.402524:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14703 00010000:00010000:2.0:1746065189.402528:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.402529:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.402533:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.402545:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.402551:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe92200, rc 0) 00000100:00100000:2.0:1746065189.402566:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263127424:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 55us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.402570:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14704 00000100:00100000:0.0:1746065189.402952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.402982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.403010:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.403061:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263127680 00000100:00100000:3.0:1746065189.403066:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263127680 00000100:00100000:3.0:1746065189.403423:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263127552 00000100:00100000:3.0:1746065189.403426:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263127552 00000100:00100000:3.0:1746065189.403442:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263127808 00000100:00100000:3.0:1746065189.403443:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263127808 00000100:00100000:3.0:1746065189.403454:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14705 00000100:00100000:3.0:1746065189.403459:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263127680:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:2.0:1746065189.403461:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14706 00010000:00010000:3.0:1746065189.403466:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065189.403466:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263127552:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065189.403471:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.403473:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd3e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60eac expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.403476:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ea5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.403484:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.403485:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.403489:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd3e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eac expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.403489:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.403497:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd3e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eac expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.403498:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.403504:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe93000, rc 0) 00010000:00010000:3.0:1746065189.403508:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29e00, rc 0) 00000100:00100000:3.0:1746065189.403536:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263127680:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 76us (584us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.403536:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263127552:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 70us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.403541:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14706 00000100:00100000:3.0:1746065189.403626:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14705 00000100:00100000:2.0:1746065189.403629:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14707 00000100:00100000:2.0:1746065189.403635:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263127808:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065189.403641:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.403647:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe93600/0x14b4f8542d4fd3f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60eb3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.403679:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260376832:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065189.403724:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.405549:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260376832:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065189.405574:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe93600/0x14b4f8542d4fd3f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eb3 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.405584:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe93600/0x14b4f8542d4fd3f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eb3 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.405601:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe93600, rc 0) 00000100:00100000:2.0:1746065189.405637:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263127808:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2001us (2624us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.405643:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14707 00000100:00100000:0.0:1746065189.406865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.406935:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128064 00000100:00100000:2.0:1746065189.406944:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128064 00000100:00100000:2.0:1746065189.406976:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9988 00000100:00100000:2.0:1746065189.406982:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31872:x1830881263128064:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065189.406997:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.407010:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93800/0x14b4f8542d4fd3f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60eba expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.407091:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.407104:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.407110:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.407142:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.407152:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 8 pid: 14643 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.407162:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260376960:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.407228:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.408730:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260376960:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.408745:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065189.408973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.409196:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128192 00000100:00100000:1.0:1746065189.409201:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128192 00010000:00010000:1.0:1746065189.409225:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 9 pid: 14643 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.409360:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7541 00000100:00100000:1.0:1746065189.409367:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263128192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.409376:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.409380:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 9 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.409389:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 9 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.409404:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29400/0x14b4f8542d4fd3c8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e89 expref: 9 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.409427:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065189.409431:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.409439:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.409444:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.409469:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.409499:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263128192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 133us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.409504:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7541 00010000:00010000:3.0:1746065189.409671:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.409681:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065189.409695:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065189.409806:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe93800/0x14b4f8542d4fd3f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eba expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.410010:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eba expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.410017:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.410019:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065189.410021:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe92400, rc 0) 00000100:00100000:3.0:1746065189.410054:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31872:x1830881263128064:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 3072us (3194us total) trans 8589944241 rc 0/0 00000100:00100000:3.0:1746065189.410060:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9988 00000100:00100000:0.0:1746065189.411617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.411654:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128448 00000100:00100000:3.0:1746065189.411659:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128448 00000100:00100000:3.0:1746065189.411693:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9989 00000100:00100000:3.0:1746065189.411700:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31872:x1830881263128448:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065189.411716:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.411718:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065189.411733:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe92400/0x14b4f8542d4fd400 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eba expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.411741:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.411744:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065189.411762:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28e00/0x14b4f8542d4fd40e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ec1 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.411853:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd415 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.411862:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd415 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.411870:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd415 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065189.411877:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065189.411945:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28e00/0x14b4f8542d4fd40e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ec1 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.411956:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd415 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ec1 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.411962:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.411964:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065189.411965:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29200, rc 0) 00000100:00100000:3.0:1746065189.411997:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31872:x1830881263128448:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 297us (382us total) trans 8589944242 rc 0/0 00000100:00100000:3.0:1746065189.412002:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9989 00000100:00100000:0.0:1746065189.415162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.415241:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128576 00000100:00100000:3.0:1746065189.415247:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128576 00000100:00100000:3.0:1746065189.415288:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9990 00000100:00100000:3.0:1746065189.415296:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31872:x1830881263128576:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065189.415314:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.415330:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd423 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ec8 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.415376:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd423 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ec8 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.415386:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd423 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ec8 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.415402:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.415405:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065189.415407:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29e00, rc 0) 00000100:00100000:3.0:1746065189.415456:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31872:x1830881263128576:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 160us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.415461:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9990 00000100:00100000:0.0:1746065189.417108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.417137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.417166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.417192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.417207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.417210:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128832 00000100:00100000:2.0:1746065189.417216:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128832 00000100:00100000:0.0:1746065189.417229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.417243:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129088 00000100:00100000:0.0:1746065189.417244:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129344 00000100:00100000:2.0:1746065189.417245:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129088 00000100:00100000:0.0:1746065189.417245:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129344 00000100:00100000:2.0:1746065189.417254:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128704 00000100:00100000:2.0:1746065189.417256:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128704 00000100:00100000:0.0:1746065189.417257:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263128960 00000100:00100000:0.0:1746065189.417258:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263128960 00000100:00100000:2.0:1746065189.417264:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129216 00000100:00100000:2.0:1746065189.417266:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129216 00000100:00100000:0.0:1746065189.417269:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14708 00000100:00100000:0.0:1746065189.417274:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263128832:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065189.417276:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14709 00000100:00100000:2.0:1746065189.417280:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263129088:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065189.417302:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.417302:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.417315:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.417315:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 30 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.417322:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065189.417322:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065189.417328:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 32 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.417329:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.417334:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065189.417334:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.417335:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065189.417335:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.417337:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.417337:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.417359:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 31 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.417359:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 32 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.417369:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 31 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.417369:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 32 pid: 2463 timeout: 888 lvb_type: 1 00000100:00100000:2.0:1746065189.417379:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260377088:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.417379:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260377216:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065189.417425:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14710 00000100:00100000:3.0:1746065189.417431:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14711 00000100:00100000:1.0:1746065189.417432:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263129344:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:3.0:1746065189.417437:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263128704:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065189.417447:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.417450:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.417455:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.417458:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 36 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.417461:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065189.417462:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065189.417464:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.417464:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.417470:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 31 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.417474:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.417475:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.417477:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.417477:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 30 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.417484:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 30 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.417489:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 31 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.417496:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 31 pid: 8429 timeout: 888 lvb_type: 1 00000100:00100000:1.0:1746065189.417497:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260377344:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.417503:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260377472:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065189.417910:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065189.417918:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 10 pid: 25185 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746065189.417926:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260377600:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065189.417949:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 30 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.417955:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 30 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065189.417962:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260377728:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.417976:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065189.417986:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.417994:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 10 pid: 8429 timeout: 888 lvb_type: 1 00000100:00100000:2.0:1746065189.418002:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260377856:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.418022:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.418030:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 36 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.418036:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260377984:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.418061:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.418077:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14712 00000100:00100000:2.0:1746065189.418083:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263128960:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065189.418101:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.418111:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065189.418549:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14713 00000100:00100000:0.0:1746065189.418556:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263129216:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065189.418572:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.418581:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.418592:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 36 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.418599:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.418605:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746065189.418606:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746065189.418608:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.418624:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.418632:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065189.418640:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260378112:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065189.418671:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 36 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.418678:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 36 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065189.418685:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260378240:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.418703:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065189.418706:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.418710:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065189.418713:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.418716:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.418717:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.418719:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065189.418720:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260378368:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.418731:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d2600 going to sleep for 11 seconds 00010000:00010000:2.0:1746065189.418732:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.418738:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 888 lvb_type: 1 00000100:00100000:2.0:1746065189.418745:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260378496:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.418780:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.418787:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 10 pid: 2463 timeout: 888 lvb_type: 1 00000100:00100000:2.0:1746065189.418794:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260378624:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.418832:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 30 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.418839:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 30 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.418851:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260378752:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.418870:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00010000:00010000:3.0:1746065189.419002:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.419010:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 10 pid: 2463 timeout: 888 lvb_type: 1 00000100:00100000:3.0:1746065189.419017:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260378880:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.419041:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 36 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.419048:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 36 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.419053:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260379008:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.419068:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065189.419125:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.426074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.426088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.426264:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260377088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.426275:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260377856:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.426282:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260377984:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.426320:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.426426:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260377216:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.426435:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260377600:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.426445:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260377728:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.426509:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.426540:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129600 00000100:00100000:2.0:1746065189.426545:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129600 00000100:00100000:0.0:1746065189.426550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.426564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065189.426571:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 11 pid: 8429 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746065189.426577:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.426902:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260378112:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.426927:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260378368:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.427004:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260378496:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.427010:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260378624:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.427016:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260378752:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.427031:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.427044:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129728 00000100:00100000:2.0:1746065189.427047:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129728 00010000:00010000:2.0:1746065189.427058:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 37 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.427064:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260377472:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.427070:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260378880:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.427071:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129472 00000100:00100000:2.0:1746065189.427073:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129472 00000100:00100000:3.0:1746065189.427076:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260379008:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.427080:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 11 pid: 25185 timeout: 888 lvb_type: 1 00000100:00100000:2.0:1746065189.427086:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129984 00010000:00010000:3.0:1746065189.427088:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.427088:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129984 00010000:00010000:2.0:1746065189.427094:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 33 pid: 2463 timeout: 888 lvb_type: 1 00000100:00100000:2.0:1746065189.427101:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263129856 00000100:00100000:2.0:1746065189.427102:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263129856 00000100:00100000:3.0:1746065189.427107:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7542 00010000:00010000:2.0:1746065189.427108:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.427112:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263129600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065189.427117:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7543 00000100:00100000:2.0:1746065189.427120:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263129728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.427126:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.427126:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.427143:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 11 pid: 8429 timeout: 888 lvb_type: 1 00010000:00010000:2.0:1746065189.427143:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 37 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.427151:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 37 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.427158:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 11 pid: 8429 timeout: 888 lvb_type: 1 00000100:00100000:1.0:1746065189.427197:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7544 00000100:00100000:1.0:1746065189.427207:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7545 00000100:00100000:1.0:1746065189.427213:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263129984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.427220:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.427232:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 33 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.427240:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 33 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.427258:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801355a2000/0x14b4f8542d4fd0e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60cb4 expref: 33 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.427273:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.427305:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263129984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.427311:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7545 00000100:00100000:1.0:1746065189.427326:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7546 00000100:00100000:1.0:1746065189.427331:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881263129856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.427337:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.427343:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.429053:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800908d1600/0x14b4f8542d4fd2be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dcc expref: 37 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.429073:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.429103:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263129728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1981us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.429109:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7543 00010000:00010000:3.0:1746065189.429177:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93000/0x14b4f8542d4fd3eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ea5 expref: 11 pid: 8429 timeout: 888 lvb_type: 1 00010000:00010000:3.0:1746065189.429197:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.429217:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263129600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2104us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.429222:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7542 00010000:00010000:1.0:1746065189.429400:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.429412:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdcb200/0x14b4f8542d4fd0a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c91 expref: 31 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.429421:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.429439:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881263129856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2108us (2862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.429445:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7546 00000100:00100000:1.0:1746065189.429468:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263129472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.429478:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.429494:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 11 pid: 25185 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.429502:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 11 pid: 25185 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.429512:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29600/0x14b4f8542d4fd3d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e97 expref: 11 pid: 25185 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.429520:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.429521:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.429525:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.429535:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.429551:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.429564:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881263129472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2361us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.429569:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7544 00010000:00010000:2.0:1746065189.429881:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.429890:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.429906:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.429912:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.429919:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.429924:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009373fe00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065189.429927:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.429934:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.429946:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.429951:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009373fe00/0x14b4f8542d4fd431 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.429998:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263128832:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 12723us (12894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.430004:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14708 00000100:00100000:0.0:1746065189.433132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.433771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.434023:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260378240:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065189.434050:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.434126:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130368 00000100:00100000:2.0:1746065189.434132:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130368 00002000:00100000:2.0:1746065189.434168:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2371584->2609151) req@ffff88012b45d180 x1830881263130368/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.434177:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d180 with x1830881263130368 ext(2371584->2609151) 00010000:00010000:2.0:1746065189.434183:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 32 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.434194:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 32 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:2.0:1746065189.434200:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45d180 00000100:00100000:1.0:1746065189.434246:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130496 00000100:00100000:1.0:1746065189.434250:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130496 00010000:00010000:1.0:1746065189.434267:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 888 lvb_type: 1 00000100:00100000:1.0:1746065189.434292:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7547 00000100:00100000:1.0:1746065189.434298:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263130496:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.434309:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.434327:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.434335:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.434357:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c812200/0x14b4f8542d4fd2b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dbe expref: 32 pid: 8429 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.434370:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.434402:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263130496:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.434407:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7547 00000100:00100000:0.0:1746065189.434549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.434562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.434572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.434585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.434699:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130240 00000100:00100000:1.0:1746065189.434703:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130240 00010000:00010000:1.0:1746065189.434714:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 33 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.434909:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7548 00000100:00100000:1.0:1746065189.434915:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263130240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.434923:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.434935:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 33 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.434943:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 33 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.434955:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a62e600/0x14b4f8542d4fd382 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e58 expref: 33 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.434964:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.434982:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881263130240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.434986:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7548 00000100:00100000:1.0:1746065189.434995:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130752 00000100:00100000:1.0:1746065189.434997:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130752 00010000:00010000:1.0:1746065189.435005:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 30 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:0.0:1746065189.435120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.435171:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263131264 00000100:00100000:2.0:1746065189.435174:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263131264 00002000:00100000:2.0:1746065189.435190:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2977792->3145727) req@ffff88012b45f480 x1830881263131264/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.435202:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f480 with x1830881263131264 ext(2977792->3145727) 00010000:00010000:2.0:1746065189.435208:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:2.0:1746065189.435215:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00002000:00010000:2.0:1746065189.435220:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b45f480 00000100:00100000:2.0:1746065189.435233:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2524 00000100:00100000:2.0:1746065189.435237:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263130368:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065189.435463:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2525 00000100:00100000:2.0:1746065189.435469:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263131264:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065189.436046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.436113:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263131008 00000100:00100000:1.0:1746065189.436117:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263131008 00010000:00010000:1.0:1746065189.436130:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 33 pid: 8429 timeout: 888 lvb_type: 1 00000100:00100000:1.0:1746065189.436145:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130112 00000100:00100000:1.0:1746065189.436147:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130112 00010000:00010000:1.0:1746065189.436154:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 34 pid: 25185 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.436162:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7549 00000100:00100000:1.0:1746065189.436169:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881263130752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.436176:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.436189:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 32 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.436197:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 32 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.436210:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800908d1200/0x14b4f8542d4fd263 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60da9 expref: 32 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.436219:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.436232:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263130752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 65us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.436236:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7549 00000100:00100000:1.0:1746065189.436246:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7550 00000100:00100000:1.0:1746065189.436249:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263131008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.436254:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.436262:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 34 pid: 8429 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.436268:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 34 pid: 8429 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.436277:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fd0b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c9f expref: 34 pid: 8429 timeout: 888 lvb_type: 1 00010000:00010000:1.0:1746065189.436284:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.436293:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263131008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 43us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.436297:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7550 00000100:00100000:1.0:1746065189.436304:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7551 00000100:00100000:1.0:1746065189.436307:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881263130112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.436311:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.436317:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 32 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.436324:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 32 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.436332:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f74de00/0x14b4f8542d4fd2c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60dd3 expref: 32 pid: 25185 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.436339:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.436341:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.436345:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.436351:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.436369:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.436378:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881263130112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.436382:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7551 00000100:00100000:1.0:1746065189.436425:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260377344:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065189.436436:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.436501:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130624 00000100:00100000:3.0:1746065189.436505:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130624 00010000:00010000:3.0:1746065189.436517:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 9 pid: 2463 timeout: 888 lvb_type: 1 00000100:00100000:0.0:1746065189.436524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.436528:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263130880 00000100:00100000:3.0:1746065189.436529:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263130880 00010000:00010000:3.0:1746065189.436537:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 10 pid: 2463 timeout: 888 lvb_type: 1 00000100:00100000:3.0:1746065189.436546:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7552 00000100:00100000:3.0:1746065189.436551:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263130624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.436556:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.436564:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 9 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:3.0:1746065189.436570:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 9 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:3.0:1746065189.436580:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe92200/0x14b4f8542d4fd3dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e9e expref: 9 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:3.0:1746065189.436587:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.436588:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.436590:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436595:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436610:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.436625:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263130624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.436629:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7552 00000100:00100000:3.0:1746065189.436638:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7553 00000100:00100000:3.0:1746065189.436641:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263130880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.436647:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.436653:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 10 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:3.0:1746065189.436659:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 10 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:3.0:1746065189.436669:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe92c00/0x14b4f8542d4fd3cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e90 expref: 10 pid: 2463 timeout: 888 lvb_type: 1 00010000:00010000:3.0:1746065189.436676:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.436688:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263130880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.436693:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7553 00010000:00010000:3.0:1746065189.436713:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436719:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436739:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436755:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436761:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436766:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe93200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065189.436769:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436776:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436784:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.436789:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93200/0x14b4f8542d4fd42a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.436838:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263129088:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 19557us (19700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.436844:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14709 00000100:00100000:0.0:1746065189.437121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.437170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.437286:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263131392 00000100:00100000:3.0:1746065189.437289:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263131392 00010000:00010000:3.0:1746065189.437303:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 36 pid: 2463 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.437318:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7554 00000100:00100000:3.0:1746065189.437323:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263131392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.437328:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.437336:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 36 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.437344:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 36 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.437354:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdca800/0x14b4f8542d4fd095 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c83 expref: 36 pid: 2463 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.437362:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.437363:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.437365:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437371:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437383:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.437398:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263131392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.437403:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7554 00010000:00010000:3.0:1746065189.437419:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437425:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437438:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437445:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437451:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437456:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec29800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065189.437458:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437464:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437472:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.437477:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd43f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.437510:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263128704:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 20073us (20317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.437515:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14711 00000100:00100000:3.0:1746065189.437529:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263131136 00000100:00100000:3.0:1746065189.437532:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263131136 00002000:00100000:3.0:1746065189.437548:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3670015) req@ffff88012b45d880 x1830881263131136/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.437556:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881263131136 ext(3145728->3670015) 00010000:00010000:3.0:1746065189.437561:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 35 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.437569:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 35 pid: 21998 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065189.437574:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45d880 00000100:00100000:3.0:1746065189.437586:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2526 00000100:00100000:3.0:1746065189.437590:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263131136:12345-192.168.202.46@tcp:4:cat.0 00010000:00010000:2.0:1746065189.437835:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.437843:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.437856:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.437861:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.437866:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.437872:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc82200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065189.437874:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.437879:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.437887:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.437892:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc82200/0x14b4f8542d4fd446 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.437932:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263128960:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 19850us (20724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.437938:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14712 00000100:00100000:3.0:1746065189.446864:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263130368:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11613us (13730us total) trans 21474840899 rc 0/0 00000100:00100000:3.0:1746065189.446878:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2524 00002000:00100000:3.0:1746065189.446892:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2371584->2609151) req@ffff88012b45d180 x1830881263130368/t21474840899(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.446902:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d180 with x1830881263130368 ext(2371584->2609151) 00010000:00010000:3.0:1746065189.446916:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.446928:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065189.446934:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45d180 00000100:00100000:0.0:1746065189.447775:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263131264:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12301us (13183us total) trans 17179873622 rc 0/0 00000100:00100000:0.0:1746065189.447784:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2525 00002000:00100000:0.0:1746065189.447792:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2977792->3145727) req@ffff88012b45f480 x1830881263131264/t17179873622(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.447799:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45f480 with x1830881263131264 ext(2977792->3145727) 00010000:00010000:0.0:1746065189.447807:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.447860:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00002000:00010000:0.0:1746065189.447868:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b45f480 00000100:00100000:0.0:1746065189.454227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.455497:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263131136:12345-192.168.202.46@tcp:4:cat.0 Request processed in 17899us (18369us total) trans 21474840900 rc 0/0 00000100:00100000:3.0:1746065189.455508:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2526 00002000:00100000:3.0:1746065189.455517:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3670015) req@ffff88012b45d880 x1830881263131136/t21474840900(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.455526:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d880 with x1830881263131136 ext(3145728->3670015) 00010000:00010000:3.0:1746065189.455534:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.455545:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 888 lvb_type: 0 00002000:00010000:3.0:1746065189.455550:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b45d880 00000100:00100000:0.0:1746065189.455792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.456112:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263131520 00000100:00100000:1.0:1746065189.456120:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263131520 00010000:00010000:1.0:1746065189.456145:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.456165:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263131648 00000100:00100000:1.0:1746065189.456166:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263131648 00010000:00010000:1.0:1746065189.456174:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.456187:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7555 00000100:00100000:1.0:1746065189.456194:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263131520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.456210:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.456230:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.456239:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.456262:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe92800/0x14b4f8542d4fd390 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2977792->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e66 expref: 31 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.456281:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.456283:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.456287:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456295:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065189.456326:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7556 00000100:00100000:0.0:1746065189.456332:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263131648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065189.456341:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065189.456352:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.456367:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:0.0:1746065189.456382:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe93c00/0x14b4f8542d4fd374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2371584->2621439] (req 2371584->2609151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e4a expref: 31 pid: 9716 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.456481:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065189.456494:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.456505:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263131520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 311us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.456512:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7555 00000100:00100000:0.0:1746065189.456512:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1959:x1830881263131648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 181us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.456520:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7556 00010000:00010000:1.0:1746065189.456531:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456539:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456563:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456570:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456576:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456588:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a62e000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065189.456592:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456600:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456611:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.456616:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a62e000/0x14b4f8542d4fd438 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065189.456670:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263129344:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 39238us (39502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.456677:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14710 00000100:00100000:0.0:1746065189.460086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.460288:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263131776 00000100:00100000:3.0:1746065189.460298:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263131776 00010000:00010000:3.0:1746065189.460338:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.460366:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7557 00000100:00100000:3.0:1746065189.460374:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263131776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.460392:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.460417:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.460430:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.460461:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe92e00/0x14b4f8542d4fd3a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4718591] (req 3145728->3670015) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60e7b expref: 37 pid: 21998 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.461441:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.461445:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.461451:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.461460:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.461489:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.461543:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881263131776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1170us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.461550:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7557 00010000:00010000:0.0:1746065189.461622:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.461632:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.461660:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.461670:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.461677:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.461689:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009373e000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065189.461694:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.461701:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.461713:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.461718:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009373e000/0x14b4f8542d4fd44d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065189.461797:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263129216:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 43241us (44567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.461805:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14713 00000100:00100000:0.0:1746065189.467962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.468080:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132032 00000100:00100000:3.0:1746065189.468088:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132032 00000100:00100000:3.0:1746065189.468443:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9991 00000100:00100000:3.0:1746065189.468451:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31872:x1830881263132032:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:3.0:1746065189.468496:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.468523:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd423 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ec8 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.468540:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.468545:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065189.468574:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.468585:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 265 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.468592:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 265 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.468597:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 25 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.468603:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 265 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.468609:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 25 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.468615:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.468645:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 25 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.468657:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 25 pid: 14643 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.468670:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379136:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.469375:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 265 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.469384:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 265 pid: 14643 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.469392:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379264:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.469421:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 25 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.469428:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 25 pid: 14643 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.469434:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379392:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.469452:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 265 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.469459:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 265 pid: 14644 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.469466:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379520:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.469483:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 265 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.469495:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 265 pid: 16767 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.469501:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379648:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.469518:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a23c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.474220:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.474250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.474268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.474283:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.474342:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.475898:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379136:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.475911:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379264:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.475919:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379392:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065189.475926:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132288 00000100:00100000:3.0:1746065189.475927:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379520:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.475934:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260379648:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065189.475937:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132288 00010000:00010000:3.0:1746065189.475961:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.475975:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 266 pid: 14643 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.476008:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132544 00000100:00100000:1.0:1746065189.476010:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132544 00010000:00010000:1.0:1746065189.476018:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 267 pid: 14644 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.476026:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132160 00000100:00100000:1.0:1746065189.476028:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132160 00010000:00010000:1.0:1746065189.476038:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 26 pid: 14643 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.476045:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132416 00000100:00100000:1.0:1746065189.476047:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132416 00010000:00010000:1.0:1746065189.476054:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 27 pid: 14643 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.476061:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132672 00000100:00100000:1.0:1746065189.476062:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132672 00010000:00010000:1.0:1746065189.476069:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 268 pid: 16767 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.476079:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7558 00000100:00100000:1.0:1746065189.476085:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5beec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:1958:x1830881263132288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.476098:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.476105:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 268 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476122:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 268 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476144:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50bb200/0x14b4f8542d4fcfc3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c28 expref: 268 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476163:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065189.476167:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.476174:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.476211:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5beec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1958:x1830881263132288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 126us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.476216:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7558 00000100:00100000:1.0:1746065189.476251:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7559 00000100:00100000:1.0:1746065189.476255:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:1958:x1830881263132544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.476260:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.476263:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 266 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476270:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 266 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476279:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54200/0x14b4f8542d4fcf3e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb8 expref: 266 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476288:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065189.476291:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.476296:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.476305:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1958:x1830881263132544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.476310:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7559 00000100:00100000:1.0:1746065189.476317:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7560 00000100:00100000:1.0:1746065189.476321:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881263132160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.476325:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.476328:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 27 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476336:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 27 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476345:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdcba00/0x14b4f8542d4fcfe6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60c2f expref: 27 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476351:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065189.476354:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.476359:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.476367:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263132160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.476372:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7560 00000100:00100000:1.0:1746065189.476378:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7561 00000100:00100000:1.0:1746065189.476382:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263132416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.476387:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.476390:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 25 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476397:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 25 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476404:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129b54a00/0x14b4f8542d4fcf45 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bbf expref: 25 pid: 14643 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476410:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065189.476412:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.476416:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.476425:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881263132416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 42us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.476429:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7561 00000100:00100000:1.0:1746065189.476435:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7562 00000100:00100000:1.0:1746065189.476439:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1958:x1830881263132672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.476443:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065189.476446:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 264 pid: 16767 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476453:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 264 pid: 16767 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476461:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c765c00/0x14b4f8542d4fcf37 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60bb1 expref: 264 pid: 16767 timeout: 888 lvb_type: 0 00010000:00010000:1.0:1746065189.476468:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065189.476470:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.476476:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.476481:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065189.476497:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065189.476506:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1958:x1830881263132672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.476510:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7562 00010000:00010000:3.0:1746065189.476527:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.476535:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000040:00080000:3.0:1746065189.477153:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3074, 88 off259936 00000004:00080000:3.0:1746065189.477161:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768344809ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477212:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3102, 88 off262584 00000004:00080000:3.0:1746065189.477217:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788768401256ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065189.477227:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3103, 88 off262672 00000004:00080000:3.0:1746065189.477229:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788768413748ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065189.477236:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3075, 88 off260024 00000004:00080000:3.0:1746065189.477238:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768423064ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477244:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3076, 88 off260112 00000004:00080000:3.0:1746065189.477247:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768431596ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477253:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3104, 88 off262760 00000004:00080000:3.0:1746065189.477255:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788768439979ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065189.477261:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3105, 88 off262848 00000004:00080000:3.0:1746065189.477264:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788768448338ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065189.477269:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3106, 88 off262936 00000004:00080000:3.0:1746065189.477271:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788768456173ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065189.477277:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3077, 88 off260200 00000004:00080000:3.0:1746065189.477279:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768463382ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477284:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3107, 88 off263024 00000004:00080000:3.0:1746065189.477286:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788768471094ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065189.477291:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3078, 88 off260288 00000004:00080000:3.0:1746065189.477293:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768477932ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477298:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3108, 88 off263112 00000004:00080000:3.0:1746065189.477301:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788768485811ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065189.477307:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3079, 88 off260376 00000004:00080000:3.0:1746065189.477310:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768494429ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477316:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3080, 88 off260464 00000004:00080000:3.0:1746065189.477318:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768502876ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477325:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3081, 88 off260552 00000004:00080000:3.0:1746065189.477327:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768511886ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477333:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3082, 88 off260640 00000004:00080000:3.0:1746065189.477335:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788768520131ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065189.477341:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3109, 88 off263200 00000004:00080000:3.0:1746065189.477344:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 788768529091ns, next at 737095943431ns, rc = 0 00000001:00080000:0.0:1746065189.504012:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944239 is committed 00000001:00080000:0.0:1746065189.504026:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944238 is committed 00000001:00080000:0.0:1746065189.504037:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944240 is committed 00000001:00080000:0.0:1746065189.504059:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944243 is committed 00000004:00080000:0.0:1746065189.504064:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2390 committed 00000004:00080000:0.0:1746065189.504070:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2363 committed 00000004:00080000:0.0:1746065189.504076:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2362 committed 00000004:00080000:0.0:1746065189.504077:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2361 committed 00000004:00080000:0.0:1746065189.504079:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2360 committed 00000004:00080000:0.0:1746065189.504080:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2389 committed 00000004:00080000:0.0:1746065189.504082:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2359 committed 00000004:00080000:0.0:1746065189.504083:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2388 committed 00000004:00080000:0.0:1746065189.504084:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2358 committed 00000004:00080000:0.0:1746065189.504086:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2387 committed 00000004:00080000:0.0:1746065189.504087:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2386 committed 00000004:00080000:0.0:1746065189.504089:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2385 committed 00000004:00080000:0.0:1746065189.504090:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2357 committed 00000004:00080000:0.0:1746065189.504091:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2356 committed 00000004:00080000:0.0:1746065189.504093:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2384 committed 00000004:00080000:0.0:1746065189.504094:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2383 committed 00000004:00080000:0.0:1746065189.504095:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2355 committed 00000004:00010000:2.0:1746065189.504451:0:14643:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b45dc00 reply state ffff8800a52ea400 transno 8589944243 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:2.0:1746065189.504463:0:14643:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746065189.504571:0:14643:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065189.504586:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31872:x1830881263132032:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 36132us (36628us total) trans 8589944243 rc 0/0 00000100:00100000:2.0:1746065189.504594:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9991 00000100:00100000:3.0:1746065189.504895:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260379904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.504949:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.504997:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260380416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505011:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505021:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260380928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505034:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505045:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260381440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505059:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505073:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1746065189.505077:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260379776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505088:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505097:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260380288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505106:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505115:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260380800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505125:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505134:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260381312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505145:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505163:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260380160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505178:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505188:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260380672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505198:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505206:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260381184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505217:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505227:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260381696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505238:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505248:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1746065189.505252:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260380032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505263:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505269:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260380544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505281:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505287:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260381056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505297:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.505303:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260381568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505314:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065189.505331:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.505339:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.505345:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.505350:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec28600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065189.505353:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.505360:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.505372:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.505374:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065189.505378:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065189.505383:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28600/0x14b4f8542d4fd454 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065189.505399:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260379904 00000100:00100000:3.0:1746065189.505404:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260379904 00000100:00100000:3.0:1746065189.505429:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260380416 00000100:00100000:3.0:1746065189.505431:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260380416 00000100:00100000:3.0:1746065189.505437:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260380928 00000100:00100000:3.0:1746065189.505439:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260380928 00000100:00100000:3.0:1746065189.505447:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260381440 00000100:00100000:3.0:1746065189.505449:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260381440 00000100:00100000:3.0:1746065189.505453:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260379776 00000100:00100000:3.0:1746065189.505455:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260379776 00000100:00100000:3.0:1746065189.505460:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260380288 00000100:00100000:3.0:1746065189.505461:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260380288 00000100:00100000:3.0:1746065189.505466:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260380800 00000100:00100000:3.0:1746065189.505468:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260380800 00000100:00100000:3.0:1746065189.505472:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260381312 00000100:00100000:3.0:1746065189.505474:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260381312 00000100:00100000:3.0:1746065189.505478:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260380160 00000100:00100000:3.0:1746065189.505480:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260380160 00000100:00100000:3.0:1746065189.505485:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260380672 00000100:00100000:3.0:1746065189.505486:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260380672 00000100:00100000:3.0:1746065189.505491:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260381184 00000100:00100000:3.0:1746065189.505492:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260381184 00000100:00100000:3.0:1746065189.505496:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260381696 00000100:00100000:3.0:1746065189.505498:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260381696 00000100:00100000:3.0:1746065189.505503:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260380032 00000100:00100000:3.0:1746065189.505504:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260380032 00000100:00100000:3.0:1746065189.505509:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260380544 00000100:00100000:3.0:1746065189.505511:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260380544 00000100:00100000:3.0:1746065189.505516:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260381056 00000100:00100000:3.0:1746065189.505517:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260381056 00000100:00100000:3.0:1746065189.505522:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260381568 00000100:00100000:3.0:1746065189.505524:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260381568 00000100:00100000:3.0:1746065189.505531:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14714 00000100:00100000:3.0:1746065189.505536:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881260379904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505719:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3298:x1830881260379904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (770us total) trans 17179873623 rc 0/0 00000100:00100000:3.0:1746065189.505724:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14714 00000100:00100000:3.0:1746065189.505734:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14715 00000100:00100000:3.0:1746065189.505738:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881260380416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.505844:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3298:x1830881260380416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (832us total) trans 17179873624 rc 0/0 00000100:00100000:3.0:1746065189.505849:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14715 00000100:00100000:3.0:1746065189.505857:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14716 00000100:00100000:3.0:1746065189.505862:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881260380928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.505951:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881260380928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (914us total) trans 21474840901 rc 0/0 00000100:00100000:3.0:1746065189.505955:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14716 00000100:00100000:3.0:1746065189.505963:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14717 00000100:00100000:3.0:1746065189.505967:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881260381440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.506029:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881260381440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (968us total) trans 21474840902 rc 0/0 00000100:00100000:3.0:1746065189.506033:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14717 00000100:00100000:3.0:1746065189.506129:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14718 00000100:00100000:3.0:1746065189.506134:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881260379776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.506206:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3298:x1830881260379776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1116us total) trans 17179873625 rc 0/0 00000100:00100000:3.0:1746065189.506211:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14718 00000100:00100000:3.0:1746065189.506219:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14719 00000100:00100000:3.0:1746065189.506223:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881260380288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065189.506275:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506278:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506280:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506282:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506283:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065189.506299:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3298:x1830881260380288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (1191us total) trans 17179873626 rc 0/0 00000100:00100000:3.0:1746065189.506304:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14719 00000100:00100000:3.0:1746065189.506312:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14720 00000100:00100000:3.0:1746065189.506316:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881260380800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.506386:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881260380800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1260us total) trans 21474840903 rc 0/0 00000100:00100000:3.0:1746065189.506391:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14720 00000100:00100000:3.0:1746065189.506399:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14721 00000100:00100000:3.0:1746065189.506402:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3298:x1830881260381312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.506461:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881260381312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1314us total) trans 21474840904 rc 0/0 00000100:00100000:3.0:1746065189.506465:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14721 00000100:00100000:3.0:1746065189.506472:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14722 00000100:00100000:3.0:1746065189.506476:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3296:x1830881260380160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065189.506527:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506530:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065189.506532:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065189.506534:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065189.506535:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065189.506555:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3296:x1830881260380160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (1376us total) trans 17179873627 rc 0/0 00000100:00100000:3.0:1746065189.506559:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14722 00000100:00100000:3.0:1746065189.506567:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14723 00000100:00100000:3.0:1746065189.506571:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3296:x1830881260380672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.506631:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3296:x1830881260380672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1432us total) trans 17179873628 rc 0/0 00000100:00100000:3.0:1746065189.506636:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14723 00000100:00100000:3.0:1746065189.506643:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14724 00000100:00100000:3.0:1746065189.506648:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3296:x1830881260381184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065189.506696:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506697:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506699:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506701:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.506702:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065189.506717:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881260381184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1498us total) trans 21474840905 rc 0/0 00000100:00100000:3.0:1746065189.506720:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14724 00000100:00100000:3.0:1746065189.506729:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14725 00000100:00100000:3.0:1746065189.506733:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3296:x1830881260381696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.506834:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881260381696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (1594us total) trans 21474840906 rc 0/0 00000100:00100000:3.0:1746065189.506841:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14725 00000100:00100000:3.0:1746065189.506850:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14726 00000100:00100000:3.0:1746065189.506854:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3296:x1830881260380032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.506922:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3296:x1830881260380032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1657us total) trans 17179873629 rc 0/0 00000100:00100000:3.0:1746065189.506927:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14726 00000100:00100000:3.0:1746065189.506935:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14727 00000100:00100000:3.0:1746065189.506939:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3296:x1830881260380544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065189.507002:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3296:x1830881260380544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1719us total) trans 17179873630 rc 0/0 00000100:00100000:3.0:1746065189.507006:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14727 00000100:00100000:3.0:1746065189.507014:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14728 00000100:00100000:3.0:1746065189.507018:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3296:x1830881260381056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.507085:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881260381056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1787us total) trans 21474840907 rc 0/0 00000100:00100000:3.0:1746065189.507089:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14728 00000100:00100000:3.0:1746065189.507099:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14729 00000100:00100000:3.0:1746065189.507103:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3296:x1830881260381568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065189.507155:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065189.507157:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.507158:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.507160:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065189.507161:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065189.507176:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3296:x1830881260381568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1861us total) trans 21474840908 rc 0/0 00000100:00100000:3.0:1746065189.507180:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14729 00000004:00080000:3.0:1746065189.507219:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0c000/2, rc 0, transno 17179873629 00000100:00100000:3.0:1746065189.507224:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260380032:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.507230:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0ea00/2, rc 0, transno 17179873630 00000100:00100000:3.0:1746065189.507233:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260380544:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.507239:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06680/2, rc 0, transno 21474840907 00000100:00100000:3.0:1746065189.507246:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260381056:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.507251:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdce00/2, rc 0, transno 21474840908 00000100:00100000:3.0:1746065189.507253:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260381568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.507259:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0c700/2, rc 0, transno 17179873627 00000100:00100000:3.0:1746065189.507261:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260380160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.507266:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0ce00/2, rc 0, transno 17179873628 00000100:00100000:3.0:1746065189.507268:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260380672:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.507273:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdea00/2, rc 0, transno 21474840905 00000100:00100000:3.0:1746065189.507275:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260381184:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.507279:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdd500/2, rc 0, transno 21474840906 00000100:00100000:3.0:1746065189.507281:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260381696:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.507328:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0e680/2, rc 0, transno 17179873625 00000100:00100000:3.0:1746065189.507331:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260379776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.507336:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0f800/2, rc 0, transno 17179873626 00000100:00100000:3.0:1746065189.507339:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260380288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.507344:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7af100/2, rc 0, transno 21474840903 00000100:00100000:3.0:1746065189.507347:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260380800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.507351:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdc700/2, rc 0, transno 21474840904 00000100:00100000:3.0:1746065189.507353:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260381312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.507360:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0dc00/2, rc 0, transno 17179873623 00000100:00100000:3.0:1746065189.507362:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260379904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.507368:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0fb80/2, rc 0, transno 17179873624 00000100:00100000:3.0:1746065189.507370:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260380416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.507376:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094092680/2, rc 0, transno 21474840901 00000100:00100000:3.0:1746065189.507378:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260380928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.507383:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdf800/2, rc 0, transno 21474840902 00000100:00100000:3.0:1746065189.507385:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260381440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.507390:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065189.507396:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260381824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.507414:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.507434:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260381824 00000100:00100000:3.0:1746065189.507438:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260381824 00000100:00100000:3.0:1746065189.507453:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14730 00000100:00100000:3.0:1746065189.507458:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881260381824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.507523:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3298:x1830881260381824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (108us total) trans 21474840909 rc 0/0 00000100:00100000:3.0:1746065189.507528:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14730 00000004:00080000:3.0:1746065189.507543:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee2d80/2, rc 0, transno 21474840909 00000100:00100000:3.0:1746065189.507545:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260381824:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746065189.507632:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065189.507636:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065189.508244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.508379:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132800 00000100:00100000:2.0:1746065189.508383:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132800 00000100:00100000:2.0:1746065189.508404:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9992 00000100:00100000:2.0:1746065189.508409:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31872:x1830881263132800:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065189.508423:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.508436:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ecf expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.508475:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.508485:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.508501:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.508503:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065189.508506:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc83800, rc 0) 00000100:00100000:2.0:1746065189.508541:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31872:x1830881263132800:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 131us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.508546:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9992 00000100:00100000:0.0:1746065189.514115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.514449:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263132928 00000100:00100000:2.0:1746065189.514457:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263132928 00000100:00100000:3.0:1746065189.516037:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 774 00000100:00100000:3.0:1746065189.516050:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31872:x1830881263132928:12345-192.168.202.46@tcp:103:mirror_io.0 00010000:00010000:3.0:1746065189.516064:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.516089:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd415 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ec1 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.516106:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.516109:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.516283:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31872:x1830881263132928:12345-192.168.202.46@tcp:103:mirror_io.0 Request processed in 236us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.516289:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 774 00000100:00100000:0.0:1746065189.519104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.519302:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263133184 00000100:00100000:2.0:1746065189.519311:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263133184 00000100:00100000:2.0:1746065189.519389:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4284 00000100:00100000:2.0:1746065189.519396:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31872:x1830881263133184:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065189.520020:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31872:x1830881263133184:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 622us (923us total) trans 8589944244 rc 0/0 00000100:00100000:2.0:1746065189.520027:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4284 00000100:00100000:0.0:1746065189.525353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.526026:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263133440 00000100:00100000:2.0:1746065189.526035:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263133440 00000100:00100000:2.0:1746065189.526090:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4285 00000100:00100000:2.0:1746065189.526097:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b51f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31872:x1830881263133440:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065189.526293:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b51f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31872:x1830881263133440:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 195us (945us total) trans 8589944245 rc 0/0 00000100:00100000:2.0:1746065189.526299:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4285 00000100:00100000:0.0:1746065189.535971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.536040:0:14642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263133568 00000100:00100000:1.0:1746065189.536048:0:14642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263133568 00000100:00100000:1.0:1746065189.536094:0:14642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 223 00000100:00100000:1.0:1746065189.536101:0:14642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edf50a1e-6d84-485b-9392-04c729e87e94+15:1961:x1830881263133568:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:1.0:1746065189.536151:0:14642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edf50a1e-6d84-485b-9392-04c729e87e94+15:1961:x1830881263133568:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.536157:0:14642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 223 00000100:00100000:0.0:1746065189.556019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.556124:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263133824 00000100:00100000:2.0:1746065189.556133:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263133824 00000100:00100000:2.0:1746065189.556169:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9993 00000100:00100000:2.0:1746065189.556176:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:31878:x1830881263133824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.556197:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.556212:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83a00/0x14b4f8542d4fd462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ed6 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.556302:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556312:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556321:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556332:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556337:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556341:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556449:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556456:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556461:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065189.556468:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065189.556530:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556536:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556540:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556544:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc82200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065189.556547:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556552:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556560:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065189.556562:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065189.556566:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.556570:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc82200/0x14b4f8542d4fd469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.558867:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.558879:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.558885:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.558889:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc83c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065189.558897:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.558903:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.558915:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012cf55800) 00010000:00010000:2.0:1746065189.558917:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065189.558920:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.558924:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd470 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.558986:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83a00/0x14b4f8542d4fd462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.558999:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.559005:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.559007:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065189.559009:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc83600, rc 0) 00000100:00100000:2.0:1746065189.559068:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31878:x1830881263133824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2891us (3056us total) trans 8589944246 rc 0/0 00000100:00100000:2.0:1746065189.559075:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9993 00000100:00100000:1.0:1746065189.566646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.566685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.566715:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.566728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.566756:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263133952 00000100:00100000:1.0:1746065189.566756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.566764:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263133952 00000100:00100000:1.0:1746065189.566781:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.566797:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263134208 00000100:00100000:1.0:1746065189.566797:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263134464 00000100:00100000:3.0:1746065189.566798:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263134208 00000100:00100000:1.0:1746065189.566801:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263134464 00000100:00100000:3.0:1746065189.566812:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263134080 00000100:00100000:3.0:1746065189.566829:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263134080 00000100:00100000:1.0:1746065189.566834:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263134336 00000100:00100000:1.0:1746065189.566836:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263134336 00000100:00100000:3.0:1746065189.566842:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263134592 00000100:00100000:3.0:1746065189.566844:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263134592 00000100:00100000:1.0:1746065189.566853:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14731 00000100:00100000:3.0:1746065189.566858:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14732 00000100:00100000:1.0:1746065189.566859:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881263133952:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065189.566863:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263134208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.566874:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.566878:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.566889:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60eeb expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.566891:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60edd expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065189.566910:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d725, atime: 0x6812d725, ctime: 0x6812d725, blocks: 0x821 00002000:00010000:1.0:1746065189.566911:0:25185:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d725, atime: 0x6812d725, ctime: 0x6812d725, blocks: 0x7a9 00010000:00010000:3.0:1746065189.566927:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.566927:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.566929:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.566929:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.566935:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 33 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.566936:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 39 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.566948:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 33 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.566948:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 39 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.566956:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f74de00, rc 0) 00010000:00010000:1.0:1746065189.566956:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f503e00, rc 0) 00000100:00100000:1.0:1746065189.567002:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881263133952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 143us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.567008:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14731 00000100:00100000:1.0:1746065189.567023:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14733 00000100:00100000:1.0:1746065189.567027:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881263134464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.567035:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.567041:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ef9 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065189.567052:0:25185:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d726, atime: 0x6812d726, ctime: 0x6812d726, blocks: 0x168b 00010000:00010000:1.0:1746065189.567059:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.567060:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.567064:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 39 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.567072:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 39 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.567078:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f503c00, rc 0) 00000100:00100000:2.0:1746065189.567136:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14734 00000100:00100000:2.0:1746065189.567143:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263134080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.567149:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.567157:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ee4 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065189.567168:0:2462:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d725, atime: 0x6812d725, ctime: 0x6812d725, blocks: 0x821 00010000:00010000:2.0:1746065189.567175:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.567176:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.567180:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 34 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.567188:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 34 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.567193:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc82e00, rc 0) 00000100:00100000:3.0:1746065189.567404:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263134208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 540us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.567409:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14732 00000100:00100000:1.0:1746065189.567413:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881263134464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 384us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.567419:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14733 00000100:00100000:3.0:1746065189.567422:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14735 00000100:00100000:3.0:1746065189.567426:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1958:x1830881263134336:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065189.567431:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14736 00010000:00010000:3.0:1746065189.567432:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065189.567436:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263134592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.567440:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ef2 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.567442:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746065189.567450:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d725, atime: 0x6812d723, ctime: 0x6812d725, blocks: 0x821 00010000:00010000:1.0:1746065189.567451:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f00 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.567456:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.567457:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.567460:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746065189.567461:0:25185:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d726, atime: 0x6812d726, ctime: 0x6812d726, blocks: 0x1029 00010000:00010000:3.0:1746065189.567468:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 39 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.567469:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.567470:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.567474:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29200, rc 0) 00010000:00010000:1.0:1746065189.567474:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.567483:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065189.567486:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881263134336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 60us (730us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065189.567489:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f503a00, rc 0) 00000100:00100000:3.0:1746065189.567495:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14735 00000100:00100000:1.0:1746065189.567506:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263134592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 69us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.567511:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14736 00000100:00100000:2.0:1746065189.567568:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263134080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 425us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.567573:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14734 00000100:00100000:0.0:1746065189.569890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.569944:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263134848 00000100:00100000:3.0:1746065189.569951:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263134848 00000100:00100000:3.0:1746065189.569982:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9994 00000100:00100000:3.0:1746065189.569988:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+6:31883:x1830881263134848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.570005:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.570018:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd4af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f07 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.570094:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570105:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570113:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570123:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570127:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570132:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570204:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570210:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570216:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065189.570223:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065189.570296:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570302:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570307:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570312:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec29a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065189.570315:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570321:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570330:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065189.570332:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065189.570336:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570340:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29a00/0x14b4f8542d4fd4b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570363:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570367:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570375:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570379:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec29800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065189.570381:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570385:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570390:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205d00) 00010000:00010000:3.0:1746065189.570392:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065189.570394:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570398:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29800/0x14b4f8542d4fd4bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.570426:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd4af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.570435:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.570441:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.570442:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065189.570444:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec28800, rc 0) 00000100:00100000:3.0:1746065189.570481:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:31883:x1830881263134848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 493us (597us total) trans 8589944247 rc 0/0 00000100:00100000:3.0:1746065189.570486:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9994 00000100:00100000:0.0:1746065189.577963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.578603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.579129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.579158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.579526:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.579761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.579940:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263134976 00000100:00100000:3.0:1746065189.579949:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263134976 00000100:00100000:1.0:1746065189.579966:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263135104 00000100:00100000:1.0:1746065189.579971:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263135104 00000100:00100000:3.0:1746065189.579981:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263135232 00000100:00100000:3.0:1746065189.579983:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263135232 00000100:00100000:1.0:1746065189.579990:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263135360 00000100:00100000:1.0:1746065189.579991:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263135360 00000100:00100000:3.0:1746065189.579993:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263135488 00000100:00100000:3.0:1746065189.579995:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263135488 00000100:00100000:1.0:1746065189.580005:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14737 00000100:00100000:3.0:1746065189.580010:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14738 00000100:00100000:1.0:1746065189.580011:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881263134976:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065189.580015:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881263135104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.580024:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.580025:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.580036:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f15 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.580036:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f0e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.580053:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.580053:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.580055:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.580055:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.580062:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 33 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.580062:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.580074:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 33 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.580074:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.580082:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec28400, rc 0) 00010000:00010000:1.0:1746065189.580086:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f503200, rc 0) 00000100:00100000:3.0:1746065189.580122:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263135104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 106us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.580128:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14738 00000100:00100000:3.0:1746065189.580142:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14739 00000100:00100000:3.0:1746065189.580146:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881263135232:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065189.580152:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.580157:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f1c expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.580166:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.580167:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.580170:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 33 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.580177:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 33 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.580183:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29c00, rc 0) 00000100:00100000:2.0:1746065189.580223:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14740 00000100:00100000:2.0:1746065189.580230:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263135360:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.580238:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.580245:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f23 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.580254:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.580255:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.580259:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 34 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.580267:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 34 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.580273:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc83400, rc 0) 00000100:00100000:1.0:1746065189.580433:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263134976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 422us (2478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.580438:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14737 00000100:00100000:1.0:1746065189.580447:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263135616 00000100:00100000:1.0:1746065189.580450:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263135616 00000100:00100000:1.0:1746065189.580462:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14741 00000100:00100000:1.0:1746065189.580466:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+33:1961:x1830881263135488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.580471:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.580476:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f2a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.580486:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.580487:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.580490:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.580498:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.580505:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f502e00, rc 0) 00000100:00100000:1.0:1746065189.580518:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263135488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 51us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.580522:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14741 00000100:00100000:1.0:1746065189.580531:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14742 00000100:00100000:1.0:1746065189.580535:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263135616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.580540:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.580545:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f31 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.580553:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.580554:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.580557:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 35 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.580565:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 35 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.580571:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f502c00, rc 0) 00000100:00100000:1.0:1746065189.580582:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263135616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 46us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.580586:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14742 00000100:00100000:3.0:1746065189.581141:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263135232:12345-192.168.202.46@tcp:101:cat.0 Request processed in 993us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.581143:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263135360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 911us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.581147:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14739 00000100:00100000:2.0:1746065189.581150:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14740 00000100:00100000:2.0:1746065189.585022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.585050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.585071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.585091:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.585162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.585169:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263136384 00000100:00100000:3.0:1746065189.585177:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263136384 00000100:00100000:0.0:1746065189.585185:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263136256 00000100:00100000:0.0:1746065189.585188:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263136256 00002000:00100000:0.0:1746065189.585213:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800900c0e00 x1830881263136256/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.585214:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8800900c2d80 x1830881263136384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.585223:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c2d80 with x1830881263136384 ext(1048576->2097151) 00002000:00100000:0.0:1746065189.585223:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0e00 with x1830881263136256 ext(1048576->2097151) 00002000:00010000:3.0:1746065189.585227:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c2d80 00002000:00010000:0.0:1746065189.585227:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c0e00 00000100:00100000:3.0:1746065189.585438:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263136640 00000100:00100000:3.0:1746065189.585442:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263136640 00002000:00100000:3.0:1746065189.585458:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff8800900c0a80 x1830881263136640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.585464:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0a80 with x1830881263136640 ext(0->1048575) 00002000:00010000:3.0:1746065189.585467:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c0a80 00000100:00100000:3.0:1746065189.585477:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263136768 00000100:00100000:3.0:1746065189.585479:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263136768 00002000:00100000:3.0:1746065189.585489:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800900c1880 x1830881263136768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.585494:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1880 with x1830881263136768 ext(1048576->2097151) 00002000:00010000:3.0:1746065189.585497:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c1880 00000100:00100000:3.0:1746065189.585508:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8292 00000100:00100000:3.0:1746065189.585514:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263136256:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065189.585673:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8293 00000100:00100000:1.0:1746065189.585681:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263136384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.587125:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8294 00000100:00100000:3.0:1746065189.587135:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1959:x1830881263136640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.587966:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8295 00000100:00100000:0.0:1746065189.587976:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1959:x1830881263136768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.590317:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263136128 00000100:00100000:2.0:1746065189.590327:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263136128 00000100:00100000:2.0:1746065189.590384:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9995 00000100:00100000:2.0:1746065189.590391:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:31882:x1830881263136128:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.590410:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.590425:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83a00/0x14b4f8542d4fd4fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f38 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.590505:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.590517:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.590525:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.590531:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.590554:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.590564:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 9 pid: 14644 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.590574:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260381952:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.590655:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 248 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.590662:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 248 pid: 14644 timeout: 888 lvb_type: 0 00000100:00100000:2.0:1746065189.590669:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260382080:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.590685:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.601102:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.601140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.601170:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.601193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.601207:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263137152 00000100:00100000:3.0:1746065189.601216:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263137152 00000100:00100000:0.0:1746065189.601222:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263137408 00000100:00100000:0.0:1746065189.601225:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263137408 00002000:00100000:0.0:1746065189.601251:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009baa0e00 x1830881263137408/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.601252:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009baa2680 x1830881263137152/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.601260:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2680 with x1830881263137152 ext(0->1048575) 00002000:00100000:0.0:1746065189.601260:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0e00 with x1830881263137408 ext(1048576->2097151) 00002000:00010000:3.0:1746065189.601265:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2680 00002000:00010000:0.0:1746065189.601265:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0e00 00000100:00100000:3.0:1746065189.601280:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263137664 00000100:00100000:3.0:1746065189.601283:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263137664 00002000:00100000:3.0:1746065189.601293:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009baa1180 x1830881263137664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.601300:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1180 with x1830881263137664 ext(1048576->2097151) 00002000:00010000:3.0:1746065189.601302:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa1180 00000100:00100000:0.0:1746065189.601391:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263137920 00000100:00100000:0.0:1746065189.601394:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263137920 00002000:00100000:0.0:1746065189.601406:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009baa1500 x1830881263137920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.601412:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1500 with x1830881263137920 ext(1048576->2097151) 00002000:00010000:0.0:1746065189.601415:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1500 00000100:00100000:0.0:1746065189.601442:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8296 00000100:00100000:0.0:1746065189.601450:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263137152:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.601965:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8297 00000100:00100000:3.0:1746065189.601972:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263137408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.602584:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8298 00000100:00100000:0.0:1746065189.602590:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263137664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.603123:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8299 00000100:00100000:3.0:1746065189.603132:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263137920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.610450:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263136384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24763us (25428us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.610459:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8293 00002000:00100000:2.0:1746065189.610469:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff8800900c2d80 x1830881263136384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.610477:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c2d80 with x1830881263136384 ext(1048576->2097151) 00002000:00010000:2.0:1746065189.610481:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c2d80 00000100:00100000:3.0:1746065189.611272:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260381952:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.611281:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260382080:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065189.611312:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065189.617651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.617694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.618478:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263138048 00000100:00100000:3.0:1746065189.618485:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263138048 00010000:00010000:3.0:1746065189.618515:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 10 pid: 14644 timeout: 888 lvb_type: 0 00000100:00100000:1.0:1746065189.619314:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263138176 00000100:00100000:1.0:1746065189.619318:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263138176 00010000:00010000:1.0:1746065189.619334:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 249 pid: 14644 timeout: 888 lvb_type: 0 00000100:00100000:3.0:1746065189.620100:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7563 00000100:00100000:3.0:1746065189.620110:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881263138048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.620122:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.620128:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 10 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.620139:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 10 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.620157:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd4c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f07 expref: 10 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.620173:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.620177:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.620183:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.620187:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.620218:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263138048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.620224:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7563 00000100:00100000:3.0:1746065189.620237:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7564 00000100:00100000:3.0:1746065189.620242:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1958:x1830881263138176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.620247:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.620250:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 249 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.620258:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 249 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.620267:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83600/0x14b4f8542d4fd477 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ed6 expref: 249 pid: 14644 timeout: 888 lvb_type: 0 00010000:00010000:3.0:1746065189.620285:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.620288:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.620293:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.620299:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.620314:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.620329:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:1958:x1830881263138176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.620334:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7564 00000100:00100000:3.0:1746065189.621143:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1959:x1830881263136640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 34008us (36068us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.621150:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8294 00002000:00100000:3.0:1746065189.621157:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff8800900c0a80 x1830881263136640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.621166:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0a80 with x1830881263136640 ext(0->1048575) 00002000:00010000:3.0:1746065189.621170:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c0a80 00010000:00010000:3.0:1746065189.621190:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.621197:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065189.621215:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065189.621316:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83a00/0x14b4f8542d4fd4fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.621331:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.621338:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.621340:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065189.621342:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc83c00, rc 0) 00000100:00100000:3.0:1746065189.621356:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:31882:x1830881263136128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 30966us (36194us total) trans 8589944248 rc 0/0 00000100:00100000:3.0:1746065189.621361:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9995 00000100:00100000:2.0:1746065189.621600:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881263136256:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36085us (36547us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.621608:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8292 00002000:00100000:2.0:1746065189.621613:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff8800900c0e00 x1830881263136256/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.621620:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0e00 with x1830881263136256 ext(1048576->2097151) 00002000:00010000:2.0:1746065189.621623:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c0e00 00000100:00100000:1.0:1746065189.624206:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881263136768:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36223us (39105us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065189.624216:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8295 00002000:00100000:1.0:1746065189.624226:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800900c1880 x1830881263136768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.624235:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1880 with x1830881263136768 ext(1048576->2097151) 00002000:00010000:1.0:1746065189.624240:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c1880 00000100:00100000:0.0:1746065189.625035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.625227:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263138432 00000100:00100000:3.0:1746065189.625233:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263138432 00000100:00100000:3.0:1746065189.625261:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9996 00000100:00100000:3.0:1746065189.625267:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:31885:x1830881263138432:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065189.625283:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065189.625296:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f3f expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.625640:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625653:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625662:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625674:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625680:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625685:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625783:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd526 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625790:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd526 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625795:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd526 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065189.625802:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065189.625898:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625904:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625909:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625914:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec28a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065189.625917:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625922:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625931:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065189.625933:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065189.625937:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625941:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28a00/0x14b4f8542d4fd518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625951:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625956:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625960:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625967:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec28800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065189.625969:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625974:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625979:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205d00) 00010000:00010000:3.0:1746065189.625981:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065189.625983:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.625991:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec28800/0x14b4f8542d4fd51f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065189.626022:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29000/0x14b4f8542d4fd511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f3f expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.626033:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd526 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f3f expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.626039:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.626041:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065189.626043:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29e00, rc 0) 00000100:00100000:3.0:1746065189.626067:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31885:x1830881263138432:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 800us (1034us total) trans 8589944249 rc 0/0 00000100:00100000:3.0:1746065189.626072:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9996 00000100:00100000:0.0:1746065189.641986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.641987:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263137152:12345-192.168.202.46@tcp:3:cat.0 Request processed in 40530us (40887us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065189.641996:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8296 00002000:00100000:1.0:1746065189.642006:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009baa2680 x1830881263137152/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.642015:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2680 with x1830881263137152 ext(0->1048575) 00002000:00010000:1.0:1746065189.642020:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2680 00000100:00100000:2.0:1746065189.642099:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263138560 00000100:00100000:2.0:1746065189.642106:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263138560 00000100:00100000:2.0:1746065189.642151:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9997 00000100:00100000:2.0:1746065189.642157:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31878:x1830881263138560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.642170:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.642186:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421000/0x14b4f8542d4fd534 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f46 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.642232:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421000/0x14b4f8542d4fd534 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f46 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.642245:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421000/0x14b4f8542d4fd534 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f46 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.642262:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.642264:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065189.642267:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f421000, rc 0) 00000100:00100000:2.0:1746065189.642291:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31878:x1830881263138560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 135us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.642296:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9997 00000100:00100000:3.0:1746065189.652681:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263137408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 50698us (51528us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.652695:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8297 00002000:00100000:3.0:1746065189.652708:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009baa0e00 x1830881263137408/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.652718:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0e00 with x1830881263137408 ext(1048576->2097151) 00002000:00010000:3.0:1746065189.652723:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0e00 00000100:00100000:0.0:1746065189.658901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.659281:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263137664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 56689us (58108us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065189.659291:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8298 00002000:00100000:0.0:1746065189.659301:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009baa1180 x1830881263137664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.659310:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1180 with x1830881263137664 ext(1048576->2097151) 00002000:00010000:0.0:1746065189.659315:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa1180 00000100:00100000:2.0:1746065189.659594:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263138688 00000100:00100000:2.0:1746065189.659601:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263138688 00000100:00100000:2.0:1746065189.659642:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9998 00000100:00100000:2.0:1746065189.659649:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:31883:x1830881263138688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.659663:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.659678:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f4d expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.659721:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.659733:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.659758:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.659761:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065189.659764:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f420000, rc 0) 00000100:00100000:2.0:1746065189.659781:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:31883:x1830881263138688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 133us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.659787:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9998 00000100:00100000:0.0:1746065189.674232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.674264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.674289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.674313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.674345:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139072 00000100:00100000:0.0:1746065189.674353:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139072 00002000:00100000:0.0:1746065189.674387:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009baa2d80 x1830881263139072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.674396:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2d80 with x1830881263139072 ext(2097152->3145727) 00002000:00010000:0.0:1746065189.674401:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2d80 00000100:00100000:0.0:1746065189.674413:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139200 00000100:00100000:0.0:1746065189.674415:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139200 00002000:00100000:0.0:1746065189.674423:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009baa1880 x1830881263139200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.674430:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1880 with x1830881263139200 ext(3145728->4194303) 00002000:00010000:0.0:1746065189.674432:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1880 00000100:00100000:0.0:1746065189.674438:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139584 00000100:00100000:0.0:1746065189.674439:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139584 00002000:00100000:0.0:1746065189.674448:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009baa0380 x1830881263139584/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.674455:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0380 with x1830881263139584 ext(3145728->4194303) 00002000:00010000:0.0:1746065189.674457:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0380 00000100:00100000:0.0:1746065189.674463:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139456 00000100:00100000:0.0:1746065189.674464:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139456 00002000:00100000:0.0:1746065189.674471:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009baa3480 x1830881263139456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.674477:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3480 with x1830881263139456 ext(2097152->3145727) 00002000:00010000:0.0:1746065189.674479:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa3480 00000100:00100000:0.0:1746065189.674489:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8300 00000100:00100000:0.0:1746065189.674495:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1958:x1830881263139072:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.675459:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8301 00000100:00100000:0.0:1746065189.675465:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881263139200:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065189.678686:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8302 00000100:00100000:1.0:1746065189.678702:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263139584:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065189.679674:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8303 00000100:00100000:1.0:1746065189.679681:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263139456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.681055:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263137920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 77921us (79856us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.681063:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8299 00002000:00100000:3.0:1746065189.681071:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009baa1500 x1830881263137920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.681079:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1500 with x1830881263137920 ext(1048576->2097151) 00002000:00010000:3.0:1746065189.681084:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1500 00000100:00100000:2.0:1746065189.697545:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1958:x1830881263139072:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23041us (23312us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.697555:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8300 00002000:00100000:2.0:1746065189.697565:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009baa2d80 x1830881263139072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.697573:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2d80 with x1830881263139072 ext(2097152->3145727) 00002000:00010000:2.0:1746065189.697578:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2d80 00000100:00100000:2.0:1746065189.706998:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881263139200:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31521us (32721us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.707009:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8301 00002000:00100000:2.0:1746065189.707019:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009baa1880 x1830881263139200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.707027:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1880 with x1830881263139200 ext(3145728->4194303) 00002000:00010000:2.0:1746065189.707032:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa1880 00000100:00100000:1.0:1746065189.715476:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263139584:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36770us (41176us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065189.715486:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8302 00002000:00100000:1.0:1746065189.715497:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009baa0380 x1830881263139584/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.715505:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa0380 with x1830881263139584 ext(3145728->4194303) 00002000:00010000:1.0:1746065189.715509:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa0380 00000100:00100000:1.0:1746065189.723015:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263139456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 43326us (48692us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065189.723027:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8303 00002000:00100000:1.0:1746065189.723036:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009baa3480 x1830881263139456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065189.723044:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3480 with x1830881263139456 ext(2097152->3145727) 00002000:00010000:1.0:1746065189.723049:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baa3480 00000100:00100000:0.0:1746065189.724638:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.726585:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263139968 00000100:00100000:2.0:1746065189.726598:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263139968 00000100:00100000:2.0:1746065189.726667:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 9999 00000100:00100000:2.0:1746065189.726675:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31885:x1830881263139968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.726695:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.726698:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746065189.726721:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421000/0x14b4f8542d4fd534 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f46 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.728090:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd526 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f3f expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.728109:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.728113:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065189.728127:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420a00/0x14b4f8542d4fd542 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f54 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.728179:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.728192:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.728198:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.728204:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.728236:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.728249:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 9 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065189.728260:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260382208:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.728970:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.728979:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 8 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065189.728988:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260382336:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.730070:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c2c540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065189.730143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.730158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.730176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.730189:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140352 00000100:00100000:0.0:1746065189.730195:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140352 00000100:00100000:1.0:1746065189.730198:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.730211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:0.0:1746065189.730226:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880135cdf100 x1830881263140352/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.730235:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf100 with x1830881263140352 ext(2097152->3145727) 00002000:00010000:0.0:1746065189.730239:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdf100 00000100:00100000:0.0:1746065189.730251:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140480 00000100:00100000:0.0:1746065189.730253:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140480 00002000:00100000:0.0:1746065189.730261:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cded80 x1830881263140480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065189.730265:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260382208:192.168.202.46@tcp:104: 00002000:00100000:0.0:1746065189.730267:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cded80 with x1830881263140480 ext(3145728->4194303) 00002000:00010000:0.0:1746065189.730269:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cded80 00000100:00100000:1.0:1746065189.730272:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260382336:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.730275:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140864 00000100:00100000:0.0:1746065189.730277:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140864 00002000:00100000:0.0:1746065189.730284:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880135cdca80 x1830881263140864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065189.730287:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00002000:00100000:0.0:1746065189.730290:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdca80 with x1830881263140864 ext(3145728->4194303) 00002000:00010000:0.0:1746065189.730293:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdca80 00000100:00100000:3.0:1746065189.730742:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263140736 00000100:00100000:3.0:1746065189.730756:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263140736 00002000:00100000:3.0:1746065189.730772:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009f2c4700 x1830881263140736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065189.730773:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8304 00002000:00100000:3.0:1746065189.730778:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4700 with x1830881263140736 ext(2097152->3145727) 00000100:00100000:0.0:1746065189.730780:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263140352:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:3.0:1746065189.730781:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c4700 00000100:00100000:3.0:1746065189.730792:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8305 00000100:00100000:3.0:1746065189.730796:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263140480:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.731755:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8306 00000100:00100000:3.0:1746065189.731763:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+35:1961:x1830881263140864:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.731844:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8307 00000100:00100000:2.0:1746065189.731850:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+35:1961:x1830881263140736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.732679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.732807:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.732851:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141248 00000100:00100000:0.0:1746065189.732856:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141248 00010000:00010000:0.0:1746065189.732878:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 10 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065189.732898:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141376 00000100:00100000:0.0:1746065189.732900:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141376 00010000:00010000:0.0:1746065189.732909:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 9 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065189.732924:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7565 00000100:00100000:0.0:1746065189.732929:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263141248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065189.732939:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065189.732944:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 10 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065189.732954:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 10 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065189.732972:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd53b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f4d expref: 10 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065189.732989:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065189.732993:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.732999:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.733004:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.733008:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7566 00000100:00100000:2.0:1746065189.733013:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263141376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.733021:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.733026:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 9 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065189.733032:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263141248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (353us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065189.733035:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 9 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065189.733038:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7565 00010000:00010000:2.0:1746065189.733047:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83800/0x14b4f8542d4fd45b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ecf expref: 9 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.733068:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.733071:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.733076:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.733082:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.733099:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065189.733104:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065189.733111:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:2.0:1746065189.733118:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263141376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 105us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.733124:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7566 00000040:00080000:0.0:1746065189.733627:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3083, 88 off260728 00000004:00080000:0.0:1746065189.733633:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789024817616ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065189.733688:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3110, 88 off263288 00000004:00080000:0.0:1746065189.733691:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789024875948ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065189.733711:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3111, 88 off263376 00000004:00080000:0.0:1746065189.733713:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789024897919ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065189.733721:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3084, 88 off260816 00000004:00080000:0.0:1746065189.733723:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789024907949ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065189.733729:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3085, 88 off260904 00000004:00080000:0.0:1746065189.733731:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789024915985ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065189.733737:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3112, 88 off263464 00000004:00080000:0.0:1746065189.733740:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789024924398ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065189.733758:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3113, 88 off263552 00000004:00080000:0.0:1746065189.733762:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789024946598ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065189.733769:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3114, 88 off263640 00000004:00080000:0.0:1746065189.733771:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789024955678ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065189.733778:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3086, 88 off260992 00000004:00080000:0.0:1746065189.733780:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789024964596ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065189.733786:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3115, 88 off263728 00000004:00080000:0.0:1746065189.733789:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789024973410ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065189.733795:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3087, 88 off261080 00000004:00080000:0.0:1746065189.733798:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789024982589ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065189.733804:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3116, 88 off263816 00000004:00080000:0.0:1746065189.733806:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789024990901ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065189.733833:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3088, 88 off261168 00000004:00080000:0.0:1746065189.733838:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789025022378ns, next at 737048221954ns, rc = 0 00000100:00100000:2.0:1746065189.733868:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141120 00000100:00100000:2.0:1746065189.733873:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141120 00000100:00100000:2.0:1746065189.733894:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10000 00000100:00100000:2.0:1746065189.733899:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31878:x1830881263141120:12345-192.168.202.46@tcp:101:cat.0 00000040:00080000:0.0:1746065189.733900:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3089, 88 off261256 00000004:00080000:0.0:1746065189.733904:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789025088765ns, next at 737048221954ns, rc = 0 00010000:00010000:2.0:1746065189.733909:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:0.0:1746065189.733921:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3090, 88 off261344 00010000:00010000:2.0:1746065189.733923:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f5b expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746065189.733924:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789025108575ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065189.733937:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3091, 88 off261432 00000004:00080000:0.0:1746065189.733940:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789025124695ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065189.733948:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3117, 88 off263904 00000004:00080000:0.0:1746065189.733950:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789025134699ns, next at 737095943431ns, rc = 0 00010000:00010000:2.0:1746065189.733974:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.733981:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.733992:0:14644:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065189.734000:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.734009:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.734011:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065189.734013:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.734019:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ce800, rc 0) 00000100:00100000:2.0:1746065189.734043:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31878:x1830881263141120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 144us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.734048:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10000 00000100:00100000:3.0:1746065189.758463:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+35:1961:x1830881263140480:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27657us (28295us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.758473:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8305 00002000:00100000:3.0:1746065189.758483:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cded80 x1830881263140480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.758492:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cded80 with x1830881263140480 ext(3145728->4194303) 00002000:00010000:3.0:1746065189.758497:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cded80 00000100:00100000:3.0:1746065189.761085:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+36:1961:x1830881263140864:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29317us (30901us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.761097:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8306 00002000:00100000:3.0:1746065189.761106:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880135cdca80 x1830881263140864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.761115:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdca80 with x1830881263140864 ext(3145728->4194303) 00002000:00010000:3.0:1746065189.761119:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdca80 00000100:00100000:0.0:1746065189.764233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.764684:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141504 00000100:00100000:2.0:1746065189.764692:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141504 00000100:00100000:2.0:1746065189.764727:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10001 00000100:00100000:2.0:1746065189.764733:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:31882:x1830881263141504:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.764760:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.764776:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f62 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.766411:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.766427:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.766440:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.766442:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065189.766445:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.766452:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ce000, rc 0) 00000100:00100000:2.0:1746065189.766500:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:31882:x1830881263141504:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1766us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.766511:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10001 00000100:00100000:2.0:1746065189.768801:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+33:1961:x1830881263140352:12345-192.168.202.46@tcp:3:cat.0 Request processed in 38015us (38653us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.768812:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8304 00002000:00100000:2.0:1746065189.769075:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880135cdf100 x1830881263140352/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.769084:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf100 with x1830881263140352 ext(2097152->3145727) 00002000:00010000:2.0:1746065189.769089:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdf100 00000100:00100000:3.0:1746065189.772905:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263140736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 41050us (42700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.772914:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8307 00002000:00100000:3.0:1746065189.772924:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009f2c4700 x1830881263140736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.772932:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4700 with x1830881263140736 ext(2097152->3145727) 00002000:00010000:3.0:1746065189.772941:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c4700 00010000:00010000:1.0:1746065189.794632:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.794645:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065189.794648:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065189.794652:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.794661:0:14643:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.794672:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.794679:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.794684:0:14643:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.794690:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.794719:0:14643:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065189.794729:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260382464:192.168.202.46@tcp:105: 00000001:00080000:0.0:1746065189.794949:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944250 is committed 00000004:00080000:0.0:1746065189.794955:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2398 committed 00000004:00080000:0.0:1746065189.794960:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2372 committed 00000004:00080000:0.0:1746065189.794964:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2371 committed 00000004:00080000:0.0:1746065189.794966:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2370 committed 00000004:00080000:0.0:1746065189.794968:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2369 committed 00000004:00080000:0.0:1746065189.794969:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2397 committed 00000004:00080000:0.0:1746065189.794970:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2368 committed 00000004:00080000:0.0:1746065189.794972:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2396 committed 00000004:00080000:0.0:1746065189.794973:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2367 committed 00000004:00080000:0.0:1746065189.794974:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2395 committed 00000004:00080000:0.0:1746065189.794975:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2394 committed 00000004:00080000:0.0:1746065189.794976:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2393 committed 00000004:00080000:0.0:1746065189.794978:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2366 committed 00000004:00080000:0.0:1746065189.794979:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2365 committed 00000004:00080000:0.0:1746065189.794980:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2392 committed 00000004:00080000:0.0:1746065189.794981:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2391 committed 00000004:00080000:0.0:1746065189.794982:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2364 committed 00000001:00080000:0.0:1746065189.794991:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944245 is committed 00000001:00080000:0.0:1746065189.794999:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944248 is committed 00000100:00100000:0.0:1746065189.795048:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260382720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065189.795063:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260382976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065189.795079:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065189.795094:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065189.795109:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260382720 00000100:00100000:2.0:1746065189.795115:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260382720 00010000:00010000:1.0:1746065189.795313:0:14643:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065189.795321:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260384640:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065189.795371:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260382592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.795389:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.795402:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260382848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.795412:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.795424:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260382976 00000100:00100000:3.0:1746065189.795427:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260382976 00000100:00100000:0.0:1746065189.795453:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260382592 00000100:00100000:0.0:1746065189.795456:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260382592 00000100:00100000:2.0:1746065189.795465:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260382848 00000100:00100000:2.0:1746065189.795468:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260382848 00000100:00100000:1.0:1746065189.795535:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.795759:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14743 00000100:00100000:2.0:1746065189.795763:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14744 00000100:00100000:0.0:1746065189.795766:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881260382720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065189.795767:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3297:x1830881260382976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065189.795782:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260383104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065189.795799:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065189.795810:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260383744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065189.795839:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065189.795853:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260384256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065189.795865:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065189.795881:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260383104 00000100:00100000:0.0:1746065189.795884:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260383104 00000100:00100000:0.0:1746065189.795896:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260383744 00000100:00100000:0.0:1746065189.795898:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260383744 00000100:00100000:0.0:1746065189.795903:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260384256 00000100:00100000:0.0:1746065189.795904:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260384256 00000100:00100000:0.0:1746065189.795910:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14745 00000100:00100000:0.0:1746065189.795914:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881260382592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065189.795916:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065189.795918:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065189.795920:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065189.795922:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065189.795923:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065189.795945:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260382976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (849us total) trans 21474840910 rc 0/0 00000100:00100000:2.0:1746065189.795952:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14744 00000100:00100000:2.0:1746065189.795965:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14746 00000100:00100000:2.0:1746065189.795968:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881260382848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065189.795991:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065189.795994:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.795995:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.795997:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.795999:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1961 -> 1961 00000100:00100000:0.0:1746065189.796020:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3298:x1830881260382592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (629us total) trans 21474840911 rc 0/0 00000100:00100000:0.0:1746065189.796025:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14745 00002000:00010000:2.0:1746065189.796026:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:2.0:1746065189.796028:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065190 -> 1746065190 00002000:00010000:2.0:1746065189.796030:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065190 -> 1746065190 00002000:00010000:2.0:1746065189.796032:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065190 -> 1746065190 00002000:00010000:2.0:1746065189.796034:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5771 -> 5771 00000100:00100000:0.0:1746065189.796037:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14747 00000100:00100000:0.0:1746065189.796041:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3295:x1830881260383104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065189.796051:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881260382848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (638us total) trans 21474840912 rc 0/0 00000100:00100000:2.0:1746065189.796055:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14746 00000100:00100000:2.0:1746065189.796063:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14748 00000100:00100000:2.0:1746065189.796067:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3295:x1830881260383744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065189.796113:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14749 00000100:00100000:0.0:1746065189.796117:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881260384256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065189.796121:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065189.796122:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065189.796124:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065189.796125:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065189.796127:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065189.796145:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260383744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (305us total) trans 17179873631 rc 0/0 00000100:00100000:2.0:1746065189.796149:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14748 00000004:00080000:2.0:1746065189.796176:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c2a00/2, rc 0, transno 21474840912 00000100:00100000:2.0:1746065189.796182:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260382848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065189.796186:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260383360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065189.796186:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830881260384256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (320us total) trans 21474840913 rc 0/0 00000100:00100000:0.0:1746065189.796190:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14749 00000100:00100000:2.0:1746065189.796200:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065189.796208:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c0000/2, rc 0, transno 21474840913 00000100:00100000:2.0:1746065189.796209:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260383872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065189.796211:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260384256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065189.796217:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380f480/2, rc 0, transno 17179873631 00000100:00100000:2.0:1746065189.796219:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065189.796220:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260383744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065189.796227:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260384384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065189.796238:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746065189.796245:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065189.796247:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.796248:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.796250:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.796252:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065189.796269:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881260383104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (469us total) trans 17179873632 rc 0/0 00000100:00100000:0.0:1746065189.796274:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14747 00000100:00100000:0.0:1746065189.796282:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260383360 00000100:00100000:0.0:1746065189.796284:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260383360 00000100:00100000:0.0:1746065189.796293:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260383872 00000100:00100000:0.0:1746065189.796294:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260383872 00000100:00100000:0.0:1746065189.796298:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260384384 00000100:00100000:0.0:1746065189.796382:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260384384 00000100:00100000:0.0:1746065189.796396:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14750 00000100:00100000:0.0:1746065189.796400:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3296:x1830881260383360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065189.796465:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065189.796467:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.796469:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.796471:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.796472:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065189.796491:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3296:x1830881260383360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (290us total) trans 17179873633 rc 0/0 00000100:00100000:0.0:1746065189.796496:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14750 00000100:00100000:0.0:1746065189.796505:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14751 00000100:00100000:0.0:1746065189.796509:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3296:x1830881260383872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065189.796577:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3296:x1830881260383872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (356us total) trans 17179873634 rc 0/0 00000100:00100000:0.0:1746065189.796581:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14751 00000100:00100000:0.0:1746065189.796590:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14752 00000100:00100000:0.0:1746065189.796594:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881260384384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065189.796647:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065189.796649:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065189.796650:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065189.796652:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065189.796654:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065189.796668:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3296:x1830881260384384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (429us total) trans 21474840914 rc 0/0 00000100:00100000:0.0:1746065189.796673:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14752 00000004:00080000:0.0:1746065189.796692:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380f800/2, rc 0, transno 17179873632 00000100:00100000:0.0:1746065189.796695:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260383104:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065189.796770:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065189.796773:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.796774:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065187 -> 1746065187 00002000:00010000:0.0:1746065189.796776:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065189 -> 1746065189 00002000:00010000:0.0:1746065189.796778:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065189.796797:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3295:x1830881260382720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1032us (1719us total) trans 21474840915 rc 0/0 00000100:00100000:0.0:1746065189.796802:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14743 00000004:00080000:0.0:1746065189.796834:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c0380/2, rc 0, transno 21474840915 00000100:00100000:0.0:1746065189.796838:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260382720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065189.796904:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c1180/2, rc 0, transno 21474840914 00000100:00100000:2.0:1746065189.796908:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260384384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065189.796918:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380df80/2, rc 0, transno 17179873633 00000100:00100000:2.0:1746065189.796920:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260383360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065189.796924:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380ca80/2, rc 0, transno 17179873634 00000100:00100000:2.0:1746065189.796926:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260383872:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065189.796938:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c3b80/2, rc 0, transno 21474840910 00000100:00100000:2.0:1746065189.796940:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260382976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065189.796944:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260383488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065189.796959:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065189.796968:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260384000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065189.796977:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065189.796997:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260384512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065189.797006:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260383488 00000100:00100000:0.0:1746065189.797009:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260383488 00000100:00100000:2.0:1746065189.797012:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065189.797021:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260384000 00000100:00100000:0.0:1746065189.797023:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260384000 00000100:00100000:2.0:1746065189.797027:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260384512 00000100:00100000:2.0:1746065189.797029:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260384512 00000100:00100000:0.0:1746065189.797031:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14753 00000100:00100000:0.0:1746065189.797035:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3297:x1830881260383488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065189.797038:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14754 00000100:00100000:2.0:1746065189.797041:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3297:x1830881260384000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065189.797059:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14755 00000100:00100000:2.0:1746065189.797062:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3297:x1830881260384512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065189.797106:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065189.797109:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065190 -> 1746065190 00002000:00010000:0.0:1746065189.797111:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065190 -> 1746065190 00002000:00010000:0.0:1746065189.797112:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065190 -> 1746065190 00002000:00010000:0.0:1746065189.797114:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746065189.797123:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3297:x1830881260384512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (110us total) trans 21474840916 rc 0/0 00000100:00100000:2.0:1746065189.797128:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14755 00000100:00100000:0.0:1746065189.797128:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3297:x1830881260383488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (169us total) trans 17179873635 rc 0/0 00000100:00100000:0.0:1746065189.797132:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14753 00000100:00100000:2.0:1746065189.797188:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3297:x1830881260384000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (209us total) trans 17179873636 rc 0/0 00000100:00100000:2.0:1746065189.797195:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14754 00000004:00080000:3.0:1746065189.797260:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c0700/2, rc 0, transno 21474840911 00000100:00100000:3.0:1746065189.797263:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260382592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.797268:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260383232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.797284:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065189.797296:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260383616:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065189.797298:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380c000/2, rc 0, transno 17179873635 00000100:00100000:2.0:1746065189.797301:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260383488:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065189.797306:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc59180/2, rc 0, transno 17179873636 00000100:00100000:3.0:1746065189.797307:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065189.797308:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260384000:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065189.797314:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c2680/2, rc 0, transno 21474840916 00000100:00100000:3.0:1746065189.797316:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260384128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065189.797316:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260384512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065189.797321:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065189.797324:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260384768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065189.797326:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065189.797336:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065189.797806:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260383232 00000100:00100000:2.0:1746065189.797810:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260383232 00000100:00100000:0.0:1746065189.797827:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260383616 00000100:00100000:0.0:1746065189.797830:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260383616 00000100:00100000:2.0:1746065189.797839:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260384128 00000100:00100000:0.0:1746065189.797840:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260384768 00000100:00100000:2.0:1746065189.797841:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260384128 00000100:00100000:0.0:1746065189.797841:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260384768 00000100:00100000:0.0:1746065189.797849:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14756 00000100:00100000:2.0:1746065189.797852:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14757 00000100:00100000:0.0:1746065189.797853:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3298:x1830881260383232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065189.797856:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3298:x1830881260383616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065189.797917:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065189.797919:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:2.0:1746065189.797921:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:2.0:1746065189.797923:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:2.0:1746065189.797924:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065189.797934:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3298:x1830881260383232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (649us total) trans 21474840917 rc 0/0 00000100:00100000:2.0:1746065189.797938:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881260383616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (630us total) trans 17179873637 rc 0/0 00000100:00100000:0.0:1746065189.797939:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14756 00000100:00100000:2.0:1746065189.797942:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14757 00000100:00100000:0.0:1746065189.797948:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14758 00000100:00100000:2.0:1746065189.797951:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14759 00000100:00100000:0.0:1746065189.797952:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260384768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065189.797955:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3298:x1830881260384128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065189.798016:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3298:x1830881260384128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (688us total) trans 17179873638 rc 0/0 00000100:00100000:0.0:1746065189.798017:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881260384768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (681us total) trans 21474840918 rc 0/0 00000100:00100000:2.0:1746065189.798021:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14759 00000100:00100000:0.0:1746065189.798022:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14758 00000004:00080000:2.0:1746065189.798040:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a94a80/2, rc 0, transno 21474840918 00000100:00100000:2.0:1746065189.798043:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260384768:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.798144:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900c3800/2, rc 0, transno 21474840917 00000100:00100000:3.0:1746065189.798148:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260383232:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065189.798155:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380ce00/2, rc 0, transno 17179873637 00000100:00100000:3.0:1746065189.798157:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260383616:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065189.798162:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc58a80/2, rc 0, transno 17179873638 00000100:00100000:3.0:1746065189.798165:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260384128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065189.804598:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260382464:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065189.804608:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260384640:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065189.804640:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420a00/0x14b4f8542d4fd542 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 250 pid: 14643 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065189.804660:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.804684:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f420e00, rc 0) 00000100:00100000:1.0:1746065189.804718:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31885:x1830881263139968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 78044us (80085us total) trans 8589944250 rc 0/0 00000100:00100000:1.0:1746065189.804726:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 9999 00000100:00100000:0.0:1746065189.805177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.805225:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141632 00000100:00100000:2.0:1746065189.805232:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141632 00000100:00100000:2.0:1746065189.805258:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4286 00000100:00100000:2.0:1746065189.805264:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31878:x1830881263141632:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:2.0:1746065189.805324:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31878:x1830881263141632:12345-192.168.202.46@tcp:49:cat.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.805329:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4286 00000100:00100000:0.0:1746065189.806812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.806858:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141760 00000100:00100000:2.0:1746065189.806864:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141760 00000100:00100000:2.0:1746065189.806894:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4287 00000100:00100000:2.0:1746065189.806904:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31885:x1830881263141760:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:2.0:1746065189.806959:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31885:x1830881263141760:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.806964:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4287 00000100:00100000:0.0:1746065189.809093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.810581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.810660:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142016 00000100:00100000:1.0:1746065189.810667:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142016 00000100:00100000:1.0:1746065189.810716:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10002 00000100:00100000:1.0:1746065189.810722:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:31883:x1830881263142016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.810776:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065189.810782:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263141888 00000100:00100000:3.0:1746065189.810785:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263141888 00010000:00010000:1.0:1746065189.810791:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd55e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f69 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.810805:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4288 00000100:00100000:3.0:1746065189.810809:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:31882:x1830881263141888:12345-192.168.202.46@tcp:49:multiop.0 00010000:00010000:1.0:1746065189.810847:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd55e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f69 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.810858:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd55e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f69 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.810871:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065189.810873:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065189.810876:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29e00, rc 0) 00000100:00100000:3.0:1746065189.810883:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:31882:x1830881263141888:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 73us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.810888:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:31883:x1830881263142016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 167us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.810889:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4288 00000100:00100000:1.0:1746065189.810895:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10002 00000100:00100000:0.0:1746065189.815502:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.815602:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142144 00000100:00100000:1.0:1746065189.815609:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142144 00000100:00100000:1.0:1746065189.815650:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14760 00000100:00100000:1.0:1746065189.815656:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31885:x1830881263142144:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065189.815670:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.815683:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f70 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.815705:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.815712:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.815717:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.815718:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.815721:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.815750:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.815759:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 33 pid: 8428 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746065189.815768:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260384896:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065189.815857:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.815864:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746065189.815871:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260385024:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065189.815886:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.816053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.816090:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142272 00000100:00100000:3.0:1746065189.816094:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142272 00000100:00100000:3.0:1746065189.816119:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 775 00000100:00100000:3.0:1746065189.816125:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263142272:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.816133:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.816148:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec29e00/0x14b4f8542d4fd55e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f69 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.816274:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065189.816278:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.816297:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+8:1958:x1830881263142272:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 173us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.816303:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 775 00000100:00100000:0.0:1746065189.818317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.818363:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142528 00000100:00100000:3.0:1746065189.818369:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142528 00002000:00100000:3.0:1746065189.818398:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fc58000 x1830881263142528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.818407:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58000 with x1830881263142528 ext(3145728->4194303) 00002000:00010000:3.0:1746065189.818411:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc58000 00000100:00100000:3.0:1746065189.818439:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8308 00000100:00100000:3.0:1746065189.818445:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263142528:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065189.818701:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260384896:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065189.818708:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260385024:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065189.818728:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.818738:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec29400, rc 0) 00000100:00100000:1.0:1746065189.818780:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31885:x1830881263142144:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3123us (3285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.818785:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14760 00000100:00100000:0.0:1746065189.820332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.821160:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142656 00000100:00100000:3.0:1746065189.821166:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142656 00010000:00010000:3.0:1746065189.821192:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065189.821225:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7567 00000100:00100000:3.0:1746065189.821232:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263142656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.821241:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.821260:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.821270:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.821289:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f502c00/0x14b4f8542d4fd4f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f31 expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.821300:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.821326:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+33:1961:x1830881263142656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 95us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.821331:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7567 00000100:00100000:0.0:1746065189.827544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.827569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.827601:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143040 00000100:00100000:0.0:1746065189.827601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.827608:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143040 00000100:00100000:1.0:1746065189.827877:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143168 00000100:00100000:1.0:1746065189.827881:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143168 00000100:00100000:0.0:1746065189.827890:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14761 00000100:00100000:0.0:1746065189.827899:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+34:31882:x1830881263143040:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065189.827915:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065189.827929:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f77 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.827950:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065189.827952:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065189.827956:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.827966:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.827974:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcccc00, rc 0) 00000100:00100000:0.0:1746065189.828008:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+35:31882:x1830881263143040:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 111us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.828476:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263142912 00000100:00100000:3.0:1746065189.828480:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263142912 00002000:00100000:3.0:1746065189.828502:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fc5a680 x1830881263142912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.828511:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5a680 with x1830881263142912 ext(3145728->4194303) 00010000:00010000:3.0:1746065189.828517:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.828528:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 889 lvb_type: 1 00002000:00010000:3.0:1746065189.828534:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5a680 00000100:00100000:3.0:1746065189.828548:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2527 00000100:00100000:3.0:1746065189.828553:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263142912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065189.828898:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14761 00000100:00100000:1.0:1746065189.829549:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14762 00000100:00100000:1.0:1746065189.831857:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:31883:x1830881263143168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.831874:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.831888:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f7e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.831911:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065189.831916:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.831922:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065189.831926:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.831957:0:8851:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.831969:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.831978:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25a000, rc 0) 00000100:00100000:1.0:1746065189.832015:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+35:31883:x1830881263143168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 173us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.832022:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14762 00000100:00100000:3.0:1746065189.833054:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263142528:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 14606us (14738us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.833061:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8308 00002000:00100000:3.0:1746065189.833069:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fc58000 x1830881263142528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.833078:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58000 with x1830881263142528 ext(3145728->4194303) 00002000:00010000:3.0:1746065189.833082:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc58000 00000100:00100000:3.0:1746065189.837017:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263142912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8456us (9473us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.837027:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2527 00002000:00100000:3.0:1746065189.837036:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fc5a680 x1830881263142912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.837044:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5a680 with x1830881263142912 ext(3145728->4194303) 00010000:00010000:3.0:1746065189.837053:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.837064:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 34 pid: 25185 timeout: 889 lvb_type: 1 00002000:00010000:3.0:1746065189.837070:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5a680 00000100:00100000:0.0:1746065189.838043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.838084:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143296 00000100:00100000:2.0:1746065189.838091:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143296 00000100:00100000:2.0:1746065189.838120:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14763 00000100:00100000:2.0:1746065189.838126:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31878:x1830881263143296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.838138:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.838152:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f85 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.838171:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.838176:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.838182:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065189.838186:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.838215:0:21235:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.838227:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.838237:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cfe00, rc 0) 00000100:00100000:2.0:1746065189.838408:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31878:x1830881263143296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 280us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.838414:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14763 00000100:00100000:2.0:1746065189.847976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.848144:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143424 00000100:00100000:3.0:1746065189.848153:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143424 00010000:00010000:3.0:1746065189.848184:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 35 pid: 25185 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065189.848207:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7568 00000100:00100000:3.0:1746065189.848214:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263143424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.848226:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.848244:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 35 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.848255:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 35 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.848275:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f503a00/0x14b4f8542d4fd4a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f00 expref: 35 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.848609:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.848612:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.848619:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.848626:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.848633:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.848634:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.848637:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.848644:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.848671:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.848681:0:15963:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 34 pid: 21998 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065189.848691:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260385408:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065189.849018:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.849026:0:15963:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065189.849035:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260385536:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065189.849058:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.851537:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260385408:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065189.851548:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260385536:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065189.851562:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.851605:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263143424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3390us (3635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.851618:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7568 00000100:00100000:1.0:1746065189.852421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.852553:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143680 00000100:00100000:3.0:1746065189.852559:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143680 00002000:00100000:3.0:1746065189.852589:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2588672->2592767) req@ffff88009f2c7480 x1830881263143680/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.852598:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c7480 with x1830881263143680 ext(2588672->2592767) 00010000:00010000:3.0:1746065189.852605:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065189.852616:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065189.852626:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c7480 00000100:00100000:3.0:1746065189.852656:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2528 00000100:00100000:3.0:1746065189.852662:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263143680:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.852841:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263143680:12345-192.168.202.46@tcp:3:cat.0 Request processed in 178us (426us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065189.852847:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2528 00002000:00100000:3.0:1746065189.852852:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2588672->2592767) req@ffff88009f2c7480 x1830881263143680/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.852859:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c7480 with x1830881263143680 ext(2588672->2592767) 00010000:00010000:3.0:1746065189.852864:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065189.852876:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065189.852880:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c7480 00000100:00100000:0.0:1746065189.853362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.853597:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263143936 00000100:00100000:2.0:1746065189.853602:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263143936 00002000:00100000:2.0:1746065189.853622:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3796992->3801087) req@ffff88008fc5bb80 x1830881263143936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.853633:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5bb80 with x1830881263143936 ext(3796992->3801087) 00010000:00010000:2.0:1746065189.853638:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.853647:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746065189.853652:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5bb80 00000100:00100000:2.0:1746065189.853786:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2529 00000100:00100000:2.0:1746065189.853792:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263143936:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065189.853907:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263143936:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 115us (546us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065189.853913:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2529 00002000:00100000:2.0:1746065189.853918:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3796992->3801087) req@ffff88008fc5bb80 x1830881263143936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.853924:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5bb80 with x1830881263143936 ext(3796992->3801087) 00010000:00010000:2.0:1746065189.853929:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.853940:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746065189.853945:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5bb80 00000100:00100000:0.0:1746065189.863907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.863943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.864166:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263144192 00000100:00100000:2.0:1746065189.864173:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263144192 00000100:00100000:2.0:1746065189.864210:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14764 00000100:00100000:2.0:1746065189.864217:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+33:31882:x1830881263144192:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.864234:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.864248:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f8c expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.864271:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 38 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.864279:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.864284:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.864285:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.864288:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->3239935] (req 3145728->3239935) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 34 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.864311:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.864320:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065189.864329:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260385664:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065189.864381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065189.864387:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 38 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.864407:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 38 pid: 25185 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065189.864419:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260385792:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065189.864420:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263144320 00000100:00100000:3.0:1746065189.864424:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263144320 00000100:00100000:2.0:1746065189.864434:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.864448:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263144576 00000100:00100000:2.0:1746065189.864451:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263144576 00002000:00100000:2.0:1746065189.864466:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3796992->4194303) req@ffff88009f2c5c00 x1830881263144576/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.864474:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5c00 with x1830881263144576 ext(3796992->4194303) 00000100:00100000:1.0:1746065189.864477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065189.864480:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 889 lvb_type: 0 00002000:00100000:3.0:1746065189.864492:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2588672->3145727) req@ffff880094a13b80 x1830881263144320/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065189.864492:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 34 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746065189.864497:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c5c00 00002000:00100000:3.0:1746065189.864500:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13b80 with x1830881263144320 ext(2588672->3145727) 00010000:00010000:3.0:1746065189.864506:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065189.864514:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2530 00010000:00010000:3.0:1746065189.864517:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 35 pid: 21998 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065189.864519:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263144576:12345-192.168.202.46@tcp:4:multiop.0 00002000:00010000:3.0:1746065189.864522:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a13b80 00000100:00100000:3.0:1746065189.864542:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2531 00000100:00100000:3.0:1746065189.864548:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+35:1958:x1830881263144320:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065189.864548:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263144704 00000100:00100000:0.0:1746065189.864551:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263144704 00000100:00100000:0.0:1746065189.864578:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14765 00000100:00100000:0.0:1746065189.864583:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:31885:x1830881263144704:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065189.864589:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065189.864595:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f93 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.864611:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065189.864612:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065189.864616:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->4444159] (req 4194304->4444159) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 40 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.864624:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->4444159] (req 4194304->4444159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 40 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065189.864632:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec28000, rc 0) 00000100:00100000:0.0:1746065189.864654:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:31885:x1830881263144704:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065189.864659:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14765 00000100:00100000:0.0:1746065189.867268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.867285:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260385664:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.867296:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260385792:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.867321:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->3239935] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 34 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.867335:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cfc00, rc 0) 00000100:00100000:2.0:1746065189.867381:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+34:31882:x1830881263144192:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3164us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.867389:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14764 00000100:00100000:3.0:1746065189.867578:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263144832 00000100:00100000:3.0:1746065189.867584:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263144832 00010000:00010000:3.0:1746065189.867605:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065189.867665:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7569 00000100:00100000:3.0:1746065189.867672:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263144832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.867683:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.867698:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.867707:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.867724:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f502e00/0x14b4f8542d4fd4ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f2a expref: 34 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.867738:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065189.867938:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263144832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 265us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065189.867944:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7569 00000100:00100000:0.0:1746065189.870267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.870339:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263144960 00000100:00100000:3.0:1746065189.870346:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263144960 00010000:00010000:3.0:1746065189.870373:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 40 pid: 25185 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065189.870406:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7570 00000100:00100000:3.0:1746065189.870413:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881263144960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065189.870429:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065189.870447:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 40 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.870457:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 40 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.870475:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f503c00/0x14b4f8542d4fd493 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef9 expref: 40 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065189.870486:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.870487:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.870493:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 32 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.870500:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 32 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.870507:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.870508:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065189.870512:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 39 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.870517:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 39 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065189.870543:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 39 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.870554:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260385920:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065189.870639:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 32 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.870652:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260386048:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065189.870669:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.871543:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263144576:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 7021us (7160us total) trans 17179873639 rc 0/0 00000100:00100000:2.0:1746065189.871552:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2530 00002000:00100000:2.0:1746065189.871559:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3796992->4194303) req@ffff88009f2c5c00 x1830881263144576/t17179873639(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.871567:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5c00 with x1830881263144576 ext(3796992->4194303) 00010000:00010000:2.0:1746065189.871574:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 36 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.871584:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 36 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746065189.871589:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c5c00 00000100:00100000:0.0:1746065189.873782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.873844:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263145088 00000100:00100000:0.0:1746065189.873845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.873851:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263145088 00010000:00010000:1.0:1746065189.873877:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 36 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065189.873906:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7571 00000100:00100000:1.0:1746065189.873912:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263145088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065189.873923:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065189.873925:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260385920:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.873938:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260386048:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065189.873938:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 36 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065189.873947:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 36 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.873952:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065189.873963:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29400/0x14b4f8542d4fd565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f70 expref: 36 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065189.873977:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263144960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3565us (3717us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065189.873979:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.873984:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7570 00000100:00100000:1.0:1746065189.873996:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263145088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.874001:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7571 00000100:00100000:2.0:1746065189.874020:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263145344 00000100:00100000:2.0:1746065189.874023:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263145344 00002000:00100000:2.0:1746065189.874042:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3235840->3239935) req@ffff880094a10380 x1830881263145344/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.874055:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10380 with x1830881263145344 ext(3235840->3239935) 00002000:00010000:2.0:1746065189.874059:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a10380 00000100:00100000:2.0:1746065189.874074:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8309 00000100:00100000:2.0:1746065189.874078:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881263145344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.874178:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+33:1958:x1830881263145344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 99us (333us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065189.874183:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8309 00002000:00100000:2.0:1746065189.874187:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3235840->3239935) req@ffff880094a10380 x1830881263145344/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.874194:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10380 with x1830881263145344 ext(3235840->3239935) 00002000:00010000:2.0:1746065189.874196:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a10380 00000100:00100000:0.0:1746065189.874399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.874792:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263145600 00000100:00100000:2.0:1746065189.874795:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263145600 00002000:00100000:2.0:1746065189.874883:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4440064->4444159) req@ffff880094a11c00 x1830881263145600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.874890:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11c00 with x1830881263145600 ext(4440064->4444159) 00002000:00010000:2.0:1746065189.874893:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a11c00 00000100:00100000:2.0:1746065189.874914:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8310 00000100:00100000:2.0:1746065189.874919:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263145600:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065189.874991:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263145600:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 72us (593us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065189.874997:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8310 00002000:00100000:2.0:1746065189.875001:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4440064->4444159) req@ffff880094a11c00 x1830881263145600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.875008:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11c00 with x1830881263145600 ext(4440064->4444159) 00002000:00010000:2.0:1746065189.875010:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a11c00 00000100:00100000:3.0:1746065189.877291:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+37:1958:x1830881263144320:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12735us (13339us total) trans 17179873640 rc 0/0 00000100:00100000:3.0:1746065189.877301:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2531 00002000:00100000:3.0:1746065189.877309:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2588672->3145727) req@ffff880094a13b80 x1830881263144320/t17179873640(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.877317:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13b80 with x1830881263144320 ext(2588672->3145727) 00010000:00010000:3.0:1746065189.877325:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 37 pid: 21998 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065189.877338:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 37 pid: 21998 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065189.877344:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a13b80 00000100:00100000:0.0:1746065189.877605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.879808:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263145856 00000100:00100000:3.0:1746065189.879858:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263145856 00000100:00100000:3.0:1746065189.879907:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4289 00000100:00100000:3.0:1746065189.879913:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31885:x1830881263145856:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065189.880145:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31885:x1830881263145856:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 231us (2541us total) trans 8589944251 rc 0/0 00000100:00100000:3.0:1746065189.880151:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4289 00000100:00100000:0.0:1746065189.881677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.881732:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263145984 00000100:00100000:2.0:1746065189.881738:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263145984 00010000:00010000:2.0:1746065189.881773:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 37 pid: 21998 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065189.881807:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7572 00000100:00100000:2.0:1746065189.881812:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+37:1960:x1830881263145984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.881847:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.881866:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 37 pid: 21998 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.881876:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 37 pid: 21998 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.881895:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcccc00/0x14b4f8542d4fd56c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f77 expref: 37 pid: 21998 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.881917:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.881919:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.881924:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 36 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.881931:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 36 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.881939:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.881940:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.881943:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 34 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.881948:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 34 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.881970:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 34 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.881979:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a96d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260386176:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.882065:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 36 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.882072:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a97480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260386304:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.882088:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.885877:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a96d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260386176:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.885890:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a97480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260386304:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.885906:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.885941:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263145984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4127us (4269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.885951:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7572 00000100:00100000:0.0:1746065189.886205:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.886265:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263146240 00000100:00100000:3.0:1746065189.886272:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263146240 00002000:00100000:3.0:1746065189.886576:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a11880 x1830881263146240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.886585:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881263146240 ext(3145728->4194303) 00002000:00010000:3.0:1746065189.886589:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11880 00000100:00100000:3.0:1746065189.886619:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8311 00000100:00100000:3.0:1746065189.886626:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263146240:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065189.891378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.891409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.891434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.891489:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263146496 00000100:00100000:2.0:1746065189.891496:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263146496 00002000:00100000:2.0:1746065189.891533:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a10a80 x1830881263146496/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.891546:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10a80 with x1830881263146496 ext(2097152->3145727) 00002000:00010000:2.0:1746065189.891550:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10a80 00000100:00100000:2.0:1746065189.892101:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263146624 00000100:00100000:2.0:1746065189.892104:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263146624 00002000:00100000:2.0:1746065189.892118:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a10e00 x1830881263146624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.892126:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10e00 with x1830881263146624 ext(3145728->4194303) 00002000:00010000:2.0:1746065189.892129:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10e00 00000100:00100000:0.0:1746065189.892152:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147008 00000100:00100000:0.0:1746065189.892160:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147008 00000100:00100000:3.0:1746065189.892162:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8312 00000100:00100000:3.0:1746065189.892171:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+37:1960:x1830881263146496:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:0.0:1746065189.892178:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3239936->4194303) req@ffff880094a13480 x1830881263147008/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065189.892190:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13480 with x1830881263147008 ext(3239936->4194303) 00002000:00010000:0.0:1746065189.892194:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a13480 00000100:00100000:0.0:1746065189.892207:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8313 00000100:00100000:0.0:1746065189.892213:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+37:1961:x1830881263146624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.893047:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8314 00000100:00100000:2.0:1746065189.893055:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+33:1961:x1830881263147008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065189.895447:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263146240:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8816us (9237us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.895456:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8311 00002000:00100000:3.0:1746065189.895465:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a11880 x1830881263146240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.895473:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11880 with x1830881263146240 ext(3145728->4194303) 00002000:00010000:3.0:1746065189.895478:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a11880 00000100:00100000:2.0:1746065189.905502:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+38:1961:x1830881263146624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13276us (14078us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065189.905514:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8313 00002000:00100000:2.0:1746065189.905524:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a10e00 x1830881263146624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.905532:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10e00 with x1830881263146624 ext(3145728->4194303) 00002000:00010000:2.0:1746065189.905537:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10e00 00000100:00100000:1.0:1746065189.908961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.909089:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147136 00000100:00100000:2.0:1746065189.909097:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147136 00000100:00100000:2.0:1746065189.909126:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14766 00000100:00100000:2.0:1746065189.909132:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263147136:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.909147:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.909161:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f502400/0x14b4f8542d4fd58f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60f9a expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.909201:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260386432:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065189.909254:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.909429:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+33:1961:x1830881263147008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16375us (17993us total) trans 0 rc 954368/954368 00000100:00100000:2.0:1746065189.909436:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8314 00002000:00100000:2.0:1746065189.909443:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3239936->4194303) req@ffff880094a13480 x1830881263147008/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 954368/954368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.909451:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13480 with x1830881263147008 ext(3239936->4194303) 00002000:00010000:2.0:1746065189.909454:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a13480 00000100:00100000:3.0:1746065189.910486:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263146496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18314us (19112us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065189.910494:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8312 00002000:00100000:3.0:1746065189.910500:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a10a80 x1830881263146496/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.910727:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a10a80 with x1830881263146496 ext(2097152->3145727) 00002000:00010000:3.0:1746065189.910731:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a10a80 00000100:00100000:2.0:1746065189.911256:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260386432:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065189.911278:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f502400/0x14b4f8542d4fd58f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f9a expref: 40 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.911290:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f502400/0x14b4f8542d4fd58f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f9a expref: 40 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.911396:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f502400, rc 0) 00000100:00100000:2.0:1746065189.911528:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263147136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2394us (2572us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.911534:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14766 00000100:00100000:0.0:1746065189.916391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.916476:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147392 00000100:00100000:3.0:1746065189.916484:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147392 00002000:00100000:3.0:1746065189.916520:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4444160->5013503) req@ffff880094a12680 x1830881263147392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.916529:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a12680 with x1830881263147392 ext(4444160->5013503) 00002000:00010000:3.0:1746065189.916534:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a12680 00000100:00100000:3.0:1746065189.916567:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8315 00000100:00100000:3.0:1746065189.916575:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263147392:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065189.919411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.919938:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147520 00000100:00100000:2.0:1746065189.919946:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147520 00000100:00100000:2.0:1746065189.919987:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14767 00000100:00100000:2.0:1746065189.919995:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263147520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065189.920007:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.920021:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f502a00/0x14b4f8542d4fd596 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fa1 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.920061:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260386560:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065189.920559:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065189.922171:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263147392:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5592us (5782us total) trans 0 rc 569344/569344 00000100:00100000:3.0:1746065189.922180:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8315 00002000:00100000:3.0:1746065189.922188:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4444160->5013503) req@ffff880094a12680 x1830881263147392/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 569344/569344 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.922197:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a12680 with x1830881263147392 ext(4444160->5013503) 00002000:00010000:3.0:1746065189.922201:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a12680 00000100:00100000:3.0:1746065189.922960:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260386560:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065189.922984:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f502a00/0x14b4f8542d4fd596 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa1 expref: 34 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.922995:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f502a00/0x14b4f8542d4fd596 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa1 expref: 34 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065189.923549:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f502a00, rc 0) 00000100:00100000:3.0:1746065189.923604:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263147520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3609us (4197us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065189.923614:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14767 00000100:00100000:0.0:1746065189.925772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065189.926036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.926104:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147648 00000100:00100000:1.0:1746065189.926111:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147648 00000100:00100000:1.0:1746065189.926140:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147776 00000100:00100000:1.0:1746065189.926142:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147776 00000100:00100000:1.0:1746065189.926155:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14768 00000100:00100000:1.0:1746065189.926161:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:31883:x1830881263147648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.926175:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.926189:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fa8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.926214:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 39 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.926221:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065189.926223:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065189.926225:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.926250:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 39 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.926260:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 39 pid: 4545 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065189.926270:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260386688:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065189.926364:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14769 00000100:00100000:0.0:1746065189.926371:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881263147776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065189.926378:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065189.926383:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fccd400/0x14b4f8542d4fd5a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60faf expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065189.926408:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260386816:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065189.927079:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5eee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065189.928413:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.929551:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260386816:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065189.929575:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fccd400/0x14b4f8542d4fd5a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60faf expref: 40 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.929586:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fccd400/0x14b4f8542d4fd5a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60faf expref: 40 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.929610:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fccd400, rc 0) 00000100:00100000:2.0:1746065189.929655:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881263147776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3285us (3618us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065189.929663:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14769 00000100:00100000:1.0:1746065189.929981:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260386688:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065189.929997:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.930008:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac54e00, rc 0) 00000100:00100000:1.0:1746065189.930030:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:31883:x1830881263147648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3864us (4259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.930036:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14768 00000100:00100000:0.0:1746065189.930317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.930411:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263147904 00000100:00100000:3.0:1746065189.930417:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263147904 00002000:00100000:3.0:1746065189.930446:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4444159) req@ffff880094a11f80 x1830881263147904/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.930455:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11f80 with x1830881263147904 ext(4194304->4444159) 00010000:00010000:3.0:1746065189.930461:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 39 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065189.930471:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 39 pid: 4545 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065189.930477:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a11f80 00000100:00100000:3.0:1746065189.930491:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2532 00000100:00100000:3.0:1746065189.930497:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263147904:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065189.934971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.935016:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148032 00000100:00100000:1.0:1746065189.935029:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148032 00000100:00100000:1.0:1746065189.935145:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14770 00000100:00100000:1.0:1746065189.935153:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:31878:x1830881263148032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.935169:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.935183:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fb6 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.935206:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065189.935208:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065189.935211:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->5242879] (req 5009408->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 42 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.935222:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->5242879] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 42 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.935230:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55000, rc 0) 00000100:00100000:1.0:1746065189.935277:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:31878:x1830881263148032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 124us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065189.935282:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14770 00000100:00100000:3.0:1746065189.936156:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1960:x1830881263147904:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5656us (5837us total) trans 21474840919 rc 0/0 00000100:00100000:3.0:1746065189.936165:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2532 00002000:00100000:3.0:1746065189.936172:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4444159) req@ffff880094a11f80 x1830881263147904/t21474840919(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/448 e 0 to 0 dl 1746065200 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.936181:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a11f80 with x1830881263147904 ext(4194304->4444159) 00010000:00010000:3.0:1746065189.936186:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 42 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065189.936202:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 42 pid: 4545 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065189.936207:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a11f80 00000100:00100000:0.0:1746065189.940403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.940464:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148160 00000100:00100000:2.0:1746065189.940472:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148160 00010000:00010000:2.0:1746065189.940501:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 42 pid: 4545 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065189.940541:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7573 00000100:00100000:2.0:1746065189.940548:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1960:x1830881263148160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065189.940559:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065189.940577:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 42 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.940589:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 42 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.940608:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec28000/0x14b4f8542d4fd588 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4444159) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f93 expref: 42 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065189.940635:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.940636:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.940643:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.940650:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.940657:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.940658:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.940660:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 41 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.940666:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 41 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.940693:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 41 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.940705:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260386944:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.940799:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065189.940807:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260387072:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.940862:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065189.943604:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260386944:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065189.943613:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260387072:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065189.943628:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065189.944161:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263148160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3612us (3763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065189.944171:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7573 00000100:00100000:0.0:1746065189.944246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.944633:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148288 00000100:00100000:1.0:1746065189.944639:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148288 00000100:00100000:0.0:1746065189.944917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.944983:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14771 00000100:00100000:1.0:1746065189.944992:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263148288:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.945005:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065189.945015:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148544 00010000:00010000:1.0:1746065189.945018:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd5b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fbd expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065189.945020:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148544 00010000:00010000:1.0:1746065189.945043:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd5b2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fbd expref: 42 pid: 8851 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746065189.945045:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008ec2e680 x1830881263148544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.945053:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2e680 with x1830881263148544 ext(4194304->5013503) 00010000:00010000:1.0:1746065189.945054:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd5b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fbd expref: 42 pid: 8851 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746065189.945057:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2e680 00000100:00100000:3.0:1746065189.945069:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8316 00000100:00100000:3.0:1746065189.945074:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263148544:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:1.0:1746065189.945444:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55400, rc 0) 00000100:00100000:1.0:1746065189.945474:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263148288:12345-192.168.202.46@tcp:101:cat.0 Request processed in 484us (1228us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065189.945479:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14771 00000100:00100000:0.0:1746065189.951628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.951802:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148800 00000100:00100000:2.0:1746065189.951809:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148800 00002000:00100000:2.0:1746065189.951862:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88008ec2ed80 x1830881263148800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/0 e 0 to 0 dl 1746065200 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065189.951872:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ed80 with x1830881263148800 ext(5009408->5013503) 00002000:00010000:2.0:1746065189.951876:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2ed80 00000100:00100000:2.0:1746065189.951894:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8317 00000100:00100000:2.0:1746065189.951901:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263148800:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065189.952039:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263148800:12345-192.168.202.46@tcp:3:cat.0 Request processed in 137us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065189.952048:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8317 00002000:00100000:2.0:1746065189.952053:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88008ec2ed80 x1830881263148800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:105/0 lens 488/4536 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065189.952059:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263148544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6983us (7142us total) trans 0 rc 819200/819200 00002000:00100000:2.0:1746065189.952059:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ed80 with x1830881263148800 ext(5009408->5013503) 00002000:00010000:2.0:1746065189.952062:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2ed80 00000100:00100000:3.0:1746065189.952066:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8316 00002000:00100000:3.0:1746065189.952072:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008ec2e680 x1830881263148544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:105/0 lens 488/440 e 0 to 0 dl 1746065200 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065189.952079:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2e680 with x1830881263148544 ext(4194304->5013503) 00002000:00010000:3.0:1746065189.952082:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2e680 00000100:00100000:0.0:1746065189.961159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.961220:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263148928 00000100:00100000:1.0:1746065189.961227:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263148928 00000100:00100000:1.0:1746065189.961277:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14772 00000100:00100000:1.0:1746065189.961284:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263148928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.961300:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.961314:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd5b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fc4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.961340:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd5b9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fc4 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.961350:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd5b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fc4 expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.961373:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55800, rc 0) 00000100:00100000:1.0:1746065189.961415:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263148928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 131us (262us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065189.961421:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14772 00000100:00100000:0.0:1746065189.971466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.971717:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149184 00000100:00100000:2.0:1746065189.971726:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149184 00000100:00100000:2.0:1746065189.971778:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4290 00000100:00100000:2.0:1746065189.971785:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094491850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:31878:x1830881263149184:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065189.971976:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094491850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31878:x1830881263149184:12345-192.168.202.46@tcp:35:cat.0 Request processed in 190us (516us total) trans 8589944252 rc 0/0 00000100:00100000:2.0:1746065189.971982:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4290 00000100:00100000:0.0:1746065189.972251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065189.972765:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149312 00000100:00100000:1.0:1746065189.972770:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149312 00000100:00100000:1.0:1746065189.972800:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14773 00000100:00100000:1.0:1746065189.972805:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263149312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065189.972830:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065189.972843:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fcb expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065189.972870:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fcb expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.972878:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fcb expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065189.972888:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55c00, rc 0) 00000100:00100000:1.0:1746065189.972906:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263149312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 102us (656us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065189.972911:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14773 00000100:00100000:0.0:1746065189.977291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.977419:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149568 00000100:00100000:2.0:1746065189.977426:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149568 00000100:00100000:2.0:1746065189.977471:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4291 00000100:00100000:2.0:1746065189.977477:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:31883:x1830881263149568:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065189.977670:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:31883:x1830881263149568:12345-192.168.202.46@tcp:35:cat.0 Request processed in 193us (386us total) trans 8589944253 rc 0/0 00000100:00100000:2.0:1746065189.977676:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4291 00000100:00100000:0.0:1746065189.993656:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.993855:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263149824 00000100:00100000:2.0:1746065189.993864:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263149824 00000100:00100000:2.0:1746065189.993921:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10003 00000100:00100000:2.0:1746065189.993929:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:31892:x1830881263149824:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.993952:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.993969:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503600/0x14b4f8542d4fd5c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fd2 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.994057:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994067:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994076:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994086:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994091:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994095:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994179:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994186:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994192:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065189.994199:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065189.994263:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994270:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994276:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994280:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f503800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065189.994283:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994289:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994297:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065189.994300:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065189.994303:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994307:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503800/0x14b4f8542d4fd5ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994319:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994324:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994329:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994332:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f502600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065189.994334:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994339:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994347:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012cf55b00) 00010000:00010000:2.0:1746065189.994349:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065189.994350:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994354:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502600/0x14b4f8542d4fd5d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065189.994394:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f503600/0x14b4f8542d4fd5c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.994405:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.994410:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065189.994412:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065189.994414:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f502800, rc 0) 00000100:00100000:2.0:1746065189.994449:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:31892:x1830881263149824:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 521us (801us total) trans 8589944254 rc 0/0 00000100:00100000:2.0:1746065189.994456:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10003 00000100:00100000:0.0:1746065189.996327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065189.996402:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150080 00000100:00100000:3.0:1746065189.996408:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150080 00000100:00100000:3.0:1746065189.996432:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4292 00000100:00100000:3.0:1746065189.996438:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:31892:x1830881263150080:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065189.997131:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:31892:x1830881263150080:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 691us (806us total) trans 8589944255 rc 0/0 00000100:00100000:3.0:1746065189.997137:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4292 00000100:00100000:0.0:1746065189.999308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.999403:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150208 00000100:00100000:2.0:1746065189.999409:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150208 00000100:00100000:0.0:1746065189.999672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065189.999701:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14774 00000100:00100000:2.0:1746065189.999709:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+36:31892:x1830881263150208:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065189.999727:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065189.999751:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fd9 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.999781:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.999788:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 37 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.999793:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.999794:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065189.999797:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1343488->1396735] (req 1343488->1396735) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 37 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065189.999855:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 37 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.999866:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 37 pid: 4544 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065189.999876:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260387200:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065189.999938:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 34 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065189.999945:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 34 pid: 8851 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065189.999951:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260387328:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065189.999965:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065190.000579:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150464 00000100:00100000:1.0:1746065190.000584:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150464 00000100:00100000:1.0:1746065190.000669:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10004 00000100:00100000:1.0:1746065190.000676:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31894:x1830881263150464:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065190.000688:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.000698:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fd5f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fe0 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.000790:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.000800:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.000809:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.000840:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.000846:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.000852:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.000933:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.000941:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.000946:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065190.000953:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065190.001020:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001026:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001031:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001039:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac55c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065190.001042:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001048:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001057:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065190.001059:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065190.001062:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001067:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55c00/0x14b4f8542d4fd5f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001079:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001083:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001087:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001091:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac55600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065190.001093:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001097:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001103:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669100) 00010000:00010000:1.0:1746065190.001105:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065190.001107:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001111:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd5ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065190.001140:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fd5f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.001148:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.001153:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.001155:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065190.001157:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55800, rc 0) 00000100:00100000:1.0:1746065190.001183:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31894:x1830881263150464:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 508us (1511us total) trans 8589944256 rc 0/0 00000100:00100000:1.0:1746065190.001189:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10004 00000100:00100000:0.0:1746065190.001454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.001478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.001521:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150720 00000100:00100000:2.0:1746065190.001524:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150720 00010000:00010000:2.0:1746065190.001546:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 35 pid: 8851 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.001558:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150592 00000100:00100000:2.0:1746065190.001560:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150592 00010000:00010000:2.0:1746065190.001566:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 38 pid: 4544 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.001576:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7574 00000100:00100000:2.0:1746065190.001580:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263150720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.001587:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.001600:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 35 pid: 8851 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.001607:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 35 pid: 8851 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.001620:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.001635:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263150720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.001640:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7574 00000100:00100000:2.0:1746065190.001650:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7575 00000100:00100000:2.0:1746065190.001654:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+38:1959:x1830881263150592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.001659:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.001665:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 38 pid: 4544 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.001671:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 38 pid: 4544 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.001680:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.001681:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.001685:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.001691:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.001706:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.001714:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260387456:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065190.001752:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065190.001774:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec29c00/0x14b4f8542d4fd4e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f1c expref: 38 pid: 4544 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.001782:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260387200:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.001788:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f74de00/0x14b4f8542d4fd485 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60eeb expref: 34 pid: 8851 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.001794:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260387328:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.001808:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 37 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.001827:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f502200, rc 0) 00000100:00100000:2.0:1746065190.001840:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+37:31892:x1830881263150208:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2133us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.001845:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14774 00000100:00080000:3.0:1746065190.001946:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065190.003865:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a97100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260387456:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.003879:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.003924:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+36:1959:x1830881263150592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2268us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.003932:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7575 00000100:00100000:0.0:1746065190.004844:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.005007:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263150976 00000100:00100000:2.0:1746065190.005012:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263150976 00002000:00100000:2.0:1746065190.005040:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1343488->1347583) req@ffff88008ec2df80 x1830881263150976/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.005048:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2df80 with x1830881263150976 ext(1343488->1347583) 00002000:00010000:2.0:1746065190.005052:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2df80 00000100:00100000:2.0:1746065190.005075:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8318 00000100:00100000:2.0:1746065190.005080:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263150976:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065190.005202:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263150976:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 120us (388us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065190.005207:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8318 00002000:00100000:2.0:1746065190.005212:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1343488->1347583) req@ffff88008ec2df80 x1830881263150976/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.005223:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2df80 with x1830881263150976 ext(1343488->1347583) 00002000:00010000:2.0:1746065190.005225:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2df80 00000100:00100000:0.0:1746065190.007063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.007345:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151232 00000100:00100000:3.0:1746065190.007351:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151232 00002000:00100000:3.0:1746065190.007378:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1392640->1396735) req@ffff88008ec2e300 x1830881263151232/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.007385:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2e300 with x1830881263151232 ext(1392640->1396735) 00002000:00010000:3.0:1746065190.007389:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2e300 00000100:00100000:3.0:1746065190.007517:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8319 00000100:00100000:3.0:1746065190.007525:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263151232:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065190.007662:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263151232:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 137us (603us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065190.007668:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8319 00002000:00100000:3.0:1746065190.007673:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1392640->1396735) req@ffff88008ec2e300 x1830881263151232/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.007679:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2e300 with x1830881263151232 ext(1392640->1396735) 00002000:00010000:3.0:1746065190.007682:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2e300 00000100:00100000:0.0:1746065190.008132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.008391:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151360 00000100:00100000:2.0:1746065190.008395:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151360 00000100:00080000:3.0:1746065190.008676:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065190.008718:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14775 00000100:00100000:2.0:1746065190.008725:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:31894:x1830881263151360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065190.008735:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.008758:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fe7 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.008779:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 42 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.008786:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 33 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.008791:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.008793:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.008796:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1249280->1429503] (req 1249280->1429503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 42 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.008846:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 33 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.008856:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 33 pid: 2462 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.008869:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260387584:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.009407:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 42 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.009416:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 42 pid: 8851 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.009423:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260387712:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.009455:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4600 going to sleep for 11 seconds 00010000:00010000:3.0:1746065190.010309:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065190.011417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.011440:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260387584:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.011449:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260387712:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.011468:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1249280->1429503] (req 1249280->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 42 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.011479:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f503400, rc 0) 00000100:00100000:0.0:1746065190.011482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.011509:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:31894:x1830881263151360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2785us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.011516:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14775 00000100:00100000:3.0:1746065190.011584:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151488 00000100:00100000:3.0:1746065190.011589:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151488 00010000:00010000:3.0:1746065190.011611:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 34 pid: 2462 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.011630:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151616 00000100:00100000:3.0:1746065190.011632:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151616 00010000:00010000:3.0:1746065190.011638:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 42 pid: 8851 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.011648:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7576 00000100:00100000:3.0:1746065190.012972:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263151488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065190.012989:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065190.013012:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 34 pid: 2462 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065190.013024:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 34 pid: 2462 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065190.013042:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd4e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f23 expref: 34 pid: 2462 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.013065:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7577 00000100:00100000:2.0:1746065190.013072:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1960:x1830881263151616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065190.013074:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065190.013079:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.013088:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 42 pid: 8851 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.013096:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 42 pid: 8851 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.013099:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263151488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1446us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.013105:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7576 00010000:00010000:2.0:1746065190.013107:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec29200/0x14b4f8542d4fd4a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ef2 expref: 42 pid: 8851 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.013114:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.013115:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.013120:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 41 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.013126:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 41 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.013148:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 41 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.013159:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260387840:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065190.013215:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab4600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.014570:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260387840:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.014588:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.014618:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263151616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1546us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.014625:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7577 00000100:00100000:0.0:1746065190.015467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.016667:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263151872 00000100:00100000:2.0:1746065190.016676:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263151872 00002000:00100000:2.0:1746065190.016717:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1249280->1253375) req@ffff88009fa75880 x1830881263151872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.016725:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75880 with x1830881263151872 ext(1249280->1253375) 00002000:00010000:2.0:1746065190.016729:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75880 00000100:00100000:3.0:1746065190.016862:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8320 00000100:00100000:3.0:1746065190.016871:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263151872:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065190.017012:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263151872:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 142us (1547us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065190.017019:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8320 00002000:00100000:3.0:1746065190.017024:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1249280->1253375) req@ffff88009fa75880 x1830881263151872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.017030:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75880 with x1830881263151872 ext(1249280->1253375) 00002000:00010000:3.0:1746065190.017033:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75880 00000100:00100000:0.0:1746065190.020337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.021115:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152128 00000100:00100000:3.0:1746065190.021123:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152128 00002000:00100000:3.0:1746065190.021154:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1425408->1429503) req@ffff88009fa75500 x1830881263152128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.021163:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75500 with x1830881263152128 ext(1425408->1429503) 00002000:00010000:3.0:1746065190.021167:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75500 00000100:00100000:3.0:1746065190.021191:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8321 00000100:00100000:3.0:1746065190.021197:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263152128:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065190.021335:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263152128:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 137us (1004us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065190.021340:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8321 00002000:00100000:3.0:1746065190.021345:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1425408->1429503) req@ffff88009fa75500 x1830881263152128/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.021351:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75500 with x1830881263152128 ext(1425408->1429503) 00002000:00010000:3.0:1746065190.021354:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75500 00000100:00100000:0.0:1746065190.023034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.023311:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152384 00000100:00100000:3.0:1746065190.023317:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152384 00000100:00100000:3.0:1746065190.023356:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4293 00000100:00100000:3.0:1746065190.023363:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31894:x1830881263152384:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065190.023542:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31894:x1830881263152384:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 179us (512us total) trans 8589944257 rc 0/0 00000100:00100000:3.0:1746065190.023591:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4293 00000100:00100000:0.0:1746065190.117329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.117359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.118285:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152640 00000100:00100000:0.0:1746065190.118294:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152640 00000100:00100000:0.0:1746065190.118305:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263152896 00000100:00100000:0.0:1746065190.118307:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263152896 00000100:00100000:0.0:1746065190.118336:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10005 00000100:00100000:0.0:1746065190.118343:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31902:x1830881263152896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065190.118364:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.118378:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25aa00/0x14b4f8542d4fd61b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ff5 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.118455:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118466:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118475:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118485:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118490:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118495:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118573:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25b000/0x14b4f8542d4fd630 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118580:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25b000/0x14b4f8542d4fd630 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118585:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25b000/0x14b4f8542d4fd630 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065190.118591:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065190.118654:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118660:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118665:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.118672:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25ac00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065190.118675:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120887:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120902:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065190.120904:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065190.120908:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120914:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ac00/0x14b4f8542d4fd622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120929:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120934:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120938:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120942:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25a600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065190.120945:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120950:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120956:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669900) 00010000:00010000:0.0:1746065190.120957:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065190.120960:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.120964:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25a600/0x14b4f8542d4fd629 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065190.123341:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25aa00/0x14b4f8542d4fd61b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ff5 expref: 257 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.123360:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25b000/0x14b4f8542d4fd630 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ff5 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.123368:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065190.123370:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065190.123373:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25b000, rc 0) 00000100:00100000:1.0:1746065190.134848:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31902:x1830881263152896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 16492us (17475us total) trans 8589944258 rc 0/0 00000100:00100000:1.0:1746065190.134859:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10005 00000100:00100000:1.0:1746065190.135054:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10006 00000100:00100000:1.0:1746065190.135061:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:31901:x1830881263152640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.135080:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.135096:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54200/0x14b4f8542d4fd63e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60fee expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.135182:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135196:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135206:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135218:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135222:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135227:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135310:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55200/0x14b4f8542d4fd653 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135317:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55200/0x14b4f8542d4fd653 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135323:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55200/0x14b4f8542d4fd653 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065190.135330:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065190.135395:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135401:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135405:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135413:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac54a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065190.135417:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135422:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135430:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065190.135433:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065190.135436:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135440:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fd645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135452:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135457:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135461:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135464:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac55400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065190.135466:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135471:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135476:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6f000) 00010000:00010000:1.0:1746065190.135477:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065190.135480:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135484:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fd64c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.135511:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54200/0x14b4f8542d4fd63e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fee expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.135520:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55200/0x14b4f8542d4fd653 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fee expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.135525:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.135527:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065190.135529:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55200, rc 0) 00000100:00100000:1.0:1746065190.143257:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:31901:x1830881263152640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8185us (25924us total) trans 8589944259 rc 0/0 00000100:00100000:1.0:1746065190.143266:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10006 00000100:00100000:0.0:1746065190.144911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.144940:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.144960:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153024 00000100:00100000:0.0:1746065190.144967:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153024 00000100:00100000:0.0:1746065190.145005:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 776 00000100:00100000:0.0:1746065190.145011:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1959:x1830881263153024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.145022:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065190.145041:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25b000/0x14b4f8542d4fd630 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ff5 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.145054:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065190.145057:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065190.145088:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1959:x1830881263153024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.145096:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 776 00000100:00100000:0.0:1746065190.146058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.146074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.146096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.146113:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153152 00000100:00100000:0.0:1746065190.146116:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153152 00000100:00100000:0.0:1746065190.146144:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153408 00000100:00100000:0.0:1746065190.146146:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153408 00000100:00100000:0.0:1746065190.146159:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153536 00000100:00100000:0.0:1746065190.146160:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153536 00000100:00100000:0.0:1746065190.146171:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14776 00000100:00100000:2.0:1746065190.146305:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14777 00000100:00100000:2.0:1746065190.146360:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263153408:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065190.148785:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14778 00000100:00100000:1.0:1746065190.148796:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263153536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.148810:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.148834:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fd661 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6100a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.148860:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fd661 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6100a expref: 35 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.148868:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fd661 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6100a expref: 35 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.148880:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55a00, rc 0) 00000100:00100000:1.0:1746065190.148923:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263153536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 130us (2826us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065190.148929:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14778 00000100:00100000:1.0:1746065190.148950:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153280 00000100:00100000:1.0:1746065190.148955:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153280 00000100:00100000:1.0:1746065190.148979:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 777 00000100:00100000:1.0:1746065190.148983:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263153280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.148991:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.149004:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55200/0x14b4f8542d4fd653 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fee expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.149014:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.149017:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.149029:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263153280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.149034:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 777 00010000:00010000:1.0:1746065190.149370:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.149378:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd668 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61003 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.149410:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260387968:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065190.149468:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.149916:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263153152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.150518:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.150530:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac55400/0x14b4f8542d4fd66f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e60ffc expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.150557:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260388096:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065190.150756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.150799:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263153664 00000100:00100000:0.0:1746065190.150803:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263153664 00000100:00100000:0.0:1746065190.150838:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14779 00000100:00100000:0.0:1746065190.150844:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263153664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065190.150850:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.150856:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f25ba00/0x14b4f8542d4fd676 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61011 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.150870:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f25ba00/0x14b4f8542d4fd676 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61011 expref: 42 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.150878:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f25ba00/0x14b4f8542d4fd676 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61011 expref: 42 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.150889:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25ba00, rc 0) 00000100:00100000:0.0:1746065190.150908:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263153664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (153us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065190.150913:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14779 00000100:00100000:1.0:1746065190.151022:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d3c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065190.154617:0:4545:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065189 -> 1746065190 00002000:00010000:1.0:1746065190.154627:0:4545:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065187 -> 1746065190 00002000:00010000:1.0:1746065190.154629:0:4545:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065189 -> 1746065190 00000100:00100000:1.0:1746065190.154650:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260387968:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065190.154677:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd668 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61003 expref: 34 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.154689:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fd668 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61003 expref: 34 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.154698:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55600, rc 0) 00000100:00100000:1.0:1746065190.154757:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+33:1961:x1830881263153408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8443us (8680us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065190.154765:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14777 00002000:00010000:1.0:1746065190.154801:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime: 1746065189 -> 1746065190 00002000:00010000:1.0:1746065190.154804:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime: 1746065189 -> 1746065190 00002000:00010000:1.0:1746065190.154805:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime: 1746065189 -> 1746065190 00000100:00100000:1.0:1746065190.154830:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260388096:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065190.154845:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac55400/0x14b4f8542d4fd66f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ffc expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.154853:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac55400/0x14b4f8542d4fd66f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ffc expref: 35 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.154861:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55400, rc 0) 00000100:00100000:1.0:1746065190.154880:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263153152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8703us (9939us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065190.154885:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14776 00000100:00100000:1.0:1746065190.163464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.163488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.163505:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263154048 00000100:00100000:1.0:1746065190.163511:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263154048 00002000:00100000:1.0:1746065190.163543:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f2c6a00 x1830881263154048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.163551:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6a00 with x1830881263154048 ext(0->1048575) 00002000:00010000:1.0:1746065190.163555:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c6a00 00000100:00100000:1.0:1746065190.163566:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263154176 00000100:00100000:1.0:1746065190.163567:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263154176 00002000:00100000:1.0:1746065190.163575:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f2c5180 x1830881263154176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.163581:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5180 with x1830881263154176 ext(1048576->2097151) 00002000:00010000:1.0:1746065190.163583:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c5180 00000100:00100000:1.0:1746065190.163591:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8322 00000100:00100000:1.0:1746065190.163596:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263154048:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065190.163662:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8323 00000100:00100000:2.0:1746065190.163669:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263154176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.165987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.166011:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.166035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.166060:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263154432 00000100:00100000:0.0:1746065190.166066:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263154432 00002000:00100000:0.0:1746065190.166094:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009fa76a00 x1830881263154432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.166103:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa76a00 with x1830881263154432 ext(0->1048575) 00002000:00010000:0.0:1746065190.166107:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa76a00 00000100:00100000:0.0:1746065190.166120:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263154688 00000100:00100000:0.0:1746065190.166123:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263154688 00000100:00100000:2.0:1746065190.166125:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263154944 00000100:00100000:2.0:1746065190.166128:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263154944 00002000:00100000:0.0:1746065190.166133:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fa74700 x1830881263154688/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.166139:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74700 with x1830881263154688 ext(1048576->2097151) 00002000:00100000:2.0:1746065190.166142:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009fa74380 x1830881263154944/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 504/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746065190.166142:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa74700 00002000:00100000:2.0:1746065190.166149:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74380 with x1830881263154944 ext(1048576->2097151) 00002000:00010000:2.0:1746065190.166151:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa74380 00000100:00100000:0.0:1746065190.166153:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8324 00000100:00100000:0.0:1746065190.166159:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263154432:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065190.166163:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8325 00000100:00100000:2.0:1746065190.166167:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+37:1958:x1830881263154688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.166477:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8326 00000100:00100000:0.0:1746065190.166480:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+37:1958:x1830881263154944:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.187162:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+38:1958:x1830881263154944:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20671us (21117us total) trans 0 rc 995328/995328 00000100:00100000:0.0:1746065190.187173:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8326 00002000:00100000:0.0:1746065190.187184:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009fa74380 x1830881263154944/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 504/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 995328/995328 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.187193:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74380 with x1830881263154944 ext(1048576->2097151) 00002000:00010000:0.0:1746065190.187198:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa74380 00000100:00100000:2.0:1746065190.189413:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+36:1958:x1830881263154688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23238us (23395us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.189423:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8325 00002000:00100000:2.0:1746065190.189431:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fa74700 x1830881263154688/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.189440:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74700 with x1830881263154688 ext(1048576->2097151) 00002000:00010000:2.0:1746065190.189445:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa74700 00000100:00100000:1.0:1746065190.189914:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263154048:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26316us (26454us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065190.189920:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8322 00002000:00100000:1.0:1746065190.189925:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f2c6a00 x1830881263154048/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.189932:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6a00 with x1830881263154048 ext(0->1048575) 00002000:00010000:1.0:1746065190.189935:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c6a00 00000100:00100000:2.0:1746065190.190034:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263154176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26366us (26545us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.190040:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8323 00002000:00100000:2.0:1746065190.190045:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f2c5180 x1830881263154176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.190051:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5180 with x1830881263154176 ext(1048576->2097151) 00002000:00010000:2.0:1746065190.190054:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f2c5180 00000100:00100000:1.0:1746065190.195799:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+33:1959:x1830881263154432:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29634us (29811us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065190.195810:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8324 00002000:00100000:1.0:1746065190.195835:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009fa76a00 x1830881263154432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.195844:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa76a00 with x1830881263154432 ext(0->1048575) 00002000:00010000:1.0:1746065190.195848:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa76a00 00000100:00100000:2.0:1746065190.200493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.200515:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263155072 00000100:00100000:1.0:1746065190.200522:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263155072 00000100:00100000:1.0:1746065190.200553:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14780 00000100:00100000:1.0:1746065190.200560:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:31902:x1830881263155072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.200574:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.200587:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61018 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.200610:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 35 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.200616:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065190.200618:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065190.200621:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.200649:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 35 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.200661:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 35 pid: 4545 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.200671:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260388224:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065190.200752:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.203583:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260388224:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065190.203669:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.203683:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f43c800, rc 0) 00000100:00100000:0.0:1746065190.203715:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:31902:x1830881263155072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3155us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.203722:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14780 00000100:00100000:1.0:1746065190.205374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.205395:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263155200 00000100:00100000:1.0:1746065190.205401:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263155200 00002000:00100000:1.0:1746065190.205431:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1343488->1396735) req@ffff88009f2c4a80 x1830881263155200/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.205439:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4a80 with x1830881263155200 ext(1343488->1396735) 00010000:00010000:1.0:1746065190.205446:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 36 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.205457:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 36 pid: 4545 timeout: 889 lvb_type: 0 00002000:00010000:1.0:1746065190.205464:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c4a80 00000100:00100000:1.0:1746065190.205480:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2533 00000100:00100000:1.0:1746065190.205486:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+36:1960:x1830881263155200:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065190.207790:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+38:1960:x1830881263155200:12345-192.168.202.46@tcp:4:cat.0 Request processed in 2299us (2414us total) trans 17179873641 rc 0/0 00000100:00100000:2.0:1746065190.207799:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2533 00002000:00100000:2.0:1746065190.207807:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1343488->1396735) req@ffff88009f2c4a80 x1830881263155200/t17179873641(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/448 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.207831:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4a80 with x1830881263155200 ext(1343488->1396735) 00010000:00010000:2.0:1746065190.207838:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.207849:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746065190.207856:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f2c4a80 00000100:00100000:0.0:1746065190.208027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.208047:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263155328 00000100:00100000:0.0:1746065190.208052:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263155328 00000100:00100000:0.0:1746065190.208078:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14781 00000100:00100000:0.0:1746065190.208083:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:31901:x1830881263155328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065190.208095:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.208106:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6101f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.208128:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 40 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.208135:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065190.208136:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065190.208139:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.208162:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 40 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.208171:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 40 pid: 4545 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065190.208181:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260388352:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065190.208238:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065190.210206:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260388352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.210226:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.210239:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0f8200, rc 0) 00000100:00100000:3.0:1746065190.210265:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:31901:x1830881263155328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2181us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.210271:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14781 00000100:00100000:2.0:1746065190.210362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.210413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.210431:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263155584 00000100:00100000:3.0:1746065190.210456:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263155456 00000100:00100000:3.0:1746065190.210459:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263155456 00002000:00100000:3.0:1746065190.210481:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1249280->1429503) req@ffff880094a97100 x1830881263155456/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.210489:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a97100 with x1830881263155456 ext(1249280->1429503) 00010000:00010000:3.0:1746065190.210494:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 41 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.210503:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 41 pid: 4545 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065190.210508:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a97100 00000100:00100000:3.0:1746065190.210521:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2534 00000100:00100000:3.0:1746065190.210526:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1959:x1830881263155456:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065190.210728:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263155584 00010000:00010000:1.0:1746065190.210756:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.210774:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7578 00000100:00100000:1.0:1746065190.210779:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+38:1961:x1830881263155584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.210791:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.210804:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.210812:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.210850:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f502200/0x14b4f8542d4fd5ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1396735) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd9 expref: 38 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.210859:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.210861:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.210866:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.210874:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.210893:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.210903:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260388480:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065190.210959:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.213920:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881263155456:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3390us (3555us total) trans 21474840920 rc 0/0 00000100:00100000:2.0:1746065190.213929:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2534 00002000:00100000:2.0:1746065190.213935:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1249280->1429503) req@ffff880094a97100 x1830881263155456/t21474840920(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/448 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.213941:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a97100 with x1830881263155456 ext(1249280->1429503) 00010000:00010000:2.0:1746065190.213947:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 43 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.213956:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 43 pid: 4545 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746065190.213960:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a97100 00000100:00100000:1.0:1746065190.214760:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260388480:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065190.214773:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.214805:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+37:1961:x1830881263155584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4025us (4391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.214812:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7578 00000001:00080000:0.0:1746065190.216565:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873635 is committed 00000001:00080000:0.0:1746065190.216582:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873622 is committed 00000001:00080000:0.0:1746065190.216612:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873639 is committed 00000001:00080000:0.0:1746065190.216619:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873638 is committed 00000001:00080000:0.0:1746065190.216625:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873621 is committed 00000001:00080000:0.0:1746065190.216670:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873640 is committed 00000100:00100000:0.0:1746065190.216861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.216882:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263155712 00000100:00100000:0.0:1746065190.216888:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263155712 00010000:00010000:0.0:1746065190.216910:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 43 pid: 4545 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065190.216931:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7579 00000100:00100000:0.0:1746065190.216938:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881263155712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.216948:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065190.216964:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 43 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.216974:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 43 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.216993:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f503400/0x14b4f8542d4fd614 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1249280->1429503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe7 expref: 43 pid: 4545 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.217003:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.217005:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.217010:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.217017:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.217039:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.217048:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260388608:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065190.217096:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.222407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.222432:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263155968 00000100:00100000:0.0:1746065190.222440:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263155968 00002000:00100000:0.0:1746065190.222471:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094a96680 x1830881263155968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.222486:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96680 with x1830881263155968 ext(1048576->2097151) 00002000:00010000:0.0:1746065190.222490:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a96680 00000100:00100000:0.0:1746065190.222507:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8327 00000100:00100000:0.0:1746065190.222514:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263155968:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.224207:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260388608:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065190.224223:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065190.224261:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1959:x1830881263155712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7323us (7402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.224271:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7579 00000100:00100000:1.0:1746065190.229606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.229937:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263156224 00000100:00100000:0.0:1746065190.229945:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263156224 00000100:00100000:0.0:1746065190.229981:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10007 00000100:00100000:0.0:1746065190.229987:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:31904:x1830881263156224:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065190.230006:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.230021:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35800/0x14b4f8542d4fd68b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61026 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.230097:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230107:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230116:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230125:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230131:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230135:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230246:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34000/0x14b4f8542d4fd6a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230255:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34000/0x14b4f8542d4fd6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230261:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34000/0x14b4f8542d4fd6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065190.230268:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065190.230328:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230334:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230339:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230343:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc34600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065190.230346:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230352:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230361:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065190.230364:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065190.230387:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230391:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34600/0x14b4f8542d4fd692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230400:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.230404:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.231030:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.231036:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc35000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065190.231038:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.231044:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.231051:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669800) 00010000:00010000:0.0:1746065190.231053:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065190.231055:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.231059:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35000/0x14b4f8542d4fd699 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.231169:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc35800/0x14b4f8542d4fd68b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61026 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.231184:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34000/0x14b4f8542d4fd6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61026 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.231190:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065190.231191:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065190.231193:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc34000, rc 0) 00000100:00100000:0.0:1746065190.231250:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:31904:x1830881263156224:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1262us (1648us total) trans 8589944260 rc 0/0 00000100:00100000:0.0:1746065190.231271:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10007 00000100:00100000:2.0:1746065190.233198:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263155968:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10681us (10792us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.233207:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8327 00002000:00100000:2.0:1746065190.233216:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094a96680 x1830881263155968/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.233226:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96680 with x1830881263155968 ext(1048576->2097151) 00002000:00010000:2.0:1746065190.233231:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a96680 00000100:00100000:2.0:1746065190.236049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.236117:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263156480 00000100:00100000:3.0:1746065190.236125:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263156480 00000100:00100000:3.0:1746065190.236160:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4294 00000100:00100000:3.0:1746065190.236167:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:31904:x1830881263156480:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065190.236929:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:31904:x1830881263156480:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 760us (882us total) trans 8589944261 rc 0/0 00000100:00100000:3.0:1746065190.236936:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4294 00000100:00100000:2.0:1746065190.237115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.237172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.237220:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263156864 00000100:00100000:3.0:1746065190.237224:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263156864 00002000:00100000:3.0:1746065190.237247:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88008ec2d500 x1830881263156864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.237255:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2d500 with x1830881263156864 ext(1048576->2097151) 00002000:00010000:3.0:1746065190.237259:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2d500 00000100:00100000:3.0:1746065190.237273:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8328 00000100:00100000:3.0:1746065190.237278:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+34:1960:x1830881263156864:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.240054:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263156608 00000100:00100000:0.0:1746065190.240065:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263156608 00000100:00100000:0.0:1746065190.240106:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 778 00000100:00100000:0.0:1746065190.240113:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263156608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.240125:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065190.240146:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc34000/0x14b4f8542d4fd6a0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61026 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.240161:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065190.240165:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065190.240197:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263156608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (3082us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.240203:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 778 00000100:00100000:1.0:1746065190.247812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.247900:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263156992 00000100:00100000:2.0:1746065190.247907:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263156992 00000100:00100000:2.0:1746065190.248050:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14782 00000100:00100000:2.0:1746065190.248059:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:31902:x1830881263156992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.248072:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.248086:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6102d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.248105:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.248106:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.248112:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 43 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.248125:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 43 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.248133:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d11de00, rc 0) 00000100:00100000:2.0:1746065190.248315:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:31902:x1830881263156992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 256us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.248321:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14782 00000001:00080000:1.0:1746065190.255038:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840918 is committed 00000001:00080000:1.0:1746065190.255072:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840860 is committed 00000001:00080000:1.0:1746065190.255080:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840896 is committed 00000001:00080000:1.0:1746065190.255085:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840893 is committed 00000001:00080000:1.0:1746065190.255127:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840919 is committed 00000001:00080000:1.0:1746065190.255213:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840899 is committed 00000100:00100000:0.0:1746065190.256554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.256631:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157248 00000100:00100000:2.0:1746065190.256638:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157248 00000100:00100000:2.0:1746065190.256681:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10008 00000100:00100000:2.0:1746065190.256688:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:31906:x1830881263157248:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065190.256706:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.256721:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61034 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.257125:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257141:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257374:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257387:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257392:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257397:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257481:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d400/0x14b4f8542d4fd6ca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257489:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d400/0x14b4f8542d4fd6ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257494:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d400/0x14b4f8542d4fd6ca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065190.257500:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065190.257563:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257568:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257573:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257580:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d11d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.257583:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257588:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257597:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065190.257600:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065190.257602:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257606:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d800/0x14b4f8542d4fd6bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257614:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257618:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257623:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257626:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d11d600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.257628:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257632:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257637:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f715600) 00010000:00010000:2.0:1746065190.257639:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065190.257641:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257645:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.257673:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61034 expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.257682:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d400/0x14b4f8542d4fd6ca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61034 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.257687:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.257689:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065190.257691:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d11d400, rc 0) 00000100:00100000:2.0:1746065190.258299:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31906:x1830881263157248:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1610us (1748us total) trans 8589944262 rc 0/0 00000100:00100000:2.0:1746065190.258305:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10008 00000100:00100000:3.0:1746065190.260796:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263156864:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23509us (23615us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.260806:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8328 00002000:00100000:3.0:1746065190.260825:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88008ec2d500 x1830881263156864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.260834:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2d500 with x1830881263156864 ext(1048576->2097151) 00002000:00010000:3.0:1746065190.260839:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2d500 00000100:00100000:0.0:1746065190.264755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.265299:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157504 00000100:00100000:3.0:1746065190.265310:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157504 00002000:00100000:3.0:1746065190.265761:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009b9fdc00 x1830881263157504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.265775:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdc00 with x1830881263157504 ext(1048576->2097151) 00002000:00010000:3.0:1746065190.265782:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fdc00 00000100:00100000:3.0:1746065190.266596:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8329 00000100:00100000:3.0:1746065190.266612:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263157504:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065190.268125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.268235:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.268274:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157632 00000100:00100000:0.0:1746065190.268280:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157632 00000100:00100000:2.0:1746065190.268293:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157760 00000100:00100000:2.0:1746065190.268296:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157760 00000100:00100000:0.0:1746065190.268312:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 779 00000100:00100000:0.0:1746065190.268318:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1960:x1830881263157632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.268328:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065190.268329:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14783 00000100:00100000:2.0:1746065190.268334:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31906:x1830881263157760:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065190.268343:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.268347:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d400/0x14b4f8542d4fd6ca lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61034 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.268353:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6103b expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.268359:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065190.268362:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065190.268386:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1960:x1830881263157632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.268392:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 779 00010000:00010000:2.0:1746065190.268512:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.268525:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.268530:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.268532:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.268535:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3317760->3354623] (req 3317760->3354623) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.268558:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.268568:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 22 pid: 21235 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.268582:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260388736:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.268672:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.268680:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 8 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.268688:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260388864:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.268706:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.281602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.281873:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260388736:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.281886:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260388864:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.281909:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3317760->3354623] (req 3317760->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.281929:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d11c400, rc 0) 00000100:00100000:2.0:1746065190.281971:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31906:x1830881263157760:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 13636us (13735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.281979:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14783 00000100:00100000:1.0:1746065190.282128:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263157888 00000100:00100000:1.0:1746065190.282134:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263157888 00010000:00010000:1.0:1746065190.282156:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 22 pid: 21235 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.282188:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7580 00000100:00100000:1.0:1746065190.282194:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263157888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.282204:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.282220:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 22 pid: 21235 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.282235:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 22 pid: 21235 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.282258:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cfe00/0x14b4f8542d4fd57a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f85 expref: 22 pid: 21235 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.282848:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.282871:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263157888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 677us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.282876:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7580 00000100:00100000:3.0:1746065190.283615:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263157504:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17006us (18872us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.283624:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8329 00002000:00100000:3.0:1746065190.283632:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009b9fdc00 x1830881263157504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.283640:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdc00 with x1830881263157504 ext(1048576->2097151) 00002000:00010000:3.0:1746065190.283644:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fdc00 00000100:00100000:0.0:1746065190.284360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.284392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.284406:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158016 00000100:00100000:1.0:1746065190.284412:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158016 00000100:00100000:0.0:1746065190.284423:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065190.284430:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 9 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065190.284434:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158272 00000100:00100000:3.0:1746065190.284438:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158272 00000100:00100000:1.0:1746065190.284448:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7581 00000100:00100000:1.0:1746065190.284453:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263158016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.284461:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746065190.284467:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009b9ffb80 x1830881263158272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.284474:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ffb80 with x1830881263158272 ext(2097152->3145727) 00010000:00010000:1.0:1746065190.284474:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 9 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065190.284478:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9ffb80 00010000:00010000:1.0:1746065190.284483:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 9 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065190.284496:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8330 00010000:00010000:1.0:1746065190.284497:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f25a000/0x14b4f8542d4fd573 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f7e expref: 9 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065190.284502:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263158272:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:1.0:1746065190.284507:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.284509:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.284515:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.284522:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.284545:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.284554:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260388992:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065190.284597:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.284701:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158400 00000100:00100000:2.0:1746065190.284704:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158400 00000100:00100000:2.0:1746065190.284724:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14784 00000100:00100000:2.0:1746065190.284728:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:31904:x1830881263158400:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065190.284736:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.284755:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61042 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.284772:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 20 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.284780:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.284785:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.284786:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.284789:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 5/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1552384->1961983] (req 1552384->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.284809:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 10 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.284839:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 10 pid: 4544 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.284847:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260389120:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.284878:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 20 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.284890:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 20 pid: 2462 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.284897:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260389248:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.284913:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065190.287574:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260388992:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065190.287592:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.287634:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263158016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3179us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.287643:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7581 00000100:00100000:2.0:1746065190.288845:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260389120:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.288854:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260389248:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.288873:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1552384->1961983] (req 1552384->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.288885:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d11da00, rc 0) 00000100:00100000:2.0:1746065190.289284:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:31904:x1830881263158400:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4553us (4859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.289594:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14784 00000100:00100000:0.0:1746065190.293649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.294368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.294399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.294419:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158528 00000100:00100000:1.0:1746065190.294426:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158528 00010000:00010000:1.0:1746065190.294453:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 9 pid: 4544 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746065190.294475:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158784 00000100:00100000:1.0:1746065190.294477:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158784 00010000:00010000:1.0:1746065190.294486:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 21 pid: 2462 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746065190.294500:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7582 00000100:00100000:1.0:1746065190.294506:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263158528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.294516:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.294533:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 9 pid: 4544 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.294543:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 9 pid: 4544 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.294561:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec28400/0x14b4f8542d4fd4d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f15 expref: 9 pid: 4544 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.294573:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065190.294587:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7583 00000100:00100000:3.0:1746065190.294596:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263158784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065190.294606:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065190.294606:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263158528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.294613:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7582 00010000:00010000:3.0:1746065190.294615:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 21 pid: 2462 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065190.294625:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 21 pid: 2462 timeout: 889 lvb_type: 1 00010000:00010000:3.0:1746065190.294637:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd49a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60ee4 expref: 21 pid: 2462 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746065190.294881:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263158912 00000100:00100000:1.0:1746065190.294885:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263158912 00002000:00100000:1.0:1746065190.294906:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3317760->3321855) req@ffff880095350700 x1830881263158912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.294914:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350700 with x1830881263158912 ext(3317760->3321855) 00002000:00010000:1.0:1746065190.294918:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350700 00000100:00100000:1.0:1746065190.294935:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8331 00000100:00100000:1.0:1746065190.294941:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263158912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065190.295091:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263158912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 150us (1450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065190.295097:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8331 00002000:00100000:1.0:1746065190.295101:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3317760->3321855) req@ffff880095350700 x1830881263158912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.295109:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350700 with x1830881263158912 ext(3317760->3321855) 00002000:00010000:1.0:1746065190.295111:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350700 00010000:00010000:3.0:1746065190.295238:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.295240:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.295247:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.295255:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.295282:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.295292:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260389376:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065190.295332:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.299316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.299447:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263159040 00000100:00100000:2.0:1746065190.299454:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263159040 00000100:00100000:2.0:1746065190.299498:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14785 00000100:00100000:2.0:1746065190.299505:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:31902:x1830881263159040:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.299520:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.299536:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61049 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.299563:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 11 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.299570:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065190.299571:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065190.299574:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.299600:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 11 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.299610:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 11 pid: 21235 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.299621:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260389504:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.299701:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065190.300943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.302071:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263159296 00000100:00100000:0.0:1746065190.302077:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263159296 00000100:00100000:3.0:1746065190.302112:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263158272:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17509us (17618us total) trans 0 rc 1048576/1048576 00002000:00100000:0.0:1746065190.302112:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1552384->1556479) req@ffff88009f144000 x1830881263159296/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.302120:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f144000 with x1830881263159296 ext(1552384->1556479) 00000100:00100000:3.0:1746065190.302122:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8330 00002000:00010000:0.0:1746065190.302124:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f144000 00002000:00100000:3.0:1746065190.302130:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009b9ffb80 x1830881263158272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065190.302139:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8332 00000100:00100000:0.0:1746065190.302145:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263159296:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065190.302251:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260389376:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065190.302263:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263159296:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 118us (1322us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065190.302269:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8332 00010000:00010000:2.0:1746065190.302270:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746065190.302273:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1552384->1556479) req@ffff88009f144000 x1830881263159296/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.302279:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f144000 with x1830881263159296 ext(1552384->1556479) 00002000:00010000:0.0:1746065190.302282:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f144000 00000100:00100000:2.0:1746065190.302290:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263158784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7697us (7891us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.302298:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7583 00000100:00100000:2.0:1746065190.302325:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260389504:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065190.302338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065190.302340:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.302354:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263159552 00000100:00100000:1.0:1746065190.302357:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263159552 00002000:00100000:3.0:1746065190.302360:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ffb80 with x1830881263158272 ext(2097152->3145727) 00010000:00010000:3.0:1746065190.302367:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 10 pid: 21235 timeout: 889 lvb_type: 0 00002000:00100000:1.0:1746065190.302372:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3350528->3354623) req@ffff880095353800 x1830881263159552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065190.302378:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 10 pid: 21235 timeout: 889 lvb_type: 0 00002000:00100000:1.0:1746065190.302379:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353800 with x1830881263159552 ext(3350528->3354623) 00002000:00010000:1.0:1746065190.302381:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353800 00002000:00010000:3.0:1746065190.302384:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9ffb80 00000100:00100000:1.0:1746065190.302391:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8333 00000100:00100000:1.0:1746065190.302396:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263159552:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065190.302497:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263159552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 100us (159us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065190.302503:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8333 00002000:00100000:1.0:1746065190.302507:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3350528->3354623) req@ffff880095353800 x1830881263159552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.302513:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353800 with x1830881263159552 ext(3350528->3354623) 00002000:00010000:1.0:1746065190.302515:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353800 00010000:00010000:2.0:1746065190.302652:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d11d600, rc 0) 00000100:00100000:2.0:1746065190.302688:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:31902:x1830881263159040:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3184us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.302695:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14785 00000100:00100000:0.0:1746065190.302854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.302885:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263159680 00000100:00100000:2.0:1746065190.302889:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263159680 00002000:00100000:2.0:1746065190.302905:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3239935) req@ffff880095352d80 x1830881263159680/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.302913:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352d80 with x1830881263159680 ext(3145728->3239935) 00010000:00010000:2.0:1746065190.302917:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 10 pid: 21235 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.302925:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 10 pid: 21235 timeout: 889 lvb_type: 0 00002000:00010000:2.0:1746065190.302930:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095352d80 00000100:00100000:2.0:1746065190.302941:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2535 00000100:00100000:2.0:1746065190.302946:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263159680:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065190.306078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.306143:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263159936 00000100:00100000:3.0:1746065190.306150:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263159936 00000100:00100000:3.0:1746065190.306193:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4295 00000100:00100000:3.0:1746065190.306200:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31906:x1830881263159936:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065190.306697:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31906:x1830881263159936:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 495us (624us total) trans 8589944263 rc 0/0 00000100:00100000:3.0:1746065190.306703:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4295 00000100:00100000:0.0:1746065190.309001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.309043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.309260:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263160192 00000100:00100000:1.0:1746065190.309266:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263160192 00002000:00100000:1.0:1746065190.309295:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1957888->1961983) req@ffff880095353100 x1830881263160192/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.309303:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881263160192 ext(1957888->1961983) 00002000:00010000:1.0:1746065190.309308:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353100 00000100:00100000:1.0:1746065190.309324:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8334 00000100:00100000:1.0:1746065190.309329:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263160192:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065190.309437:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263160192:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 108us (443us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065190.309443:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8334 00002000:00100000:1.0:1746065190.309447:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1957888->1961983) req@ffff880095353100 x1830881263160192/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.309453:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353100 with x1830881263160192 ext(1957888->1961983) 00002000:00010000:1.0:1746065190.309456:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353100 00000100:00100000:3.0:1746065190.309515:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263159680:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 6568us (6660us total) trans 21474840921 rc 0/0 00000100:00100000:3.0:1746065190.309521:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2535 00002000:00100000:3.0:1746065190.309525:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3239935) req@ffff880095352d80 x1830881263159680/t21474840921(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/448 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.309531:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352d80 with x1830881263159680 ext(3145728->3239935) 00010000:00010000:3.0:1746065190.309537:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 12 pid: 21235 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.309552:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 12 pid: 21235 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065190.309557:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095352d80 00000100:00100000:2.0:1746065190.309734:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263160320 00000100:00100000:2.0:1746065190.309746:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263160320 00000100:00100000:2.0:1746065190.309768:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14786 00000100:00100000:2.0:1746065190.309774:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:31901:x1830881263160320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.309781:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.309794:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61050 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.309811:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.309833:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065190.309835:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065190.309838:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.309863:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.309871:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 19 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.309881:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260389632:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.309931:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.313645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.314543:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263160448 00000100:00100000:2.0:1746065190.314552:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263160448 00010000:00010000:2.0:1746065190.314584:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 12 pid: 21235 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.314613:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7584 00000100:00100000:2.0:1746065190.314620:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263160448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.314631:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065190.314650:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065190 -> 1746065191 00010000:00010000:2.0:1746065190.314656:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 12 pid: 21235 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.314665:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 12 pid: 21235 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.314685:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6cfc00/0x14b4f8542d4fd581 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->3239935) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f8c expref: 12 pid: 21235 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.314703:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.314704:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.314711:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.314718:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.314756:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.314768:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260389760:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065190.314857:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065190.314935:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260389632:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.314957:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.314967:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d11c600, rc 0) 00000100:00100000:3.0:1746065190.314988:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:31901:x1830881263160320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5214us (5944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.314995:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14786 00000100:00100000:0.0:1746065190.316160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.316230:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263160576 00000100:00100000:3.0:1746065190.316235:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263160576 00002000:00100000:3.0:1746065190.316266:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3317760->3354623) req@ffff880095350000 x1830881263160576/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.316274:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350000 with x1830881263160576 ext(3317760->3354623) 00010000:00010000:3.0:1746065190.316280:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 20 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.316291:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 20 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065190.316296:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095350000 00000100:00100000:3.0:1746065190.316311:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2536 00000100:00100000:3.0:1746065190.316317:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263160576:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065190.318581:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260389760:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065190.318599:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065190.318646:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263160448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4025us (5008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.318656:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7584 00000100:00100000:3.0:1746065190.319463:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263160576:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3144us (3304us total) trans 17179873642 rc 0/0 00000100:00100000:3.0:1746065190.319470:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2536 00002000:00100000:3.0:1746065190.319478:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3317760->3354623) req@ffff880095350000 x1830881263160576/t17179873642(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/448 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.319487:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350000 with x1830881263160576 ext(3317760->3354623) 00010000:00010000:3.0:1746065190.319577:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 22 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.319590:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 22 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065190.319597:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095350000 00000100:00100000:0.0:1746065190.320061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.320130:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263160832 00000100:00100000:3.0:1746065190.320136:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263160832 00002000:00100000:3.0:1746065190.320156:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880095353b80 x1830881263160832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.320163:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353b80 with x1830881263160832 ext(2097152->3145727) 00002000:00010000:3.0:1746065190.320166:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095353b80 00000100:00100000:3.0:1746065190.320190:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8335 00000100:00100000:3.0:1746065190.320196:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263160832:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065190.320430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.320466:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263160960 00000100:00100000:2.0:1746065190.320470:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263160960 00010000:00010000:2.0:1746065190.320487:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 22 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.320513:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7585 00000100:00100000:2.0:1746065190.320519:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263160960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.320528:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065190.320541:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065190 -> 1746065191 00002000:00010000:2.0:1746065190.320544:0:10991:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065190 -> 1746065191 00010000:00010000:2.0:1746065190.320549:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 22 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.320563:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 22 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.320582:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d11c400/0x14b4f8542d4fd6d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3317760->3354623) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6103b expref: 22 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.320593:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.320594:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.320601:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.320608:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.320637:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.320648:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260389888:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065190.320715:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.322987:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260389888:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.323003:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.323036:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263160960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2516us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.323046:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7585 00000100:00100000:0.0:1746065190.325713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.326029:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263161216 00000100:00100000:2.0:1746065190.326037:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263161216 00002000:00100000:2.0:1746065190.326077:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880095350380 x1830881263161216/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.326085:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350380 with x1830881263161216 ext(2097152->3145727) 00002000:00010000:2.0:1746065190.326091:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350380 00000100:00100000:2.0:1746065190.326125:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8336 00000100:00100000:2.0:1746065190.326133:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263161216:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065190.328180:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263160832:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7977us (8114us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.328190:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8335 00002000:00100000:3.0:1746065190.328198:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880095353b80 x1830881263160832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.328207:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353b80 with x1830881263160832 ext(2097152->3145727) 00002000:00010000:3.0:1746065190.328211:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095353b80 00000100:00100000:0.0:1746065190.333993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.334086:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263161344 00000100:00100000:3.0:1746065190.334094:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263161344 00000100:00100000:3.0:1746065190.334138:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14787 00000100:00100000:3.0:1746065190.334463:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31902:x1830881263161344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.334482:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.334499:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61057 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.334521:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.334523:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.334529:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.334542:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.334551:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b1800, rc 0) 00000100:00100000:3.0:1746065190.334708:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31902:x1830881263161344:12345-192.168.202.46@tcp:101:cat.0 Request processed in 561us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.334714:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14787 00000100:00100000:2.0:1746065190.342332:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263161216:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 16191us (16617us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.342342:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8336 00002000:00100000:2.0:1746065190.342352:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880095350380 x1830881263161216/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.342366:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350380 with x1830881263161216 ext(2097152->3145727) 00002000:00010000:2.0:1746065190.342370:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350380 00000100:00100000:0.0:1746065190.345086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.345240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.345279:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263161600 00000100:00100000:2.0:1746065190.345287:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263161600 00002000:00100000:2.0:1746065190.345324:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880095353480 x1830881263161600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.345333:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353480 with x1830881263161600 ext(2097152->3145727) 00002000:00010000:2.0:1746065190.345338:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353480 00000100:00100000:2.0:1746065190.345362:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263161856 00000100:00100000:2.0:1746065190.345365:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263161856 00002000:00100000:2.0:1746065190.345376:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880095350e00 x1830881263161856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.345382:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350e00 with x1830881263161856 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.345385:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350e00 00000100:00100000:2.0:1746065190.345402:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8337 00000100:00100000:2.0:1746065190.345409:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263161600:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.345499:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8338 00000100:00100000:3.0:1746065190.345508:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263161856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.349056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.349132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.349252:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263162112 00000100:00100000:2.0:1746065190.349260:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263162112 00002000:00100000:2.0:1746065190.349295:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880095351180 x1830881263162112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.349305:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351180 with x1830881263162112 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.349310:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351180 00000100:00100000:2.0:1746065190.349346:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8339 00000100:00100000:2.0:1746065190.349353:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263162112:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.349390:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263162240 00000100:00100000:3.0:1746065190.349394:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263162240 00000100:00100000:3.0:1746065190.349416:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14788 00000100:00100000:3.0:1746065190.349422:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:31901:x1830881263162240:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.349431:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.349446:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6105e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.349462:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.349464:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.349470:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.349483:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.349491:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b0000, rc 0) 00000100:00100000:3.0:1746065190.349529:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:31901:x1830881263162240:12345-192.168.202.46@tcp:101:cat.0 Request processed in 107us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.349535:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14788 00000100:00100000:3.0:1746065190.358326:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263161600:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12906us (13236us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.358342:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8337 00002000:00100000:3.0:1746065190.358354:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880095353480 x1830881263161600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.358364:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095353480 with x1830881263161600 ext(2097152->3145727) 00002000:00010000:3.0:1746065190.358370:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095353480 00000100:00100000:0.0:1746065190.360709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.360757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.360777:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263162624 00000100:00100000:2.0:1746065190.360785:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263162624 00002000:00100000:2.0:1746065190.360830:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800a90ae680 x1830881263162624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.360839:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ae680 with x1830881263162624 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.360843:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ae680 00000100:00100000:2.0:1746065190.360857:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263162752 00000100:00100000:2.0:1746065190.360860:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263162752 00002000:00100000:2.0:1746065190.360873:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800a90ad880 x1830881263162752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.360879:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad880 with x1830881263162752 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.360881:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ad880 00000100:00100000:2.0:1746065190.360892:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8340 00000100:00100000:2.0:1746065190.360898:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263162624:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065190.360898:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8341 00000100:00100000:1.0:1746065190.360904:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263162752:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065190.360987:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263161856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15479us (15745us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.360995:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8338 00002000:00100000:3.0:1746065190.361001:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880095350e00 x1830881263161856/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.361007:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095350e00 with x1830881263161856 ext(3145728->4194303) 00002000:00010000:3.0:1746065190.361011:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095350e00 00000100:00100000:2.0:1746065190.366054:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263162112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16692us (17041us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.366065:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8339 00002000:00100000:2.0:1746065190.366075:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880095351180 x1830881263162112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.366084:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351180 with x1830881263162112 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.366089:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351180 00000100:00100000:0.0:1746065190.366953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.367024:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263162880 00000100:00100000:2.0:1746065190.367030:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263162880 00000100:00100000:2.0:1746065190.367174:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10009 00000100:00100000:2.0:1746065190.367181:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:31909:x1830881263162880:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065190.367198:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.367214:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4fd702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61065 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.367271:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.367282:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.367292:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.367303:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.367309:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.367314:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.367405:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.367414:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.367422:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.367449:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.367462:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 14 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.367471:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260390016:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.368281:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.369730:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263162752:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8819us (8966us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.369753:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8341 00002000:00100000:2.0:1746065190.369763:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800a90ad880 x1830881263162752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.369772:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad880 with x1830881263162752 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.369776:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90ad880 00000100:00100000:0.0:1746065190.370372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.370428:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163136 00000100:00100000:3.0:1746065190.370436:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163136 00000100:00100000:3.0:1746065190.370478:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4296 00000100:00100000:3.0:1746065190.370485:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094492450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:31256:x1830881263163136:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065190.370661:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094492450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:31256:x1830881263163136:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 176us (290us total) trans 8589944264 rc 0/0 00000100:00100000:3.0:1746065190.370667:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4296 00000100:00100000:2.0:1746065190.370810:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260390016:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.370892:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065190.372293:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263162624:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11391us (11589us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.372302:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8340 00002000:00100000:2.0:1746065190.372310:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800a90ae680 x1830881263162624/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.372318:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ae680 with x1830881263162624 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.372322:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ae680 00000100:00100000:0.0:1746065190.374660:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.374891:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163264 00000100:00100000:3.0:1746065190.374899:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163264 00000100:00100000:3.0:1746065190.374932:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14789 00000100:00100000:3.0:1746065190.374939:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263163264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.374955:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.374972:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fd71e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6106c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.375016:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260390144:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065190.375084:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.375192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.375298:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163392 00000100:00100000:3.0:1746065190.375302:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163392 00010000:00010000:3.0:1746065190.375318:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 16 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065190.375336:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7586 00000100:00100000:3.0:1746065190.375341:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263163392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065190.375350:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065190.375355:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 16 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.375365:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 16 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.375381:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc83c00/0x14b4f8542d4fd503 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f38 expref: 16 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.375395:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.375400:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.375408:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.375414:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.375429:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065190.375449:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263163392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.375454:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7586 00010000:00010000:2.0:1746065190.375945:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.375953:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065190.375988:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065190.375992:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065190.376005:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376014:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376022:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376027:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376031:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376036:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944f3400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.376039:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376044:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376053:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065190.376056:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065190.376058:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376066:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3400/0x14b4f8542d4fd709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376085:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376090:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376094:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376098:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944f2200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.376101:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376105:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376110:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f715600) 00010000:00010000:2.0:1746065190.376112:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065190.376114:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376117:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2200/0x14b4f8542d4fd710 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.376144:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3c00/0x14b4f8542d4fd702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.376154:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.376163:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.376165:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065190.376166:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f3200, rc 0) 00000100:00100000:2.0:1746065190.376192:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31909:x1830881263162880:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 9011us (9241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.376198:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10009 00002000:00010000:3.0:1746065190.376774:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime: 1746065189 -> 1746065191 00002000:00010000:3.0:1746065190.376777:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065189 -> 1746065191 00002000:00010000:3.0:1746065190.376779:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime: 1746065189 -> 1746065191 00000100:00100000:3.0:1746065190.376794:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260390144:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065190.376837:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fd71e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6106c expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.376848:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fd71e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6106c expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.376855:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b0400, rc 0) 00000100:00100000:3.0:1746065190.376876:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263163264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1938us (2224us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065190.376882:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14789 00000100:00100000:0.0:1746065190.377645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.377702:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163520 00000100:00100000:3.0:1746065190.377707:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163520 00000100:00100000:3.0:1746065190.377727:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14790 00000100:00100000:3.0:1746065190.377732:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1959:x1830881263163520:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065190.377753:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.377766:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61073 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.377779:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.377781:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.377787:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.377799:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 7 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.377806:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f12d600, rc 0) 00000100:00100000:3.0:1746065190.377920:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263163520:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 186us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.377925:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14790 00000100:00100000:0.0:1746065190.379419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.379515:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163776 00000100:00100000:3.0:1746065190.379647:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163776 00000100:00100000:3.0:1746065190.379689:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14791 00000100:00100000:3.0:1746065190.379695:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881263163776:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065190.379706:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.379718:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f12c200/0x14b4f8542d4fd72c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61081 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.379762:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260390272:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065190.379846:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.380365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.380382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.380415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.380428:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163904 00000100:00100000:0.0:1746065190.380432:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163904 00000100:00100000:0.0:1746065190.380446:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263164032 00000100:00100000:0.0:1746065190.380448:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263164032 00000100:00100000:0.0:1746065190.380457:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263163648 00000100:00100000:0.0:1746065190.380458:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263163648 00000100:00100000:0.0:1746065190.380469:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14792 00000100:00100000:0.0:1746065190.380474:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263163904:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065190.380480:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.380488:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61088 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.380541:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.380543:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065190.380548:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14793 00010000:00010000:0.0:1746065190.380549:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065190.380555:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263164032:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065190.380561:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.380561:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.380568:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003a200, rc 0) 00010000:00010000:2.0:1746065190.380569:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6108f expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.380578:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.380579:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.380583:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065190.380590:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263163904:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 116us (226us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065190.380591:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 8 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065190.380594:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14792 00010000:00010000:2.0:1746065190.380597:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f420c00, rc 0) 00000100:00100000:2.0:1746065190.380609:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263164032:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 56us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.380610:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14794 00000100:00100000:2.0:1746065190.380614:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14793 00000100:00100000:0.0:1746065190.380614:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263163648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065190.380619:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.380623:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6107a expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.380632:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.380633:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.380636:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.380644:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.380650:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003ba00, rc 0) 00000100:00100000:0.0:1746065190.380663:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263163648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.380668:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14794 00000100:00100000:0.0:1746065190.380722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.380773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.380839:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263164160 00000100:00100000:0.0:1746065190.380842:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263164160 00000100:00100000:0.0:1746065190.380854:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263164288 00000100:00100000:0.0:1746065190.380856:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263164288 00000100:00100000:0.0:1746065190.380881:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14795 00000100:00100000:0.0:1746065190.380886:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263164160:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065190.380892:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.380898:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61096 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.380908:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.380909:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.380914:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.380922:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065190.380928:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14796 00010000:00010000:0.0:1746065190.380929:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003a000, rc 0) 00000100:00100000:2.0:1746065190.380934:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263164288:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065190.380940:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.380946:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6109d expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.380946:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263164160:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 60us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.380950:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14795 00010000:00010000:2.0:1746065190.380955:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.380956:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.380960:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.380968:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.380974:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f420400, rc 0) 00000100:00100000:2.0:1746065190.380989:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263164288:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 55us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.380993:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14796 00000100:00100000:3.0:1746065190.382812:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260390272:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065190.382863:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f12c200/0x14b4f8542d4fd72c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61081 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.382874:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f12c200/0x14b4f8542d4fd72c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61081 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.382882:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f12c200, rc 0) 00000100:00100000:3.0:1746065190.382922:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263163776:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 3227us (3505us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065190.382928:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14791 00000100:00100000:2.0:1746065190.387315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.387508:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263164544 00000100:00100000:3.0:1746065190.387516:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263164544 00002000:00100000:3.0:1746065190.387561:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5009407) req@ffff88012bd3e300 x1830881263164544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.387571:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e300 with x1830881263164544 ext(4194304->5009407) 00002000:00010000:3.0:1746065190.387576:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3e300 00000100:00100000:3.0:1746065190.387605:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8342 00000100:00100000:3.0:1746065190.387612:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263164544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065190.387879:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.387932:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263164800 00000100:00100000:0.0:1746065190.387935:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263164800 00000100:00100000:0.0:1746065190.387972:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4297 00000100:00100000:0.0:1746065190.387977:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:31901:x1830881263164800:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065190.388138:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:31901:x1830881263164800:12345-192.168.202.46@tcp:35:cat.0 Request processed in 160us (259us total) trans 8589944265 rc 0/0 00000100:00100000:0.0:1746065190.388144:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4297 00000100:00100000:0.0:1746065190.389321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.389416:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165056 00000100:00100000:2.0:1746065190.389423:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165056 00000100:00100000:2.0:1746065190.389462:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10010 00000100:00100000:2.0:1746065190.389468:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31909:x1830881263165056:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065190.389486:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.389623:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610a4 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.389700:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.389711:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.389717:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.389754:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.389765:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 8 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.389775:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260390400:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.390496:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.391093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.391156:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165184 00000100:00100000:1.0:1746065190.391162:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165184 00010000:00010000:1.0:1746065190.391185:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 9 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.391214:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7587 00000100:00100000:1.0:1746065190.391221:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263165184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.391231:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.391235:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 9 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.391244:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 9 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.391260:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.391263:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.391270:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.391275:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.391286:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.391315:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263165184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.391320:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7587 00010000:00010000:2.0:1746065190.391394:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f3200/0x14b4f8542d4fd717 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61065 expref: 8 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.391406:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260390400:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.391416:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.391425:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.391427:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065190.391441:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065190.391522:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420000/0x14b4f8542d4fd756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610a4 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.391529:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610a4 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.391533:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.391535:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065190.391536:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f420200, rc 0) 00000100:00100000:2.0:1746065190.391554:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31909:x1830881263165056:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2086us (2237us total) trans 8589944266 rc 0/0 00000100:00100000:2.0:1746065190.391560:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10010 00000100:00100000:2.0:1746065190.395628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.395655:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165440 00000100:00100000:0.0:1746065190.395663:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165440 00000100:00100000:3.0:1746065190.396072:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263164544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8458us (8762us total) trans 0 rc 815104/815104 00000100:00100000:3.0:1746065190.396081:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8342 00002000:00100000:3.0:1746065190.396090:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5009407) req@ffff88012bd3e300 x1830881263164544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.396099:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e300 with x1830881263164544 ext(4194304->5009407) 00002000:00010000:3.0:1746065190.396103:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3e300 00000100:00100000:0.0:1746065190.396103:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10011 00000100:00100000:0.0:1746065190.396110:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31909:x1830881263165440:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065190.396127:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.396129:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065190.396149:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420200/0x14b4f8542d4fd75d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610a4 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.396162:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065190.396166:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065190.396174:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd76b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610ab expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.396244:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.396254:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065190.396261:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065190.396270:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065190.396360:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd76b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.396370:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.396376:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065190.396378:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065190.396380:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003ae00, rc 0) 00000100:00100000:0.0:1746065190.396400:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31909:x1830881263165440:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 291us (780us total) trans 8589944267 rc 0/0 00000100:00100000:0.0:1746065190.396406:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10011 00000100:00100000:0.0:1746065190.398996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.399101:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165568 00000100:00100000:2.0:1746065190.399109:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165568 00000100:00100000:2.0:1746065190.399152:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10012 00000100:00100000:2.0:1746065190.399159:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31909:x1830881263165568:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065190.399180:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.399195:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420a00/0x14b4f8542d4fd780 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610b2 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.399242:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420a00/0x14b4f8542d4fd780 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610b2 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.399255:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420a00/0x14b4f8542d4fd780 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610b2 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.399275:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.399278:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065190.399281:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f420a00, rc 0) 00000100:00100000:2.0:1746065190.399326:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31909:x1830881263165568:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 167us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.399332:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10012 00000100:00100000:0.0:1746065190.399831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.400357:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165696 00000100:00100000:3.0:1746065190.400363:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165696 00000100:00100000:3.0:1746065190.400398:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14797 00000100:00100000:3.0:1746065190.400404:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263165696:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.400413:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.400423:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f12c400/0x14b4f8542d4fd787 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610b9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.400459:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260390528:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065190.401026:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.401349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.401366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.401380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.401393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.401406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.401427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.401442:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165952 00000100:00100000:0.0:1746065190.401446:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165952 00000100:00100000:0.0:1746065190.401470:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166208 00000100:00100000:0.0:1746065190.401472:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166208 00000100:00100000:0.0:1746065190.401481:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166464 00000100:00100000:0.0:1746065190.401483:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166464 00000100:00100000:0.0:1746065190.401490:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263165824 00000100:00100000:0.0:1746065190.401492:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263165824 00000100:00100000:2.0:1746065190.401497:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166080 00000100:00100000:0.0:1746065190.401499:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166336 00000100:00100000:2.0:1746065190.401500:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166080 00000100:00100000:0.0:1746065190.401501:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166336 00000100:00100000:0.0:1746065190.401510:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14798 00000100:00100000:2.0:1746065190.401514:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14799 00000100:00100000:0.0:1746065190.401515:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263165952:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065190.401518:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263166208:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065190.401537:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401537:0:2463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401548:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.401549:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.401555:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.401555:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065190.401557:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065190.401559:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.401561:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.401565:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.401566:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.401567:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401577:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.401584:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401586:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 9 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.401590:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065190.401595:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260390656:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.401597:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260390784:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065190.401625:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.401639:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14800 00000100:00100000:0.0:1746065190.401645:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263166464:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065190.401658:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401666:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401672:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.401678:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401683:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.401684:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.401686:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401702:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.401710:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 23 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065190.401718:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260390912:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.401775:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14801 00000100:00100000:3.0:1746065190.401782:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263165824:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065190.401798:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.401807:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.401828:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.401835:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.401840:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.401841:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.401843:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.401866:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.401875:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 11 pid: 8428 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.401883:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260391040:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.401916:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.401925:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.401932:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260391168:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.401949:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.401955:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.401961:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260391296:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.401972:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.401984:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14802 00000100:00100000:2.0:1746065190.401989:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263166336:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065190.402002:0:2462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402011:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402017:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.402023:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402028:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402034:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402039:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065190.402040:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065190.402041:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 8/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402054:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402062:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.402069:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260391424:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065190.402074:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14803 00000100:00100000:1.0:1746065190.402080:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263166080:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065190.402094:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.402094:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402101:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.402102:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.402107:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260391552:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065190.402113:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.402119:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.402123:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.402124:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.402125:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.402127:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.402129:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.402135:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260391680:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065190.402140:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.402146:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 10 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.402151:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065190.402153:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260391808:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.402158:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 11 pid: 21998 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.402166:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260391936:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065190.402173:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.402180:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 9 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.402181:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.402187:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260392064:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.402188:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.402194:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260392192:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065190.402202:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.402203:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065190.402209:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 23 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.402215:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260392320:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065190.402226:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065190.402489:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.402496:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 10 pid: 9716 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746065190.402503:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260392448:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065190.402522:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.402529:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 9 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065190.402535:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260392576:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065190.402546:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065190.403084:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 11 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.403092:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 11 pid: 8851 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.403100:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260392704:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.403123:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.403129:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 15 pid: 25185 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.403134:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260392832:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.403144:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880131be6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.403276:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260390528:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065190.403296:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f12c400/0x14b4f8542d4fd787 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610b9 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.403305:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f12c400/0x14b4f8542d4fd787 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610b9 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.403314:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f12c400, rc 0) 00000100:00100000:2.0:1746065190.403335:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263165696:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2930us (3520us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065190.403341:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14797 00000100:00100000:1.0:1746065190.409299:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260391808:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.409374:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260390784:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.409385:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260391168:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.409392:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260391296:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.409419:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.409456:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260392064:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065190.409472:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260392320:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065190.409480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.409497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.409509:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065190.409510:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.409520:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.409528:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166976 00000100:00100000:0.0:1746065190.409529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.409533:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166976 00000100:00100000:0.0:1746065190.409540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.409553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065190.409556:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 16 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065190.409565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.409575:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167232 00000100:00100000:1.0:1746065190.409576:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167232 00000100:00100000:0.0:1746065190.409578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065190.409583:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 17 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.409591:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167488 00000100:00100000:1.0:1746065190.409593:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167488 00010000:00010000:1.0:1746065190.409599:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 10 pid: 2463 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746065190.409602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.409607:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167104 00000100:00100000:1.0:1746065190.409608:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167104 00010000:00010000:1.0:1746065190.409615:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 11 pid: 2463 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746065190.409620:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260390912:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065190.409622:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167360 00000100:00100000:1.0:1746065190.409623:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167360 00010000:00010000:1.0:1746065190.409629:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 12 pid: 21998 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746065190.409632:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260392448:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065190.409636:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167872 00000100:00100000:1.0:1746065190.409637:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167872 00010000:00010000:1.0:1746065190.409643:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 12 pid: 9716 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746065190.409650:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168000 00000100:00100000:1.0:1746065190.409652:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168000 00010000:00010000:1.0:1746065190.409664:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 22 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.409672:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168256 00000100:00100000:1.0:1746065190.409674:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168256 00010000:00010000:1.0:1746065190.409680:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 23 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.409690:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7588 00000100:00100000:1.0:1746065190.409695:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263166976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.409706:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.409724:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 17 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.409734:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 17 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.409762:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d11de00/0x14b4f8542d4fd6ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6102d expref: 17 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.409777:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.409807:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263166976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.409838:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7588 00000100:00100000:1.0:1746065190.409855:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7589 00000100:00100000:1.0:1746065190.409859:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263167232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.409865:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.409874:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.409881:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.409891:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.409906:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263167232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.409914:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7589 00000100:00100000:1.0:1746065190.409925:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7590 00000100:00100000:1.0:1746065190.409929:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263167488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.409935:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.409951:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 10 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.409958:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 10 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.409970:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003ba00/0x14b4f8542d4fd741 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6107a expref: 10 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.409978:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.409994:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263167488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.409999:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7590 00000100:00100000:1.0:1746065190.410012:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7591 00000100:00100000:1.0:1746065190.410016:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881263167104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.410023:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.410030:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 12 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.410038:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 12 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.410053:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a200/0x14b4f8542d4fd733 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61088 expref: 12 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.410060:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.410077:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263167104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.410081:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7591 00000100:00100000:1.0:1746065190.410093:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7592 00000100:00100000:1.0:1746065190.410097:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881263167360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.410104:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.410111:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 12 pid: 21998 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.410118:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 12 pid: 21998 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.410128:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.410141:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881263167360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 44us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.410145:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7592 00000100:00100000:1.0:1746065190.410156:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7593 00000100:00100000:1.0:1746065190.410159:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263167872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.410165:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.410173:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 10 pid: 9716 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.410180:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 10 pid: 9716 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.410189:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f420400/0x14b4f8542d4fd74f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6109d expref: 10 pid: 9716 timeout: 889 lvb_type: 1 00010000:00010000:1.0:1746065190.410197:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.410210:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263167872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.410215:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7593 00000100:00100000:1.0:1746065190.410227:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7594 00000100:00100000:1.0:1746065190.410232:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263168000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.410237:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.410244:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 23 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.410252:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 23 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.410262:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f43c800/0x14b4f8542d4fd67d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61018 expref: 23 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.410269:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.410271:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.410274:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.410281:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.410297:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.410310:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263168000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.410315:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7594 00000100:00100000:1.0:1746065190.410346:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7595 00000100:00100000:3.0:1746065190.410400:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166592 00000100:00100000:3.0:1746065190.410404:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166592 00002000:00100000:3.0:1746065190.410427:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1552384->1961983) req@ffff88009fb12300 x1830881263166592/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.410436:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830881263166592 ext(1552384->1961983) 00010000:00010000:3.0:1746065190.410441:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 9 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.410449:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 9 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065190.410455:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12300 00000100:00100000:3.0:1746065190.410472:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2537 00000100:00100000:3.0:1746065190.410477:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263166592:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065190.410530:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260390656:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.410541:0:2463:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.410558:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55000/0x14b4f8542d4fd5ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [5009408->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fb6 expref: 14 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.410565:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260391424:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.410572:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260391552:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.410578:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260391680:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.410585:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a003a000/0x14b4f8542d4fd748 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61096 expref: 11 pid: 21998 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.410591:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260391936:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.410597:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260392192:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.410612:0:2462:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.410627:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167744 00000100:00100000:2.0:1746065190.410629:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167744 00000100:00100000:2.0:1746065190.410650:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14804 00000100:00100000:2.0:1746065190.410655:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:31902:x1830881263167744:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.410664:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.410673:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610c0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.410684:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.410686:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.410691:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065190.410694:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [5009408->5242879] (req 5009408->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 15 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.410707:0:4544:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.410715:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [5009408->5242879] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 15 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.410722:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5574800, rc 0) 00000100:00100000:2.0:1746065190.410754:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:31902:x1830881263167744:12345-192.168.202.46@tcp:101:cat.0 Request processed in 99us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.410759:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14804 00000100:00100000:1.0:1746065190.410960:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263168256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.410969:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.410977:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 21 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.410984:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 21 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.410993:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4fd6f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61057 expref: 21 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.411000:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.411027:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263168256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 676us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.411032:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7595 00010000:00010000:1.0:1746065190.411052:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.411062:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.411077:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.411084:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.411091:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.411096:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc83800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065190.411099:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.411106:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.411114:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.411119:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc83800/0x14b4f8542d4fd7b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.411151:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263166080:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 9072us (9744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.411158:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14803 00000100:00100000:0.0:1746065190.411671:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.411703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.411725:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.411731:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166720 00000100:00100000:0.0:1746065190.411734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.411735:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166720 00010000:00010000:2.0:1746065190.411761:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00000100:00100000:0.0:1746065190.411784:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260392576:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.411785:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263167616 00000100:00100000:2.0:1746065190.411787:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263167616 00010000:00010000:2.0:1746065190.411795:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 12 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.411800:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.411806:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263166848 00000100:00100000:2.0:1746065190.411807:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263166848 00000100:00100000:0.0:1746065190.411812:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168128 00000100:00100000:0.0:1746065190.411829:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168128 00010000:00010000:2.0:1746065190.411833:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 14 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.411838:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 14 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.411846:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7596 00000100:00100000:0.0:1746065190.411856:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7597 00000100:00100000:0.0:1746065190.411861:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263167616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.411868:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065190.411878:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 14 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.411881:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7598 00010000:00010000:0.0:1746065190.411885:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 14 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.411886:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263166848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.411891:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065190.411896:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0f8200/0x14b4f8542d4fd684 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6101f expref: 14 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.411899:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 14 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.411905:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 13 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.411908:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065190.411914:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac54e00/0x14b4f8542d4fd59d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fa8 expref: 13 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.411921:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065190.411922:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263167616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.411928:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7597 00000100:00100000:1.0:1746065190.411930:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263166848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 46us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.411935:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7598 00000100:00100000:0.0:1746065190.411937:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7599 00000100:00100000:0.0:1746065190.411941:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881263168128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.411946:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065190.411952:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 10 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.411959:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 10 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.411968:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fd6fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6105e expref: 10 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:0.0:1746065190.411979:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065190.411992:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263168128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.411997:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7599 00000100:00100000:2.0:1746065190.412094:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881263166720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.412104:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.412113:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.412121:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.412131:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f420c00/0x14b4f8542d4fd73a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6108f expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.412139:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.412140:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.412143:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.412149:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.412172:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.412198:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263166720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 346us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.412203:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7596 00010000:00010000:3.0:1746065190.412255:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.412261:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.412274:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.412281:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.412286:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.412291:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f420600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065190.412293:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.412299:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.412307:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.412312:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f420600/0x14b4f8542d4fd795 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.412366:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263166208:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 10847us (10999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.412372:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14799 00000100:00100000:3.0:1746065190.414474:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260391040:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.414486:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260392704:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.414493:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260392832:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.414513:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.418124:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.418179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.418231:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168384 00000100:00100000:1.0:1746065190.418239:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168384 00010000:00010000:1.0:1746065190.418267:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 9 pid: 8851 timeout: 889 lvb_type: 1 00000100:00100000:1.0:1746065190.418288:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168512 00000100:00100000:1.0:1746065190.418290:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168512 00010000:00010000:1.0:1746065190.418300:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.418313:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7600 00000100:00100000:2.0:1746065190.418322:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263168384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.418333:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065190.418347:0:7078:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1961 -> 1969 00010000:00010000:2.0:1746065190.418353:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 9 pid: 8851 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.418363:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 9 pid: 8851 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.418381:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f12d600/0x14b4f8542d4fd725 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61073 expref: 9 pid: 8851 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.418393:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.418412:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7601 00000100:00100000:1.0:1746065190.418417:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263168512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.418423:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065190.418426:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263168384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.418431:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7600 00010000:00010000:1.0:1746065190.418433:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.418440:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.418451:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fd6e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61049 expref: 15 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.418460:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.418461:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.418465:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.418472:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.418498:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.418513:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1959:x1830881263168512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.418519:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7601 00010000:00010000:2.0:1746065190.419591:0:2462:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419604:0:2462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419621:0:2462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419628:0:2462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419634:0:2462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419643:0:2462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944f2a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065190.419647:0:2462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419653:0:2462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419662:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.419663:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.419669:0:2462:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419675:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.419705:0:2462:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 13 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.419715:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260392960:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065190.419769:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065190.419880:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263166592:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9402us (10399us total) trans 17179873643 rc 0/0 00000100:00100000:3.0:1746065190.419888:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2537 00002000:00100000:3.0:1746065190.419895:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x387:0x0] (1552384->1961983) req@ffff88009fb12300 x1830881263166592/t17179873643(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/448 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.419903:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830881263166592 ext(1552384->1961983) 00010000:00010000:3.0:1746065190.419909:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.419917:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00002000:00010000:3.0:1746065190.419921:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12300 00000100:00100000:2.0:1746065190.420263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.420279:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168768 00000100:00100000:2.0:1746065190.420283:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168768 00010000:00010000:2.0:1746065190.420301:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 9 pid: 8428 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.420320:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7602 00000100:00100000:2.0:1746065190.420325:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263168768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.420333:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.420344:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 9 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.420351:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 9 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.420363:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f503200/0x14b4f8542d4fd4d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f0e expref: 9 pid: 8428 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.420371:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.420401:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263168768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.420406:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7602 00000100:00100000:0.0:1746065190.420805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.420910:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168640 00000100:00100000:2.0:1746065190.420913:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168640 00010000:00010000:2.0:1746065190.420924:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 14 pid: 25185 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.420939:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7603 00000100:00100000:2.0:1746065190.420944:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1958:x1830881263168640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.420950:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.420958:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 14 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.420965:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 14 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.420975:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f503e00/0x14b4f8542d4fd48c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60edd expref: 14 pid: 25185 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.420981:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.420982:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.420985:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.420991:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.421007:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.421030:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1958:x1830881263168640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.421034:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7603 00010000:00010000:3.0:1746065190.421171:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.421179:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.421192:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.421199:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.421205:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.421210:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f12c200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065190.421213:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.421219:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.421228:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.421233:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f12c200/0x14b4f8542d4fd7a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.422463:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263165824:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 20678us (21064us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.422471:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14801 00000100:00100000:0.0:1746065190.422513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.422583:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169024 00000100:00100000:2.0:1746065190.422587:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169024 00010000:00010000:2.0:1746065190.422607:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.422635:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7604 00000100:00100000:2.0:1746065190.422641:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263169024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.422650:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.422715:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.422724:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.422767:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fd6df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->1961983) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61042 expref: 11 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.422777:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.422778:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.422781:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.422788:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.422806:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.422839:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263169024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 197us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.422845:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7604 00010000:00010000:0.0:1746065190.422878:0:2463:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.422886:0:2463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.422899:0:2463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.422905:0:2463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.422911:0:2463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.422916:0:2463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a003a600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065190.422919:0:2463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.422929:0:2463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.422938:0:2463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.422944:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a600/0x14b4f8542d4fd78e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.422977:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263165952:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 21461us (21629us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.422982:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14798 00000100:00100000:0.0:1746065190.426428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.426539:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260392960:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.426564:0:2462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.426578:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944f2a00/0x14b4f8542d4fd7aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.426605:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263168896 00000100:00100000:3.0:1746065190.426611:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263168896 00010000:00010000:3.0:1746065190.426634:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 10 pid: 8851 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.426642:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263166336:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 24652us (25214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.426649:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14802 00000100:00100000:3.0:1746065190.426654:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7605 00000100:00100000:3.0:1746065190.426660:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263168896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065190.426678:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065190.426697:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 10 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.426712:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 10 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.426731:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d11c600/0x14b4f8542d4fd6ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61050 expref: 10 pid: 8851 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.426748:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.426750:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.426754:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.426761:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.426777:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065190.426797:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263168896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 137us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.427090:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7605 00010000:00010000:0.0:1746065190.427196:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.427204:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.427217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.427243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.427264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.427278:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169152 00000100:00100000:2.0:1746065190.427281:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169152 00000100:00100000:3.0:1746065190.427292:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169280 00000100:00100000:3.0:1746065190.427295:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169280 00000100:00100000:2.0:1746065190.427299:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169536 00000100:00100000:2.0:1746065190.427301:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169536 00000100:00100000:3.0:1746065190.427309:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14805 00000100:00100000:3.0:1746065190.427314:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881263169152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065190.427330:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.427338:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.427344:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.427355:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a003a400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065190.427357:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.427364:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.427374:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.427378:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a003a400/0x14b4f8542d4fd79c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.427395:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14806 00000100:00100000:2.0:1746065190.427400:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263169280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.427413:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065190.427417:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263166464:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 25772us (26036us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065190.427423:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610ce expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.427423:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14800 00002000:00010000:2.0:1746065190.427434:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d727, atime: 0x6812d725, ctime: 0x6812d727, blocks: 0x821 00010000:00010000:2.0:1746065190.427443:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.427445:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.427450:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 21 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.427459:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 21 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.427467:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5563800, rc 0) 00000100:00100000:2.0:1746065190.427480:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263169280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.427485:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14806 00000100:00100000:2.0:1746065190.427493:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14807 00000100:00100000:2.0:1746065190.427497:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881263169536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.427502:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.427510:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610dc expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065190.427521:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d726, atime: 0x6812d723, ctime: 0x6812d726, blocks: 0x81d 00010000:00010000:2.0:1746065190.427527:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.427528:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.427531:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 15 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.427539:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 15 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.427545:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5562200, rc 0) 00000100:00100000:2.0:1746065190.427557:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263169536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.427562:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14807 00010000:00010000:3.0:1746065190.427583:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065190.427586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065190.427590:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610c7 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.427597:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169408 00000100:00100000:2.0:1746065190.427600:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169408 00002000:00010000:3.0:1746065190.427607:0:2462:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d725, atime: 0x6812d725, ctime: 0x6812d725, blocks: 0x7b1 00010000:00010000:3.0:1746065190.427614:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065190.427614:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14808 00010000:00010000:3.0:1746065190.427615:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065190.427617:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263169408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.427619:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 15 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.427622:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.427628:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 15 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.427629:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610d5 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.427634:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c66200, rc 0) 00002000:00010000:2.0:1746065190.427638:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d726, atime: 0x6812d725, ctime: 0x6812d726, blocks: 0x821 00010000:00010000:2.0:1746065190.427644:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.427645:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065190.427647:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263169152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 334us (431us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065190.427648:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065190.427653:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14805 00010000:00010000:2.0:1746065190.427655:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.427661:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938fc800, rc 0) 00000100:00100000:2.0:1746065190.427672:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263169408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.427677:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14808 00000100:00100000:1.0:1746065190.427812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.427902:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169664 00000100:00100000:0.0:1746065190.427905:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169664 00000100:00100000:0.0:1746065190.427931:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14809 00000100:00100000:0.0:1746065190.427935:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263169664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065190.427941:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.427948:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610e3 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065190.427957:0:2463:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d727, atime: 0x6812d726, ctime: 0x6812d727, blocks: 0x1029 00010000:00010000:0.0:1746065190.427966:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.427967:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.427972:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 23 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.427980:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 23 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.427986:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f43de00, rc 0) 00000100:00100000:0.0:1746065190.428004:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263169664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.428008:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14809 00000100:00100000:0.0:1746065190.429776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.429970:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263169920 00000100:00100000:2.0:1746065190.429976:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263169920 00000100:00100000:2.0:1746065190.430070:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10013 00000100:00100000:2.0:1746065190.430077:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31909:x1830881263169920:12345-192.168.202.46@tcp:36:mirror_io.0 00000100:00100000:1.0:1746065190.430109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065190.430114:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.430199:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420a00/0x14b4f8542d4fd780 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610b2 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430245:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.430249:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065190.430260:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263170176 00000100:00100000:3.0:1746065190.430264:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263170176 00002000:00100000:3.0:1746065190.430286:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88009f147b80 x1830881263170176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.430294:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f147b80 with x1830881263170176 ext(5009408->5013503) 00002000:00010000:3.0:1746065190.430298:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f147b80 00000100:00100000:3.0:1746065190.430322:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8343 00000100:00100000:3.0:1746065190.430327:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263170176:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065190.430369:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.430379:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430386:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 256 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430392:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430398:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430404:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430409:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.430432:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430442:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 256 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.430456:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393088:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.430526:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430533:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 15 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.430541:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393216:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.430859:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430867:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 15 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.430873:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393344:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.430896:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 256 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430903:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 256 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.430909:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393472:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.430930:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.430941:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 256 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.430947:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393600:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.430963:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065190.431442:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263170176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1113us (1330us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065190.431449:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8343 00002000:00100000:3.0:1746065190.431457:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88009f147b80 x1830881263170176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.431464:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f147b80 with x1830881263170176 ext(5009408->5013503) 00002000:00010000:3.0:1746065190.431467:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f147b80 00000100:00100000:0.0:1746065190.431948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.432089:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.432141:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263170304 00000100:00100000:3.0:1746065190.432144:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263170304 00010000:00010000:3.0:1746065190.432163:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 257 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065190.432683:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7606 00000100:00100000:3.0:1746065190.432692:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1961:x1830881263170304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065190.432701:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065190.432706:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 257 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.432716:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 257 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.432732:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55800/0x14b4f8542d4fd606 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fe0 expref: 257 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:3.0:1746065190.432755:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.432758:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.432766:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065190.432789:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1961:x1830881263170304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 99us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.432797:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7606 00000100:00100000:3.0:1746065190.433085:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393216:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.433092:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393344:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065190.434748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.434803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.434853:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.434911:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263170432 00000100:00100000:1.0:1746065190.434917:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263170432 00010000:00010000:1.0:1746065190.434937:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 16 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.434954:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263170560 00000100:00100000:1.0:1746065190.434955:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263170560 00010000:00010000:1.0:1746065190.434962:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 17 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.434970:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263170688 00000100:00100000:1.0:1746065190.434971:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263170688 00010000:00010000:1.0:1746065190.434977:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 256 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.434987:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7607 00000100:00100000:1.0:1746065190.434991:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263170432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.435000:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.435003:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 17 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.435011:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 17 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.435026:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f502800/0x14b4f8542d4fd5dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60fd2 expref: 17 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.435038:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.435042:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065190.435083:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7608 00000100:00100000:2.0:1746065190.435090:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881263170560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.435096:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.435100:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 16 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065190.435121:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393472:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065190.435125:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.435156:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263170432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 162us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.435161:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7607 00000100:00100000:1.0:1746065190.435181:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7609 00000100:00100000:1.0:1746065190.435185:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1959:x1830881263170688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.435191:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.435194:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 256 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:0.0:1746065190.435334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065190.435455:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 15 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.435467:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce000/0x14b4f8542d4fd557 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f62 expref: 15 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.435476:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.435479:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065190.435483:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.435503:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5becc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263170560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 414us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.435508:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7608 00000100:00100000:0.0:1746065190.435699:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065190.435733:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 256 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.435754:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ce800/0x14b4f8542d4fd550 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f5b expref: 256 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.435762:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.435765:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.435769:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.435789:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1959:x1830881263170688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 603us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.435794:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7609 00000100:00100000:1.0:1746065190.435804:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171072 00000100:00100000:1.0:1746065190.435807:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171072 00010000:00010000:1.0:1746065190.435839:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 255 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.435852:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7610 00000100:00100000:1.0:1746065190.435857:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1958:x1830881263171072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.435863:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.435866:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 255 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.435872:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 255 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.435882:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.435885:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.435890:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.435895:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065190.435907:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.435920:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1958:x1830881263171072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.435924:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7610 00000100:00100000:1.0:1746065190.435943:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263170944 00000100:00100000:1.0:1746065190.435946:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263170944 00000100:00100000:1.0:1746065190.435961:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4298 00000100:00100000:1.0:1746065190.435965:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:31902:x1830881263170944:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065190.436225:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31902:x1830881263170944:12345-192.168.202.46@tcp:35:cat.0 Request processed in 258us (890us total) trans 8589944268 rc 0/0 00000100:00100000:1.0:1746065190.436231:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4298 00010000:00010000:3.0:1746065190.436352:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420e00/0x14b4f8542d4fd549 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e60f54 expref: 255 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065190.436362:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260393600:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.436387:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.436393:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.436398:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000040:00080000:3.0:1746065190.436961:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3092, 88 off261520 00000004:00080000:3.0:1746065190.436968:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728151999ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437003:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3118, 88 off263992 00000004:00080000:3.0:1746065190.437007:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789728191988ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065190.437018:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3119, 88 off264080 00000004:00080000:3.0:1746065190.437020:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789728205084ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065190.437027:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3093, 88 off261608 00000004:00080000:3.0:1746065190.437029:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728213481ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437034:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3094, 88 off261696 00000004:00080000:3.0:1746065190.437037:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728221891ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437043:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3120, 88 off264168 00000004:00080000:3.0:1746065190.437045:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789728229831ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065190.437051:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3121, 88 off264256 00000004:00080000:3.0:1746065190.437053:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789728237846ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065190.437059:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3122, 88 off264344 00000004:00080000:3.0:1746065190.437061:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789728245619ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065190.437066:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3095, 88 off261784 00000004:00080000:3.0:1746065190.437068:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728253241ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437074:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3123, 88 off264432 00000004:00080000:3.0:1746065190.437076:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789728260511ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065190.437081:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3096, 88 off261872 00000004:00080000:3.0:1746065190.437083:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728268143ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437089:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3124, 88 off264520 00000004:00080000:3.0:1746065190.437091:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789728275991ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065190.437097:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3097, 88 off261960 00000004:00080000:3.0:1746065190.437099:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728283393ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437104:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3098, 88 off262048 00000004:00080000:3.0:1746065190.437107:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728291439ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437133:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3100, 88 off262232 00000004:00080000:3.0:1746065190.437136:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728321006ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437143:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3101, 88 off262320 00000004:00080000:3.0:1746065190.437145:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789728330058ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065190.437152:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3125, 88 off264608 00000004:00080000:3.0:1746065190.437154:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789728338614ns, next at 737095943431ns, rc = 0 00000100:00100000:0.0:1746065190.443624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.443648:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171328 00000100:00100000:2.0:1746065190.443656:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171328 00000100:00100000:2.0:1746065190.443689:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10014 00000100:00100000:2.0:1746065190.443695:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:31912:x1830881263171328:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065190.443713:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.443727:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd7e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610ea expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.443950:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.443961:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.443969:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.443980:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.443985:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.443990:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00010000:0.0:1746065190.454463:0:14644:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fb12a00 reply state ffff8800a500a800 transno 8589944269 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065190.454479:0:14644:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065190.454538:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.454553:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.454558:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065190.454585:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:31909:x1830881263169920:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 24507us (24813us total) trans 8589944269 rc 0/0 00000100:00100000:0.0:1746065190.454592:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10013 00010000:00010000:2.0:1746065190.454714:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.454725:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 10 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.454749:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260393728:192.168.202.46@tcp:104: 00000001:00080000:1.0:1746065190.454773:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944267 is committed 00000001:00080000:1.0:1746065190.454781:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944265 is committed 00000001:00080000:1.0:1746065190.454785:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944258 is committed 00000001:00080000:1.0:1746065190.454791:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944268 is committed 00000100:00100000:2.0:1746065190.454929:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000001:00080000:1.0:1746065190.455099:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944269 is committed 00000004:00080000:1.0:1746065190.455104:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2406 committed 00000004:00080000:1.0:1746065190.455110:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2381 committed 00000004:00080000:1.0:1746065190.455114:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2380 committed 00000004:00080000:1.0:1746065190.455115:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2379 committed 00000004:00080000:1.0:1746065190.455116:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2378 committed 00000004:00080000:1.0:1746065190.455118:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2405 committed 00000004:00080000:1.0:1746065190.455119:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2377 committed 00000004:00080000:1.0:1746065190.455120:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2404 committed 00000004:00080000:1.0:1746065190.455121:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2376 committed 00000004:00080000:1.0:1746065190.455122:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2403 committed 00000004:00080000:1.0:1746065190.455124:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2402 committed 00000004:00080000:1.0:1746065190.455125:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2401 committed 00000004:00080000:1.0:1746065190.455126:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2375 committed 00000004:00080000:1.0:1746065190.455128:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2374 committed 00000004:00080000:1.0:1746065190.455129:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2400 committed 00000004:00080000:1.0:1746065190.455131:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2399 committed 00000004:00080000:1.0:1746065190.455132:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2373 committed 00000100:00100000:2.0:1746065190.455313:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260393984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065190.455313:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260393856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065190.455418:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455437:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260394496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065190.455450:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455459:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260395008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065190.455471:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455481:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260395520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065190.455491:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455509:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260394112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065190.455522:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455532:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260394624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065190.455543:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455553:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260395136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065190.455565:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455574:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260395648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065190.455587:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455598:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746065190.455602:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260394240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065190.455614:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455625:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260394752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065190.455637:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455647:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260395264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065190.455659:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455670:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260395776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065190.455670:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260393984 00000100:00100000:0.0:1746065190.455676:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260393984 00000100:00100000:2.0:1746065190.455680:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065190.455695:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260394496 00000100:00100000:0.0:1746065190.455695:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260395008 00000100:00100000:2.0:1746065190.455697:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260394496 00000100:00100000:0.0:1746065190.455697:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260395008 00000100:00100000:0.0:1746065190.455704:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260395520 00000100:00100000:0.0:1746065190.455705:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260395520 00000100:00100000:2.0:1746065190.455707:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260394112 00000100:00100000:2.0:1746065190.455708:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260394112 00000100:00100000:0.0:1746065190.455710:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260394624 00000100:00100000:0.0:1746065190.455711:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260394624 00000100:00100000:2.0:1746065190.455713:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260395136 00000100:00100000:2.0:1746065190.455715:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260395136 00000100:00100000:0.0:1746065190.455717:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260395648 00000100:00100000:0.0:1746065190.455718:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260395648 00000100:00100000:2.0:1746065190.455720:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260394240 00000100:00100000:2.0:1746065190.455721:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260394240 00000100:00100000:0.0:1746065190.455723:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260394752 00000100:00100000:0.0:1746065190.455724:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260394752 00000100:00100000:2.0:1746065190.455726:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260395264 00000100:00100000:2.0:1746065190.455727:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260395264 00000100:00100000:0.0:1746065190.455729:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260395776 00000100:00100000:0.0:1746065190.455731:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260395776 00000100:00100000:2.0:1746065190.455734:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14810 00000100:00100000:2.0:1746065190.455750:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1830881260393984:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065190.455982:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.455993:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.455999:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.456004:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a003a800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.456007:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.456012:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.456027:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.456029:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065190.456034:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065190.456038:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003a800/0x14b4f8542d4fd7e2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065190.456190:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14811 00000100:00100000:0.0:1746065190.456196:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3296:x1830881260395008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.456655:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14812 00000100:00100000:3.0:1746065190.456661:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14813 00000100:00100000:1.0:1746065190.456663:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1830881260394496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.456666:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3296:x1830881260395520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.456710:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14814 00000100:00100000:1.0:1746065190.456715:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3297:x1830881260394112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065190.456835:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065190.456838:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065190 -> 1746065190 00002000:00010000:2.0:1746065190.456839:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:2.0:1746065190.456841:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065190 -> 1746065190 00002000:00010000:2.0:1746065190.456843:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746065190.456843:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065190.456845:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065191 -> 1746065191 00002000:00010000:1.0:1746065190.456847:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065190 -> 1746065190 00002000:00010000:1.0:1746065190.456848:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065191 -> 1746065191 00002000:00010000:1.0:1746065190.456849:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746065190.456872:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260393984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1122us (1453us total) trans 17179873644 rc 0/0 00000100:00100000:1.0:1746065190.456872:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260394112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (1348us total) trans 17179873646 rc 0/0 00000100:00100000:1.0:1746065190.456877:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14814 00002000:00010000:0.0:1746065190.456965:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065190.456968:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065190 -> 1746065190 00002000:00010000:0.0:1746065190.456969:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065187 -> 1746065187 00002000:00010000:0.0:1746065190.456970:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065190 -> 1746065190 00002000:00010000:0.0:1746065190.456972:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746065190.456982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.456990:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3296:x1830881260395008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 795us (1517us total) trans 21474840922 rc 0/0 00000100:00100000:3.0:1746065190.457000:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171456 00000100:00100000:3.0:1746065190.457002:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171456 00000100:00100000:3.0:1746065190.457023:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10015 00000100:00100000:3.0:1746065190.457028:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31909:x1830881263171456:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065190.457040:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.457049:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610f1 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.457087:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14810 00000100:00100000:2.0:1746065190.457103:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14815 00000100:00100000:2.0:1746065190.457108:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3297:x1830881260394624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065190.457157:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14816 00000100:00100000:1.0:1746065190.457162:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3297:x1830881260395136:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065190.457164:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.457175:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.457189:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.457191:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065190.457194:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b7ca00, rc 0) 00000100:00100000:3.0:1746065190.457217:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31909:x1830881263171456:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 189us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.457222:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10015 00002000:00010000:1.0:1746065190.457226:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:1.0:1746065190.457229:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065191 -> 1746065191 00002000:00010000:1.0:1746065190.457230:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065190 -> 1746065190 00002000:00010000:1.0:1746065190.457232:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065190 -> 1746065190 00002000:00010000:1.0:1746065190.457234:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5771 -> 5767 00000100:00100000:1.0:1746065190.457252:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881260395136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (1685us total) trans 21474840923 rc 0/0 00000100:00100000:1.0:1746065190.457256:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14816 00000100:00100000:1.0:1746065190.457265:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14817 00000100:00100000:1.0:1746065190.457269:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3297:x1830881260395648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065190.457342:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065190.457344:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065190.457346:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065190.457347:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065190.457349:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065190.457368:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881260395648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (1779us total) trans 21474840924 rc 0/0 00000100:00100000:1.0:1746065190.457373:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14817 00000100:00100000:1.0:1746065190.457384:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14818 00000100:00100000:1.0:1746065190.457388:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3297:x1830881260394240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065190.457426:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881260394624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 318us (1882us total) trans 17179873647 rc 0/0 00000100:00100000:2.0:1746065190.457431:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14815 00000100:00100000:2.0:1746065190.457440:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14819 00000100:00100000:2.0:1746065190.457444:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881260394752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065190.457519:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260394752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1880us total) trans 17179873649 rc 0/0 00000100:00100000:2.0:1746065190.457524:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14819 00000100:00100000:2.0:1746065190.457533:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14820 00000100:00100000:2.0:1746065190.457537:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3297:x1830881260395264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065190.457597:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065190.457599:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065190.457600:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065190.457602:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065190.457603:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065190.457619:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881260395264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (1960us total) trans 21474840925 rc 0/0 00000100:00100000:2.0:1746065190.457623:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14820 00000100:00100000:2.0:1746065190.457632:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14821 00000100:00100000:2.0:1746065190.457637:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3297:x1830881260395776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065190.457710:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881260395776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (2028us total) trans 21474840926 rc 0/0 00000100:00100000:2.0:1746065190.457714:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14821 00000100:00100000:0.0:1746065190.457748:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14811 00000100:00100000:2.0:1746065190.457768:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873638 gen 2 00000004:00080000:2.0:1746065190.457772:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e9a680, transno 17179873600 00000004:00080000:2.0:1746065190.457778:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3e680, transno 17179873601 00000004:00080000:2.0:1746065190.457780:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801298a1c00, transno 17179873602 00000004:00080000:2.0:1746065190.457782:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3e300, transno 17179873603 00000100:00100000:0.0:1746065190.457783:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065190.457784:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e9ad80, transno 17179873604 00000004:00080000:2.0:1746065190.457786:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801298a2a00, transno 17179873605 00000004:00080000:2.0:1746065190.457788:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e9aa00, transno 17179873606 00000004:00080000:2.0:1746065190.457789:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801298a2680, transno 17179873607 00000004:00080000:2.0:1746065190.457791:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133264000, transno 17179873608 00000004:00080000:2.0:1746065190.457793:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba1f100, transno 17179873609 00000004:00080000:2.0:1746065190.457795:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133266a00, transno 17179873610 00000004:00080000:2.0:1746065190.457797:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0028000, transno 17179873611 00000004:00080000:2.0:1746065190.457799:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133267b80, transno 17179873612 00000004:00080000:2.0:1746065190.457801:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd04000, transno 17179873613 00000004:00080000:2.0:1746065190.457802:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880133264e00, transno 17179873614 00000004:00080000:2.0:1746065190.457804:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a002b100, transno 17179873615 00000004:00080000:2.0:1746065190.457807:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0dc00, transno 17179873623 00000004:00080000:2.0:1746065190.457809:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0fb80, transno 17179873624 00000004:00080000:2.0:1746065190.457811:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0e680, transno 17179873625 00000004:00080000:2.0:1746065190.457827:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0f800, transno 17179873626 00000004:00080000:2.0:1746065190.457830:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0c700, transno 17179873627 00000004:00080000:2.0:1746065190.457832:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0ce00, transno 17179873628 00000004:00080000:2.0:1746065190.457833:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0c000, transno 17179873629 00000004:00080000:2.0:1746065190.457835:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0ea00, transno 17179873630 00000004:00080000:2.0:1746065190.457838:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380f480, transno 17179873631 00000004:00080000:2.0:1746065190.457839:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380f800, transno 17179873632 00000004:00080000:2.0:1746065190.457841:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380df80, transno 17179873633 00000004:00080000:2.0:1746065190.457842:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380ca80, transno 17179873634 00000004:00080000:2.0:1746065190.457844:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380c000, transno 17179873635 00000004:00080000:2.0:1746065190.457846:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc59180, transno 17179873636 00000004:00080000:2.0:1746065190.457848:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380ce00, transno 17179873637 00000004:00080000:2.0:1746065190.457849:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fc58a80, transno 17179873638 00000100:00100000:2.0:1746065190.457854:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009f146d80 x1830881260393984/t17179873644(17179873644) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065206 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746065190.457863:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f146d80/2, rc 0, transno 17179873644 00000100:00100000:2.0:1746065190.457866:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260393984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.457983:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260393728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.457998:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065190.458080:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3296:x1830881260395520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1413us (2586us total) trans 21474840927 rc 0/0 00000100:00100000:3.0:1746065190.458085:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14813 00000100:00100000:3.0:1746065190.458094:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260393856 00000100:00100000:3.0:1746065190.458097:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260393856 00000100:00100000:3.0:1746065190.458111:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14822 00000100:00100000:3.0:1746065190.458115:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260393856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065190.458181:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065190.458184:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065191 -> 1746065191 00002000:00010000:3.0:1746065190.458185:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:3.0:1746065190.458188:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065191 -> 1746065191 00002000:00010000:3.0:1746065190.458189:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065190.458206:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881260393856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (422us total) trans 17179873650 rc 0/0 00000100:00100000:3.0:1746065190.458210:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14822 00000100:00100000:0.0:1746065190.458326:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260394368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065190.458348:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065190.458361:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260394880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065190.458374:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065190.458385:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260395392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065190.458396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065190.458414:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f145f80/2, rc 0, transno 17179873650 00000100:00100000:0.0:1746065190.458418:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260393856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065190.458430:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260394368 00000100:00100000:0.0:1746065190.458433:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260394368 00000100:00100000:0.0:1746065190.458445:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260394880 00000100:00100000:0.0:1746065190.458447:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260394880 00000100:00100000:0.0:1746065190.458455:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260395392 00000100:00100000:0.0:1746065190.458456:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260395392 00000100:00100000:0.0:1746065190.458465:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14823 00000100:00100000:0.0:1746065190.458469:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881260394368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.458565:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14824 00000100:00100000:3.0:1746065190.458570:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260394880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065190.458667:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065190.458669:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065189 -> 1746065189 00002000:00010000:3.0:1746065190.458671:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:3.0:1746065190.458672:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065189 -> 1746065189 00002000:00010000:3.0:1746065190.458674:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:3.0:1746065190.458695:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260394880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (319us total) trans 21474840928 rc 0/0 00000100:00100000:3.0:1746065190.458700:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14824 00000100:00100000:3.0:1746065190.458710:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14825 00000100:00100000:3.0:1746065190.458714:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260395392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065190.458796:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260395392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (397us total) trans 21474840929 rc 0/0 00000100:00100000:3.0:1746065190.458800:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14825 00000100:00100000:3.0:1746065190.458836:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840918 gen 2 00000004:00080000:3.0:1746065190.458839:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46a300, transno 21474840873 00000004:00080000:3.0:1746065190.458845:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f469f80, transno 21474840874 00000004:00080000:3.0:1746065190.458847:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ebb80, transno 21474840875 00000004:00080000:3.0:1746065190.458849:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46a680, transno 21474840876 00000004:00080000:3.0:1746065190.458850:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f469500, transno 21474840877 00000004:00080000:3.0:1746065190.458853:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4e8a80, transno 21474840878 00000004:00080000:3.0:1746065190.458855:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46ad80, transno 21474840879 00000004:00080000:3.0:1746065190.458857:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095352300, transno 21474840880 00000004:00080000:3.0:1746065190.458859:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130445f80, transno 21474840881 00000004:00080000:3.0:1746065190.458861:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095355500, transno 21474840882 00000004:00080000:3.0:1746065190.458863:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095356300, transno 21474840883 00000004:00080000:3.0:1746065190.458865:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fdf80, transno 21474840884 00000004:00080000:3.0:1746065190.458867:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fe680, transno 21474840885 00000004:00080000:3.0:1746065190.458869:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095357100, transno 21474840886 00000004:00080000:3.0:1746065190.458871:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fd500, transno 21474840887 00000004:00080000:3.0:1746065190.458873:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fea00, transno 21474840888 00000004:00080000:3.0:1746065190.458874:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fe300, transno 21474840889 00000004:00080000:3.0:1746065190.458876:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e9b480, transno 21474840890 00000004:00080000:3.0:1746065190.458878:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094092680, transno 21474840901 00000004:00080000:3.0:1746065190.458880:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdf800, transno 21474840902 00000004:00080000:3.0:1746065190.458882:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7af100, transno 21474840903 00000004:00080000:3.0:1746065190.458884:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdc700, transno 21474840904 00000004:00080000:3.0:1746065190.458885:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdea00, transno 21474840905 00000004:00080000:3.0:1746065190.458888:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdd500, transno 21474840906 00000004:00080000:3.0:1746065190.458890:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd06680, transno 21474840907 00000004:00080000:3.0:1746065190.458892:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135cdce00, transno 21474840908 00000004:00080000:3.0:1746065190.458894:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee2d80, transno 21474840909 00000004:00080000:3.0:1746065190.458896:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c3b80, transno 21474840910 00000004:00080000:3.0:1746065190.458898:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c0700, transno 21474840911 00000004:00080000:3.0:1746065190.458900:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c2a00, transno 21474840912 00000004:00080000:3.0:1746065190.458902:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c0000, transno 21474840913 00000004:00080000:3.0:1746065190.458904:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c1180, transno 21474840914 00000004:00080000:3.0:1746065190.458906:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c0380, transno 21474840915 00000004:00080000:3.0:1746065190.458908:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c2680, transno 21474840916 00000004:00080000:3.0:1746065190.458910:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900c3800, transno 21474840917 00000004:00080000:3.0:1746065190.458913:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a94a80, transno 21474840918 00000100:00100000:3.0:1746065190.458917:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012bd3e680 x1830881260394880/t21474840928(21474840928) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065206 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746065190.458924:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3e680/2, rc 0, transno 21474840928 00000100:00100000:3.0:1746065190.458927:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260394880:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065190.458935:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3d500/2, rc 0, transno 21474840929 00000100:00100000:3.0:1746065190.458937:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260395392:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065190.459173:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 6 in flight, 36 done 00000100:00100000:3.0:1746065190.459221:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260395904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065190.459239:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.459257:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260395904 00000100:00100000:3.0:1746065190.459260:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260395904 00000100:00100000:3.0:1746065190.459273:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14826 00000100:00100000:3.0:1746065190.459278:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260395904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065190.459537:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065190.459540:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065190.459541:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065190.459543:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065190.459544:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:2.0:1746065190.459571:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3d180/2, rc 0, transno 21474840922 00000100:00100000:2.0:1746065190.459575:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260395008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.460132:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3296:x1830881260394496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3469us (4678us total) trans 17179873645 rc 0/0 00000100:00100000:1.0:1746065190.460139:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14812 00000004:00080000:2.0:1746065190.460144:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3f480/2, rc 0, transno 21474840927 00000100:00100000:2.0:1746065190.460148:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260395520:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065190.460159:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f146300/2, rc 0, transno 17179873645 00000100:00100000:2.0:1746065190.460162:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260394496:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065190.460167:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f146a00/2, rc 0, transno 17179873649 00000100:00100000:1.0:1746065190.460171:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260394752:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065190.460179:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3f800/2, rc 0, transno 21474840925 00000100:00100000:1.0:1746065190.460181:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260395264:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065190.460189:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba1ea00/2, rc 0, transno 21474840926 00000100:00100000:1.0:1746065190.460192:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260395776:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065190.460200:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f145c00/2, rc 0, transno 17179873646 00000100:00100000:1.0:1746065190.460202:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260394112:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065190.460208:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f146680/2, rc 0, transno 17179873647 00000100:00100000:1.0:1746065190.460211:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260394624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065190.460217:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3ce00/2, rc 0, transno 21474840923 00000100:00100000:1.0:1746065190.460220:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260395136:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065190.460225:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba1d500/2, rc 0, transno 21474840924 00000100:00100000:1.0:1746065190.460228:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260395648:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065190.460249:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065190.460252:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065190.460254:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065190.460256:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065190.460258:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065190.460277:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881260394240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2889us (4661us total) trans 17179873648 rc 0/0 00000100:00100000:1.0:1746065190.460282:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14818 00000004:00080000:1.0:1746065190.460297:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f145500/2, rc 0, transno 17179873648 00000100:00100000:1.0:1746065190.460300:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260394240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065190.460382:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 1 in flight, 32 done 00000100:00100000:0.0:1746065190.460587:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260394368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2115us (2235us total) trans 17179873651 rc 0/0 00000100:00100000:0.0:1746065190.460593:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14823 00000100:00100000:0.0:1746065190.460642:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.460771:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881260395904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1489us (1527us total) trans 21474840930 rc 0/0 00000100:00100000:3.0:1746065190.460778:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14826 00000100:00100000:2.0:1746065190.460803:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171584 00000100:00100000:2.0:1746065190.460807:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171584 00010000:00010000:2.0:1746065190.460842:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 8 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.460859:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7611 00000100:00100000:2.0:1746065190.460864:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263171584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.460875:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.460880:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 8 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.460888:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 8 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.460903:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fd772 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ab expref: 8 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.460915:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.460919:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.460926:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.460931:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.460947:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.460973:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263171584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.460978:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7611 00000100:00100000:0.0:1746065190.461063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.461150:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171712 00000100:00100000:3.0:1746065190.461153:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171712 00000100:00100000:3.0:1746065190.461169:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10016 00000100:00100000:3.0:1746065190.461173:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31909:x1830881263171712:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065190.461182:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.461190:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420800/0x14b4f8542d4fd80c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610f8 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.461247:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065190.461255:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065190.461261:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065190.461277:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065190.461280:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065190.461291:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065190.461306:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f420800/0x14b4f8542d4fd80c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.461315:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.461320:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.461322:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065190.461323:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f421a00, rc 0) 00000100:00100000:3.0:1746065190.461341:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31909:x1830881263171712:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 167us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.461345:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10016 00010000:00010000:3.0:1746065190.461360:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461364:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065190.461372:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065190.461437:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461443:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461448:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461453:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f3b7e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.461456:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461462:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461469:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.461471:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065190.461473:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461477:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd7fe lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461490:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461495:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461499:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461502:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a003b200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.461504:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461509:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461515:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065190.461516:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065190.461519:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461523:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b200/0x14b4f8542d4fd7f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461530:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461535:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461539:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461542:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a003b000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.461544:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461547:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461553:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801356ed600) 00010000:00010000:3.0:1746065190.461555:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065190.461556:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.461561:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b000/0x14b4f8542d4fd7f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.462179:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd7e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ea expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.462186:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd7e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ea expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.462193:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003b400, rc 0) 00000100:00100000:3.0:1746065190.462220:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:31912:x1830881263171328:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 18525us (18601us total) trans 8589944270 rc 301/301 00000100:00100000:3.0:1746065190.462225:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10014 00000004:00080000:3.0:1746065190.462259:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee2d80/2, rc 0, transno 21474840930 00000100:00100000:3.0:1746065190.462264:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260395904:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065190.462274:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f145880/2, rc 0, transno 17179873651 00000100:00100000:3.0:1746065190.462276:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260394368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065190.463519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.463535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.464073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.464184:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171968 00000100:00100000:3.0:1746065190.464190:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171968 00000100:00100000:3.0:1746065190.464218:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263172224 00000100:00100000:3.0:1746065190.464220:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263172224 00000100:00100000:3.0:1746065190.464230:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263172480 00000100:00100000:3.0:1746065190.464232:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263172480 00000100:00100000:3.0:1746065190.464244:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14827 00000100:00100000:3.0:1746065190.464250:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263171968:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065190.464261:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.464274:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61106 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.464294:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.464295:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.464302:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.464314:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 8 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.464322:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a59b8c00, rc 0) 00000100:00100000:0.0:1746065190.464400:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14828 00000100:00100000:0.0:1746065190.464407:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263172224:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065190.464416:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065190.464425:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61114 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.464434:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.464435:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.464440:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 7 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.464448:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 7 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.464454:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f43c200, rc 0) 00000100:00100000:2.0:1746065190.464862:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14829 00000100:00100000:2.0:1746065190.464871:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263172480:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065190.464877:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.464886:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61122 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.464898:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.464899:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.464903:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.464911:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.464916:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3be400, rc 0) 00000100:00100000:3.0:1746065190.464966:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263171968:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 715us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.464971:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14827 00000100:00100000:1.0:1746065190.465055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.465132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.465156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.465172:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263171840 00000100:00100000:1.0:1746065190.465176:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263171840 00000100:00100000:1.0:1746065190.465191:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263172096 00000100:00100000:1.0:1746065190.465193:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263172096 00000100:00100000:1.0:1746065190.465201:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263172352 00000100:00100000:1.0:1746065190.465202:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263172352 00000100:00100000:1.0:1746065190.465212:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14830 00000100:00100000:1.0:1746065190.465216:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263171840:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065190.465222:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.465230:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e610ff expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.465239:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.465240:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.465244:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.465258:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.465264:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc82e00, rc 0) 00000100:00100000:1.0:1746065190.465283:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263171840:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.465287:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14830 00000100:00100000:1.0:1746065190.465310:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14831 00000100:00100000:1.0:1746065190.465314:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263172096:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065190.465319:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.465325:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6110d expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.465334:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.465335:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.465338:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.465346:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.465352:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc82800, rc 0) 00000100:00100000:1.0:1746065190.465367:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263172096:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.465371:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14831 00000100:00100000:1.0:1746065190.465391:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14832 00000100:00100000:1.0:1746065190.465395:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263172352:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065190.465400:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.465406:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6111b expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.465415:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.465416:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.465420:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.465428:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.465440:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc83400, rc 0) 00000100:00100000:1.0:1746065190.465455:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263172352:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 59us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.465459:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14832 00000100:00100000:0.0:1746065190.465550:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263172224:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1143us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.465555:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14828 00000100:00100000:2.0:1746065190.465677:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263172480:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 807us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.465682:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14829 00000100:00100000:0.0:1746065190.543495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.543594:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263172736 00000100:00100000:3.0:1746065190.543603:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263172736 00000100:00100000:3.0:1746065190.543645:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10017 00000100:00100000:3.0:1746065190.543652:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+6:31915:x1830881263172736:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065190.543672:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.544150:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd84b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61129 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.544244:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544256:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544265:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544280:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544284:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544289:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544380:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544387:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544393:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065190.544400:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065190.544464:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544470:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544476:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544481:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f3b7e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.544485:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544490:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544499:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.544502:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065190.544506:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544511:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd860 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544528:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544533:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544537:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544541:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f421400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.544544:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544548:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544554:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065190.544556:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065190.544558:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544563:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544569:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544575:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544579:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544582:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f421e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.544584:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544588:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544593:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fa100) 00010000:00010000:3.0:1746065190.544595:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065190.544597:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544601:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd859 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.544631:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd84b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61129 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.544638:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd84b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61129 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.544645:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f421c00, rc 0) 00000100:00100000:3.0:1746065190.545996:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:31915:x1830881263172736:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2339us (2504us total) trans 8589944271 rc 301/301 00000100:00100000:3.0:1746065190.546008:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10017 00000100:00100000:0.0:1746065190.610124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.610226:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263172992 00000100:00100000:3.0:1746065190.610234:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263172992 00000100:00100000:3.0:1746065190.610275:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10018 00000100:00100000:3.0:1746065190.610284:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:31918:x1830881263172992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.610308:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.610325:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd86e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61130 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.610420:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610432:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610441:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610452:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610457:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610461:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610551:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610558:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610564:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065190.610571:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065190.610632:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610637:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610643:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610648:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f421400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.610651:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610656:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610665:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.610667:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065190.610670:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610675:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421400/0x14b4f8542d4fd883 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610714:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610720:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610727:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610730:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f421c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.610733:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610746:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610752:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065190.610753:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065190.610756:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610759:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421c00/0x14b4f8542d4fd875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610765:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610770:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610774:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610777:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f421e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065190.610780:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610784:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610792:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fae00) 00010000:00010000:3.0:1746065190.610794:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065190.610795:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610800:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421e00/0x14b4f8542d4fd87c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.610856:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd86e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61130 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.610863:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b7e00/0x14b4f8542d4fd86e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61130 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.610871:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3b7e00, rc 0) 00000100:00100000:3.0:1746065190.610913:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:31918:x1830881263172992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 630us (798us total) trans 8589944272 rc 301/301 00000100:00100000:3.0:1746065190.610919:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10018 00000100:00100000:0.0:1746065190.614354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.614449:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263173120 00000100:00100000:2.0:1746065190.614458:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263173120 00000100:00100000:3.0:1746065190.615070:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10019 00000100:00100000:3.0:1746065190.615079:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:31918:x1830881263173120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.615099:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.615117:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b6400/0x14b4f8542d4fd891 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61137 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.615183:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.615194:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.615204:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065190.615225:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065190.615229:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065190.615240:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065190.615262:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f3b6400/0x14b4f8542d4fd891 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.615274:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.615282:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.615284:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065190.615287:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003b400, rc 0) 00000100:00100000:3.0:1746065190.615337:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:31918:x1830881263173120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 259us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.615342:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10019 00000100:00100000:0.0:1746065190.617053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.617082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.617097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.617118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.617130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.617271:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263173376 00000100:00100000:1.0:1746065190.617278:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263173376 00000100:00100000:1.0:1746065190.617302:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263173632 00000100:00100000:1.0:1746065190.617303:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263173632 00000100:00100000:1.0:1746065190.617312:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263173888 00000100:00100000:1.0:1746065190.617313:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263173888 00000100:00100000:1.0:1746065190.617320:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263173248 00000100:00100000:1.0:1746065190.617321:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263173248 00000100:00100000:1.0:1746065190.617328:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263173504 00000100:00100000:1.0:1746065190.617329:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263173504 00000100:00100000:1.0:1746065190.617339:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14833 00000100:00100000:1.0:1746065190.617345:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263173376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.617357:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.617373:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61145 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.617389:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617391:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617398:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617410:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617419:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc82c00, rc 0) 00000100:00100000:1.0:1746065190.617446:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263173376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 102us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.617451:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14833 00000100:00100000:1.0:1746065190.617472:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14834 00000100:00100000:1.0:1746065190.617476:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263173632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.617482:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.617490:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61153 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.617499:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617500:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617504:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617517:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617524:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc82600, rc 0) 00000100:00100000:1.0:1746065190.617537:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263173632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 60us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.617541:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14834 00000100:00100000:1.0:1746065190.617558:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14835 00000100:00100000:1.0:1746065190.617562:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263173888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.617567:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.617571:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61161 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.617578:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617580:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617583:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617591:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617597:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc83200, rc 0) 00000100:00100000:1.0:1746065190.617606:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263173888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 44us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.617611:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14835 00000100:00100000:1.0:1746065190.617620:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14836 00000100:00100000:1.0:1746065190.617623:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263173248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.617628:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.617632:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6113e expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.617639:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617640:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617644:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617651:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617657:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc82400, rc 0) 00000100:00100000:1.0:1746065190.617666:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263173248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 43us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.617671:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14836 00000100:00100000:1.0:1746065190.617678:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14837 00000100:00100000:1.0:1746065190.617682:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263173504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.617686:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.617690:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6114c expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.617698:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617699:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.617702:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617710:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065190.617716:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc83600, rc 0) 00000100:00100000:1.0:1746065190.617725:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263173504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 43us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.617729:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14837 00000100:00100000:0.0:1746065190.617836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.617897:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263173760 00000100:00100000:2.0:1746065190.617901:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263173760 00000100:00100000:2.0:1746065190.617918:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14838 00000100:00100000:2.0:1746065190.617922:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263173760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.617928:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.617934:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6115a expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.617943:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.617944:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.617948:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.617961:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065190.617968:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fccd800, rc 0) 00000100:00100000:2.0:1746065190.617981:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263173760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.617986:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14838 00000100:00100000:0.0:1746065190.622523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.622610:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174016 00000100:00100000:2.0:1746065190.622618:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174016 00000100:00100000:2.0:1746065190.622705:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10020 00000100:00100000:2.0:1746065190.622712:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:31912:x1830881263174016:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065190.622730:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.622752:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccda00/0x14b4f8542d4fd8c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61168 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.622796:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccda00/0x14b4f8542d4fd8c9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61168 expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.622806:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccda00/0x14b4f8542d4fd8c9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61168 expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.622953:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.622956:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065190.622958:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fccda00, rc 0) 00000100:00100000:2.0:1746065190.623398:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31912:x1830881263174016:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 685us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.623407:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10020 00000100:00100000:0.0:1746065190.625239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.625358:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174272 00000100:00100000:2.0:1746065190.625364:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174272 00000100:00100000:2.0:1746065190.625489:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10021 00000100:00100000:2.0:1746065190.625496:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:31912:x1830881263174272:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065190.625509:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.625512:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065190.625531:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccda00/0x14b4f8542d4fd8c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61168 expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.625557:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.625561:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065190.625570:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccde00/0x14b4f8542d4fd8d0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6116f expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.625606:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.625615:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.625620:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.625625:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.625629:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.625653:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.625662:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 8 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.625670:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260396032:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.626249:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.626257:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 7 pid: 16767 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.626263:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260396160:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.626283:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.626289:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 7 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.626294:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260396288:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.626305:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065190.633475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.633510:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.633535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.633554:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174400 00000100:00100000:1.0:1746065190.633560:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174400 00010000:00010000:1.0:1746065190.633589:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 9 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.633609:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174528 00000100:00100000:1.0:1746065190.633611:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174528 00010000:00010000:1.0:1746065190.633619:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 8 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.633628:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174656 00000100:00100000:1.0:1746065190.633630:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174656 00010000:00010000:1.0:1746065190.633636:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 9 pid: 16767 timeout: 889 lvb_type: 0 00000100:00100000:1.0:1746065190.633648:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7612 00000100:00100000:1.0:1746065190.633654:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263174400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.633666:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.633671:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 9 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.633679:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 9 pid: 14643 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.633696:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.633701:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065190.633707:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065190.633712:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.633756:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263174400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.633761:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7612 00000100:00100000:1.0:1746065190.633787:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7613 00000100:00100000:1.0:1746065190.633791:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263174528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.633797:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.633801:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 9 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.633807:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 9 pid: 14644 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.633834:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.633838:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065190.633842:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065190.633845:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.633859:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263174528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.633864:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7613 00000100:00100000:1.0:1746065190.633874:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7614 00000100:00100000:1.0:1746065190.633877:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263174656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.633882:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.633885:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 8 pid: 16767 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.633892:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 8 pid: 16767 timeout: 889 lvb_type: 0 00010000:00010000:1.0:1746065190.633899:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065190.633902:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065190.633907:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065190.633913:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065190.633926:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.633937:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263174656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.633942:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7614 00010000:00010000:2.0:1746065190.634430:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a003b400/0x14b4f8542d4fd898 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61137 expref: 8 pid: 14643 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.634447:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260396032:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.634459:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f421a00/0x14b4f8542d4fd813 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f8 expref: 7 pid: 16767 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.634466:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260396160:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.634474:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b7ca00/0x14b4f8542d4fd805 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610f1 expref: 6 pid: 14644 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.634480:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260396288:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.634499:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.634504:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.634509:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000040:00080000:2.0:1746065190.635048:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3102, 88 off262408 00000004:00080000:2.0:1746065190.635055:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926238764ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635081:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3126, 88 off264696 00000004:00080000:2.0:1746065190.635085:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789926269293ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065190.635128:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3127, 88 off264784 00000004:00080000:2.0:1746065190.635131:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789926315611ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065190.635143:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3103, 88 off262496 00000004:00080000:2.0:1746065190.635145:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926329916ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635151:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3104, 88 off262584 00000004:00080000:2.0:1746065190.635153:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926338046ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635159:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3128, 88 off264872 00000004:00080000:2.0:1746065190.635162:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789926346608ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065190.635172:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3129, 88 off264960 00000004:00080000:2.0:1746065190.635174:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789926358496ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065190.635182:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3130, 88 off265048 00000004:00080000:2.0:1746065190.635184:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789926369271ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065190.635192:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3105, 88 off262672 00000004:00080000:2.0:1746065190.635195:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926379751ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635201:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3131, 88 off265136 00000004:00080000:2.0:1746065190.635203:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789926387786ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065190.635211:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3106, 88 off262760 00000004:00080000:2.0:1746065190.635214:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926398783ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635220:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3132, 88 off265224 00000004:00080000:2.0:1746065190.635222:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789926407101ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065190.635231:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3107, 88 off262848 00000004:00080000:2.0:1746065190.635233:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926418194ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635239:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3108, 88 off262936 00000004:00080000:2.0:1746065190.635241:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926426136ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635247:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3109, 88 off263024 00000004:00080000:2.0:1746065190.635249:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926434081ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635255:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3110, 88 off263112 00000004:00080000:2.0:1746065190.635257:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 789926441951ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065190.635263:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3133, 88 off265312 00000004:00080000:2.0:1746065190.635266:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789926450513ns, next at 737095943431ns, rc = 0 00000100:00100000:1.0:1746065190.635876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.636228:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263174912 00000100:00100000:3.0:1746065190.636235:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263174912 00002000:00100000:3.0:1746065190.636267:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f147100 x1830881263174912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.636275:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f147100 with x1830881263174912 ext(0->1048575) 00002000:00010000:3.0:1746065190.636279:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f147100 00000100:00100000:3.0:1746065190.636296:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8344 00000100:00100000:3.0:1746065190.636303:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263174912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.636872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.636892:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263175168 00000100:00100000:0.0:1746065190.636895:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263175168 00002000:00100000:0.0:1746065190.636912:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f468a80 x1830881263175168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.636919:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468a80 with x1830881263175168 ext(1048576->2097151) 00002000:00010000:0.0:1746065190.636923:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f468a80 00000100:00100000:0.0:1746065190.636934:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8345 00000100:00100000:0.0:1746065190.636938:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263175168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.642113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.642147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.642172:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263175424 00000100:00100000:0.0:1746065190.642178:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263175424 00002000:00100000:0.0:1746065190.642214:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009f468700 x1830881263175424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.642223:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468700 with x1830881263175424 ext(1048576->2097151) 00002000:00010000:0.0:1746065190.642228:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f468700 00000100:00100000:0.0:1746065190.642243:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263175680 00000100:00100000:0.0:1746065190.642245:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263175680 00002000:00100000:0.0:1746065190.642256:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f46a300 x1830881263175680/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.642262:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46a300 with x1830881263175680 ext(1048576->2097151) 00002000:00010000:0.0:1746065190.642265:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46a300 00000100:00100000:0.0:1746065190.642282:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8346 00000100:00100000:0.0:1746065190.642289:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263175424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.643586:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8347 00000100:00100000:3.0:1746065190.643595:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263175680:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065190.651016:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263175168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14069us (14139us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.651028:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8345 00002000:00100000:2.0:1746065190.651040:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f468a80 x1830881263175168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.651049:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468a80 with x1830881263175168 ext(1048576->2097151) 00002000:00010000:2.0:1746065190.651054:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f468a80 00000100:00100000:3.0:1746065190.657228:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263174912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20918us (21348us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.657238:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8344 00002000:00100000:3.0:1746065190.657249:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f147100 x1830881263174912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.657258:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f147100 with x1830881263174912 ext(0->1048575) 00002000:00010000:3.0:1746065190.657267:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f147100 00000100:00100000:1.0:1746065190.660218:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263175680:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16617us (18062us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065190.660228:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8347 00002000:00100000:1.0:1746065190.660830:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f46a300 x1830881263175680/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.660839:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46a300 with x1830881263175680 ext(1048576->2097151) 00002000:00010000:1.0:1746065190.660847:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46a300 00000100:00100000:2.0:1746065190.663794:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.663833:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263175936 00000100:00100000:2.0:1746065190.663841:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263175936 00000100:00100000:2.0:1746065190.663879:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10022 00000100:00100000:2.0:1746065190.663885:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31921:x1830881263175936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.663900:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.663914:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe400/0x14b4f8542d4fd8de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61176 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.664001:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664013:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664022:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664035:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664041:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664046:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664136:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664144:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664150:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065190.664159:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065190.664260:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664267:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664272:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664277:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ffbee00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.664280:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664285:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664293:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.664296:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065190.664300:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664304:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbee00/0x14b4f8542d4fd8f3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664317:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664325:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664329:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664332:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ffbea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.664334:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664338:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664343:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065190.664345:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065190.664347:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664351:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbea00/0x14b4f8542d4fd8e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664357:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664361:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664365:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664369:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ffbe200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.664371:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664379:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664384:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f200) 00010000:00010000:2.0:1746065190.664386:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065190.664388:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664391:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe200/0x14b4f8542d4fd8ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.664420:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe400/0x14b4f8542d4fd8de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61176 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.664427:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe400/0x14b4f8542d4fd8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61176 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.664433:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbe400, rc 0) 00000100:00100000:2.0:1746065190.664602:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:31921:x1830881263175936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 717us (813us total) trans 8589944274 rc 301/301 00000100:00100000:2.0:1746065190.664608:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10022 00000100:00100000:0.0:1746065190.669243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.669319:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176064 00000100:00100000:3.0:1746065190.669326:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176064 00000100:00100000:3.0:1746065190.669439:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10023 00000100:00100000:3.0:1746065190.669447:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:31918:x1830881263176064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.669463:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.669478:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6117d expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.669529:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065190.669537:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.669551:0:14644:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065190.669560:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.669571:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.669573:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065190.669576:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.669581:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd4ce00, rc 0) 00000100:00100000:3.0:1746065190.669617:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:31918:x1830881263176064:12345-192.168.202.46@tcp:101:cat.0 Request processed in 171us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.669622:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10023 00000100:00100000:1.0:1746065190.669976:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263175424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27566us (27747us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065190.669986:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8346 00002000:00100000:1.0:1746065190.669995:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009f468700 x1830881263175424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.670003:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f468700 with x1830881263175424 ext(1048576->2097151) 00002000:00010000:1.0:1746065190.670008:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f468700 00000100:00100000:0.0:1746065190.671952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.672991:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176192 00000100:00100000:2.0:1746065190.673000:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176192 00000100:00100000:2.0:1746065190.673037:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10024 00000100:00100000:2.0:1746065190.673043:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:31921:x1830881263176192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.673057:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.673071:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4fd908 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61184 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.673134:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.673144:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.673151:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000001:00080000:1.0:1746065190.679987:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944273 is committed 00000004:00080000:1.0:1746065190.679997:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2414 committed 00010000:00010000:2.0:1746065190.680304:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 253 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.680316:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.680318:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065190.680322:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.680329:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.680333:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.680339:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.680345:0:16767:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.680350:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.680388:0:16767:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.680399:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260396416:192.168.202.46@tcp:105: 00000004:00080000:1.0:1746065190.680526:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2390 committed 00000100:00100000:3.0:1746065190.680768:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260396544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.680804:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.680860:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260397056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.680878:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.680896:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746065190.680900:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260396928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.680914:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.680925:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260397440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.680937:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.680956:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260396800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.680970:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.680980:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260397312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.680992:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.681002:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065190.681005:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260396672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.681018:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.681029:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260397184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.681040:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.681063:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260396544 00000100:00100000:3.0:1746065190.681068:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260396544 00000100:00100000:3.0:1746065190.681095:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260397056 00000100:00100000:3.0:1746065190.681097:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260397056 00000100:00100000:3.0:1746065190.681107:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260396928 00000100:00100000:3.0:1746065190.681109:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260396928 00000100:00100000:3.0:1746065190.681118:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260397440 00000100:00100000:3.0:1746065190.681120:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260397440 00000100:00100000:3.0:1746065190.681129:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260396800 00000100:00100000:3.0:1746065190.681131:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260396800 00000100:00100000:3.0:1746065190.681136:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260397312 00000100:00100000:3.0:1746065190.681137:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260397312 00000100:00100000:3.0:1746065190.681142:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260396672 00000100:00100000:3.0:1746065190.681143:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260396672 00000100:00100000:3.0:1746065190.681148:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260397184 00000100:00100000:3.0:1746065190.681149:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260397184 00000100:00100000:3.0:1746065190.681156:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14839 00000100:00100000:3.0:1746065190.681162:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260396544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065190.681304:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065190.681307:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065191 -> 1746065191 00002000:00010000:3.0:1746065190.681309:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:3.0:1746065190.681310:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065191 -> 1746065191 00002000:00010000:3.0:1746065190.681312:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065190.681338:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260396544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (534us total) trans 17179873652 rc 0/0 00000100:00100000:3.0:1746065190.681343:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14839 00000100:00100000:3.0:1746065190.681356:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14840 00000100:00100000:3.0:1746065190.681360:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260397056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065190.681420:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065190.681422:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065190.681424:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065190.681425:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065190.681426:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065190.681444:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260397056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (565us total) trans 17179873653 rc 0/0 00000100:00100000:3.0:1746065190.681449:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14840 00000100:00100000:3.0:1746065190.681547:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14841 00000100:00100000:3.0:1746065190.681551:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260396928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065190.681612:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065190.681614:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065190.681616:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065190.681618:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065190.681619:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065190.681636:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260396928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (721us total) trans 17179873654 rc 0/0 00000100:00100000:3.0:1746065190.681640:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14841 00000100:00100000:3.0:1746065190.681649:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14842 00000100:00100000:3.0:1746065190.681653:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260397440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.681716:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260397440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (778us total) trans 17179873655 rc 0/0 00000100:00100000:3.0:1746065190.681721:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14842 00000100:00100000:3.0:1746065190.681729:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14843 00000100:00100000:3.0:1746065190.681733:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3298:x1830881260396800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065190.681805:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065190.681807:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065191 -> 1746065191 00002000:00010000:3.0:1746065190.681808:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065190 -> 1746065190 00002000:00010000:3.0:1746065190.681810:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065191 -> 1746065191 00002000:00010000:3.0:1746065190.681811:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746065190.681849:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830881260396800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (878us total) trans 17179873656 rc 0/0 00000100:00100000:3.0:1746065190.681865:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14843 00000100:00100000:3.0:1746065190.681874:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14844 00000100:00100000:3.0:1746065190.681878:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3298:x1830881260397312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065190.681945:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830881260397312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (952us total) trans 17179873657 rc 0/0 00000100:00100000:3.0:1746065190.681950:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14844 00000100:00100000:3.0:1746065190.681959:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14845 00000100:00100000:3.0:1746065190.681962:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3298:x1830881260396672:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065190.683173:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2389 committed 00000004:00080000:1.0:1746065190.683178:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2388 committed 00000004:00080000:1.0:1746065190.683179:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2387 committed 00000004:00080000:1.0:1746065190.683180:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2413 committed 00000004:00080000:1.0:1746065190.683182:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2386 committed 00000004:00080000:1.0:1746065190.683184:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2412 committed 00000004:00080000:1.0:1746065190.683186:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2385 committed 00000004:00080000:1.0:1746065190.683188:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2411 committed 00000004:00080000:1.0:1746065190.683191:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2410 committed 00000004:00080000:1.0:1746065190.683193:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2409 committed 00000004:00080000:1.0:1746065190.683194:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2384 committed 00000004:00080000:1.0:1746065190.683196:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2383 committed 00000004:00080000:1.0:1746065190.683197:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2408 committed 00000004:00080000:1.0:1746065190.683199:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2407 committed 00000004:00080000:1.0:1746065190.683205:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2382 committed 00000001:00080000:1.0:1746065190.683219:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944272 is committed 00000100:00100000:1.0:1746065190.683250:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14846 00000100:00100000:1.0:1746065190.683258:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3298:x1830881260397184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065190.683381:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3298:x1830881260397184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (2338us total) trans 17179873658 rc 0/0 00000100:00100000:1.0:1746065190.683386:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14846 00000100:00100000:2.0:1746065190.683884:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065190.683897:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.683904:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065190.683935:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065190.683938:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065190.683949:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065190.683976:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4fd908 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.683988:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 252 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.683994:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.683997:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065190.683999:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801302d2e00, rc 0) 00000100:00100000:2.0:1746065190.684030:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:31921:x1830881263176192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10988us (12082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.684036:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10024 00000100:00100000:1.0:1746065190.684533:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260397952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.684560:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065190.684572:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260398464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.684582:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065190.684591:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065190.684595:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260397568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.684603:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065190.684610:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260398080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.684629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065190.684643:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260397952 00000100:00100000:1.0:1746065190.684648:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260397952 00000100:00100000:1.0:1746065190.684665:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260398464 00000100:00100000:1.0:1746065190.684666:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260398464 00000100:00100000:1.0:1746065190.684671:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260397568 00000100:00100000:1.0:1746065190.684672:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260397568 00000100:00100000:1.0:1746065190.684676:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260398080 00000100:00100000:1.0:1746065190.684678:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260398080 00000100:00100000:1.0:1746065190.684683:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14847 00000100:00100000:1.0:1746065190.684687:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881260397952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065190.684783:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065190.684785:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065190.684787:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065190.684789:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065190.684790:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065190.684808:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260397952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (247us total) trans 21474840931 rc 0/0 00000100:00100000:1.0:1746065190.684812:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14847 00000100:00100000:1.0:1746065190.684835:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14848 00000100:00100000:1.0:1746065190.684838:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881260398464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.684898:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260398464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (315us total) trans 21474840932 rc 0/0 00000100:00100000:1.0:1746065190.684902:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14848 00000100:00100000:1.0:1746065190.684909:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14849 00000100:00100000:1.0:1746065190.684912:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881260397568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065190.684967:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065190.684969:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065189 -> 1746065189 00002000:00010000:1.0:1746065190.684971:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:1.0:1746065190.684973:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065189 -> 1746065189 00002000:00010000:1.0:1746065190.684974:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:1.0:1746065190.684987:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260397568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (382us total) trans 21474840933 rc 0/0 00000100:00100000:1.0:1746065190.684991:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14849 00000100:00100000:1.0:1746065190.684998:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14850 00000100:00100000:1.0:1746065190.685001:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830881260398080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.685052:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830881260398080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (422us total) trans 21474840934 rc 0/0 00000100:00100000:1.0:1746065190.685057:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14850 00000100:00100000:1.0:1746065190.685070:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260397696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.685083:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065190.685091:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260398208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.685100:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065190.685107:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746065190.685109:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260397824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.685119:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065190.685125:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260398336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.685133:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065190.685141:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260397696 00000100:00100000:1.0:1746065190.685144:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260397696 00000100:00100000:1.0:1746065190.685150:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260398208 00000100:00100000:1.0:1746065190.685152:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260398208 00000100:00100000:1.0:1746065190.685155:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260397824 00000100:00100000:1.0:1746065190.685157:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260397824 00000100:00100000:1.0:1746065190.685160:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260398336 00000100:00100000:1.0:1746065190.685161:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260398336 00000100:00100000:1.0:1746065190.685166:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14851 00000100:00100000:1.0:1746065190.685169:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881260397696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065190.685223:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065190.685225:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065190 -> 1746065190 00002000:00010000:1.0:1746065190.685227:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065187 -> 1746065187 00002000:00010000:1.0:1746065190.685228:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065190 -> 1746065190 00002000:00010000:1.0:1746065190.685230:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746065190.685245:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260397696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (162us total) trans 21474840935 rc 0/0 00000100:00100000:1.0:1746065190.685249:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14851 00000100:00100000:1.0:1746065190.685256:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14852 00000100:00100000:1.0:1746065190.685259:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881260398208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.685310:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260398208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (209us total) trans 21474840936 rc 0/0 00000100:00100000:1.0:1746065190.685314:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14852 00000100:00100000:1.0:1746065190.685320:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14853 00000100:00100000:1.0:1746065190.685323:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881260397824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065190.685377:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:1.0:1746065190.685379:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065191 -> 1746065191 00002000:00010000:1.0:1746065190.685380:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065190 -> 1746065190 00002000:00010000:1.0:1746065190.685382:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065190 -> 1746065190 00002000:00010000:1.0:1746065190.685383:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5767 -> 5767 00000100:00100000:3.0:1746065190.685387:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14854 00000100:00100000:3.0:1746065190.685395:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260398336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065190.685400:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260397824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (279us total) trans 21474840937 rc 0/0 00000100:00100000:1.0:1746065190.685404:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14853 00000004:00080000:1.0:1746065190.685430:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46aa00/2, rc 0, transno 21474840937 00000100:00100000:1.0:1746065190.685436:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260397824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065190.685443:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46ad80/2, rc 0, transno 21474840935 00000100:00100000:1.0:1746065190.685446:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260397696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065190.685451:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f469880/2, rc 0, transno 21474840936 00000100:00100000:1.0:1746065190.685454:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260398208:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065190.685466:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f469500/2, rc 0, transno 21474840933 00000100:00100000:1.0:1746065190.685468:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260397568:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065190.685472:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f469180/2, rc 0, transno 21474840934 00000100:00100000:1.0:1746065190.685474:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260398080:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065190.685478:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1746065190.685479:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46bb80/2, rc 0, transno 21474840931 00002000:00010000:3.0:1746065190.685480:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:1.0:1746065190.685481:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260397952:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065190.685482:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065190.685483:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065190.685485:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1746065190.685486:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46b800/2, rc 0, transno 21474840932 00000100:00100000:1.0:1746065190.685488:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260398464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065190.685510:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260398336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (375us total) trans 21474840938 rc 0/0 00000004:00080000:1.0:1746065190.685517:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f468e00/2, rc 0, transno 21474840938 00000100:00100000:3.0:1746065190.685518:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14854 00000100:00100000:1.0:1746065190.685520:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260398336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065190.685607:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee1880/2, rc 0, transno 17179873658 00000100:00100000:3.0:1746065190.685612:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260397184:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065190.685620:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee0000/2, rc 0, transno 17179873656 00000100:00100000:3.0:1746065190.685623:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260396800:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065190.685630:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee3100/2, rc 0, transno 17179873657 00000100:00100000:3.0:1746065190.685632:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260397312:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065190.685647:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee3480/2, rc 0, transno 17179873654 00000100:00100000:3.0:1746065190.685649:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260396928:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065190.685655:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee2a00/2, rc 0, transno 17179873655 00000100:00100000:3.0:1746065190.685657:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260397440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065190.685664:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee1180/2, rc 0, transno 17179873652 00000100:00100000:3.0:1746065190.685667:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260396544:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065190.685672:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee0e00/2, rc 0, transno 17179873653 00000100:00100000:3.0:1746065190.685674:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260397056:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065190.685764:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065190.685766:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065190 -> 1746065190 00002000:00010000:3.0:1746065190.685768:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065189 -> 1746065189 00002000:00010000:3.0:1746065190.685770:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065190 -> 1746065190 00002000:00010000:3.0:1746065190.685771:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065190.685783:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f46b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260398592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065190.685793:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830881260396672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3830us (4773us total) trans 17179873659 rc 0/0 00000100:00100000:3.0:1746065190.685798:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14845 00000100:00100000:2.0:1746065190.685803:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065190.685810:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260398592 00000100:00100000:3.0:1746065190.685826:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260398592 00000100:00100000:3.0:1746065190.685840:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14855 00000100:00100000:3.0:1746065190.685844:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881260398592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065190.685915:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260398592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (111us total) trans 21474840939 rc 0/0 00000100:00100000:3.0:1746065190.685920:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14855 00000004:00080000:3.0:1746065190.685943:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee0a80/2, rc 0, transno 17179873659 00000100:00100000:3.0:1746065190.685946:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260396672:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065190.686104:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f46b100/2, rc 0, transno 21474840939 00000100:00100000:2.0:1746065190.686108:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f46b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260398592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065190.686309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.686343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.686359:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176448 00000100:00100000:0.0:1746065190.686362:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176448 00000100:00100000:0.0:1746065190.686381:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4299 00000100:00100000:0.0:1746065190.686386:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:31918:x1830881263176448:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065190.686444:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:31918:x1830881263176448:12345-192.168.202.46@tcp:49:cat.0 Request processed in 58us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.686449:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4299 00000100:00100000:3.0:1746065190.686504:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176320 00000100:00100000:3.0:1746065190.686507:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176320 00000100:00100000:3.0:1746065190.686523:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10025 00000100:00100000:3.0:1746065190.686527:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:31921:x1830881263176320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.686536:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.686547:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6118b expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.686574:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.686585:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.686597:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065190.686599:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065190.686602:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c000, rc 0) 00000100:00100000:3.0:1746065190.686615:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31921:x1830881263176320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.686621:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10025 00000100:00100000:2.0:1746065190.686836:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260396416:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.686856:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccde00/0x14b4f8542d4fd8d0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 252 pid: 16767 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065190.686867:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 251 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.686878:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fccd600, rc 0) 00000100:00100000:2.0:1746065190.686897:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31912:x1830881263174272:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 61403us (61664us total) trans 8589944273 rc 0/0 00000100:00100000:2.0:1746065190.686902:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10021 00000100:00100000:2.0:1746065190.693917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.694154:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176576 00000100:00100000:3.0:1746065190.694162:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176576 00000100:00100000:3.0:1746065190.694258:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14856 00000100:00100000:3.0:1746065190.694265:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:31912:x1830881263176576:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065190.694279:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.694292:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61192 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.694315:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.694322:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.694328:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.694333:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.694334:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.694337:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2125824->3108863] (req 2125824->3108863) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.694357:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.694367:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 8 pid: 2463 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.694377:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260398720:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.694596:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.694604:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 10 pid: 4545 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.694612:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260398848:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.694630:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 16 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.694637:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 16 pid: 4544 timeout: 889 lvb_type: 0 00000100:00100000:3.0:1746065190.694644:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260398976:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.694653:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.699663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.699719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.699913:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263176832 00000100:00100000:2.0:1746065190.699921:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263176832 00002000:00100000:2.0:1746065190.699961:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f46b480 x1830881263176832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.699969:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b480 with x1830881263176832 ext(0->1048575) 00002000:00010000:2.0:1746065190.699974:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46b480 00000100:00100000:2.0:1746065190.700001:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177088 00000100:00100000:2.0:1746065190.700004:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177088 00002000:00100000:2.0:1746065190.700016:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880095355500 x1830881263177088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.700028:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355500 with x1830881263177088 ext(1048576->2097151) 00002000:00010000:2.0:1746065190.700032:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095355500 00000100:00100000:2.0:1746065190.700045:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8348 00000100:00100000:2.0:1746065190.700050:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263176832:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065190.700225:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8349 00000100:00100000:1.0:1746065190.700232:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263177088:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065190.701929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.703010:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177344 00000100:00100000:3.0:1746065190.703018:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177344 00002000:00100000:3.0:1746065190.703048:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880095356300 x1830881263177344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.703057:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356300 with x1830881263177344 ext(1048576->2097151) 00002000:00010000:3.0:1746065190.703061:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356300 00000100:00100000:3.0:1746065190.703084:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8350 00000100:00100000:3.0:1746065190.703090:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263177344:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065190.704732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.704767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.704790:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177600 00000100:00100000:0.0:1746065190.704797:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177600 00000100:00100000:2.0:1746065190.704829:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:0.0:1746065190.704839:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009ba1fb80 x1830881263177600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.704847:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1fb80 with x1830881263177600 ext(1048576->2097151) 00000100:00100000:2.0:1746065190.704848:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177984 00000100:00100000:2.0:1746065190.704851:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177984 00002000:00010000:0.0:1746065190.704852:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1fb80 00000100:00100000:0.0:1746065190.704864:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263177856 00000100:00100000:0.0:1746065190.704866:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263177856 00010000:00010000:2.0:1746065190.704869:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 9 pid: 2463 timeout: 889 lvb_type: 1 00002000:00100000:0.0:1746065190.704877:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009ba1c380 x1830881263177856/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.704883:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c380 with x1830881263177856 ext(1048576->2097151) 00002000:00010000:0.0:1746065190.704886:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1c380 00000100:00100000:2.0:1746065190.704890:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7615 00000100:00100000:2.0:1746065190.704896:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263177984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065190.704896:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8351 00000100:00100000:0.0:1746065190.704901:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881263177600:12345-192.168.202.46@tcp:3:multiop.0 00010000:00010000:2.0:1746065190.704906:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.704923:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 9 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.704933:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 9 pid: 2463 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.704955:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.704987:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263177984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.704992:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8352 00000100:00100000:2.0:1746065190.704993:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7615 00000100:00100000:0.0:1746065190.704997:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263177856:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065190.705121:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc83400/0x14b4f8542d4fd844 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6111b expref: 8 pid: 2463 timeout: 889 lvb_type: 1 00000100:00100000:3.0:1746065190.705150:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260398720:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.711908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.711922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.711936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.712533:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260398848:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.712543:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260398976:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.712569:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2125824->3108863] (req 2125824->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.712585:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c800, rc 0) 00000100:00100000:3.0:1746065190.712613:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:31912:x1830881263176576:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 18348us (18702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.712621:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14856 00000100:00100000:3.0:1746065190.712643:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178368 00000100:00100000:3.0:1746065190.712647:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178368 00000100:00100000:3.0:1746065190.712672:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14857 00000100:00100000:3.0:1746065190.712678:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:31915:x1830881263178368:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065190.712690:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.712702:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61199 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.712721:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 25 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.712733:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.712751:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.712757:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.712758:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.712761:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.712784:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.712795:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 8 pid: 8428 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746065190.712805:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260399104:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.712864:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.712872:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 15 pid: 21998 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746065190.712878:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260399232:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.712896:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 25 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.712902:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 25 pid: 2463 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746065190.712908:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260399360:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.712918:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.713325:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178240 00000100:00100000:2.0:1746065190.713329:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178240 00010000:00010000:2.0:1746065190.713345:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 19 pid: 4544 timeout: 889 lvb_type: 0 00000100:00100000:2.0:1746065190.713362:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178112 00000100:00100000:2.0:1746065190.713364:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178112 00010000:00010000:2.0:1746065190.713371:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00000100:00100000:2.0:1746065190.713383:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7616 00000100:00100000:2.0:1746065190.713387:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263178240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.713394:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.713409:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 19 pid: 4544 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.713418:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 19 pid: 4544 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.713434:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5574800/0x14b4f8542d4fd7b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c0 expref: 19 pid: 4544 timeout: 889 lvb_type: 0 00010000:00010000:2.0:1746065190.713446:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.713462:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881263178240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.713470:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7616 00000100:00100000:2.0:1746065190.713479:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7617 00000100:00100000:2.0:1746065190.713483:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263178112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.713488:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.713495:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.713502:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.713513:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fccd800/0x14b4f8542d4fd8c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6115a expref: 11 pid: 4545 timeout: 889 lvb_type: 1 00010000:00010000:2.0:1746065190.713519:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.713520:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.713525:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.713531:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.713547:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.713555:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260399488:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065190.713574:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065190.713854:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263177088:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13617us (14130us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065190.713861:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8349 00002000:00100000:1.0:1746065190.713868:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880095355500 x1830881263177088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.713876:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355500 with x1830881263177088 ext(1048576->2097151) 00002000:00010000:1.0:1746065190.713879:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095355500 00000100:00100000:3.0:1746065190.718065:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260399104:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.718566:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263176832:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 18513us (18909us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.718576:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8348 00002000:00100000:2.0:1746065190.718584:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f46b480 x1830881263176832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.718597:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b480 with x1830881263176832 ext(0->1048575) 00002000:00010000:2.0:1746065190.718602:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46b480 00000100:00100000:0.0:1746065190.719239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.719477:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178496 00000100:00100000:2.0:1746065190.719483:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178496 00010000:00010000:2.0:1746065190.719505:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 9 pid: 8428 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746065190.719540:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7618 00000100:00100000:2.0:1746065190.719546:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263178496:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.719557:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065190.719573:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 9 pid: 8428 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746065190.719585:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 9 pid: 8428 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746065190.719605:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f3be400/0x14b4f8542d4fd82f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61122 expref: 9 pid: 8428 timeout: 890 lvb_type: 1 00010000:00010000:2.0:1746065190.719618:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.719637:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263178496:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 92us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.719643:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7618 00000100:00100000:2.0:1746065190.721989:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.722036:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178624 00000100:00100000:0.0:1746065190.722043:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178624 00000100:00100000:2.0:1746065190.722055:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260399488:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.722070:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065190.722072:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 16 pid: 21998 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746065190.722103:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881263178112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8618us (10179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.722106:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7619 00000100:00100000:2.0:1746065190.722111:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7617 00000100:00100000:0.0:1746065190.722112:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263178624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.722123:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065190.722142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065190.722142:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 16 pid: 21998 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746065190.722153:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263178752 00010000:00010000:0.0:1746065190.722153:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 16 pid: 21998 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746065190.722155:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263178752 00010000:00010000:0.0:1746065190.722171:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065190.722175:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 25 pid: 2463 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746065190.722188:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263178624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.722193:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7620 00000100:00100000:1.0:1746065190.722201:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263178752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.722208:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.722219:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 25 pid: 2463 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746065190.722229:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 25 pid: 2463 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746065190.722241:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.722243:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.722251:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.722256:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc83200/0x14b4f8542d4fd8ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61161 expref: 16 pid: 21998 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746065190.722260:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.722290:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.722291:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260399232:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.722300:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f43de00/0x14b4f8542d4fd7db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610e3 expref: 25 pid: 2463 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746065190.722303:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260399616:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065190.722308:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260399360:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.722331:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.722339:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a61c00, rc 0) 00000100:00100000:1.0:1746065190.722347:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065190.722361:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:31915:x1830881263178368:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9682us (10423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.722366:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14857 00000100:00100000:0.0:1746065190.722427:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7619 00000100:00100000:2.0:1746065190.722467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.722548:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263179008 00000100:00100000:3.0:1746065190.722552:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263179008 00002000:00100000:3.0:1746065190.722573:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2125824->2129919) req@ffff88009ba1ed80 x1830881263179008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.722581:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ed80 with x1830881263179008 ext(2125824->2129919) 00002000:00010000:3.0:1746065190.722598:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1ed80 00000100:00100000:3.0:1746065190.722612:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8353 00000100:00100000:3.0:1746065190.722618:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263179008:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065190.722790:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263179008:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 172us (323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065190.722796:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8353 00002000:00100000:3.0:1746065190.722800:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2125824->2129919) req@ffff88009ba1ed80 x1830881263179008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.722807:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ed80 with x1830881263179008 ext(2125824->2129919) 00002000:00010000:3.0:1746065190.722810:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1ed80 00000100:00100000:1.0:1746065190.723147:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263177856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18148us (18379us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065190.723153:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8352 00002000:00100000:1.0:1746065190.723158:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009ba1c380 x1830881263177856/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.723178:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c380 with x1830881263177856 ext(1048576->2097151) 00002000:00010000:1.0:1746065190.723182:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1c380 00000100:00100000:3.0:1746065190.724045:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263177344:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 20952us (22117us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.724051:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8350 00002000:00100000:3.0:1746065190.724056:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880095356300 x1830881263177344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.724064:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356300 with x1830881263177344 ext(1048576->2097151) 00002000:00010000:3.0:1746065190.724067:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356300 00000100:00100000:1.0:1746065190.725227:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260399616:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065190.725243:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.725277:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263178752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3076us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.725284:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7620 00000100:00100000:2.0:1746065190.725479:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263177600:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 20575us (20751us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.725486:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8351 00002000:00100000:2.0:1746065190.725492:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009ba1fb80 x1830881263177600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.725500:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1fb80 with x1830881263177600 ext(1048576->2097151) 00002000:00010000:2.0:1746065190.725504:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1fb80 00000100:00100000:0.0:1746065190.729628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.729718:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263179264 00000100:00100000:2.0:1746065190.729726:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263179264 00002000:00100000:2.0:1746065190.729771:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3923968->3928063) req@ffff880095356a00 x1830881263179264/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.729787:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356a00 with x1830881263179264 ext(3923968->3928063) 00002000:00010000:2.0:1746065190.729792:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356a00 00000100:00100000:2.0:1746065190.729844:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8354 00000100:00100000:2.0:1746065190.729850:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263179264:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065190.729988:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263179264:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 138us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065190.729994:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8354 00002000:00100000:2.0:1746065190.729999:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3923968->3928063) req@ffff880095356a00 x1830881263179264/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.730005:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356a00 with x1830881263179264 ext(3923968->3928063) 00002000:00010000:2.0:1746065190.730008:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095356a00 00000100:00100000:0.0:1746065190.731468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.731787:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263179520 00000100:00100000:2.0:1746065190.731793:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263179520 00002000:00100000:2.0:1746065190.731839:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2125823) req@ffff880095355180 x1830881263179520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.731847:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355180 with x1830881263179520 ext(2097152->2125823) 00002000:00010000:2.0:1746065190.731851:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355180 00000100:00100000:2.0:1746065190.731871:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8355 00000100:00100000:2.0:1746065190.731876:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263179520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.732207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.732274:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263179776 00000100:00100000:3.0:1746065190.732278:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263179776 00002000:00100000:3.0:1746065190.732293:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3104768->3108863) req@ffff880095355c00 x1830881263179776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.732300:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355c00 with x1830881263179776 ext(3104768->3108863) 00002000:00010000:3.0:1746065190.732302:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355c00 00000100:00100000:3.0:1746065190.732313:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8356 00000100:00100000:3.0:1746065190.732317:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263179776:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.732409:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263179776:12345-192.168.202.46@tcp:3:cat.0 Request processed in 90us (201us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065190.732414:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8356 00002000:00100000:3.0:1746065190.732418:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3104768->3108863) req@ffff880095355c00 x1830881263179776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.732425:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355c00 with x1830881263179776 ext(3104768->3108863) 00002000:00010000:3.0:1746065190.732427:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095355c00 00000100:00100000:0.0:1746065190.733684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.733708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.733721:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263179904 00000100:00100000:3.0:1746065190.733726:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263179904 00000100:00100000:3.0:1746065190.733761:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14858 00000100:00100000:3.0:1746065190.733767:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:31915:x1830881263179904:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065190.733777:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.733790:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611a0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.733811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065190.733831:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.733835:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263180160 00010000:00010000:3.0:1746065190.733839:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746065190.733839:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263180160 00000100:00100000:0.0:1746065190.733840:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263180416 00010000:00010000:3.0:1746065190.733841:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746065190.733843:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263180416 00010000:00010000:3.0:1746065190.733844:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [4194304->4841471] (req 4194304->4841471) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065190.733858:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880095354700 x1830881263180160/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065190.733863:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4300 00002000:00100000:1.0:1746065190.733865:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354700 with x1830881263180160 ext(1048576->2097151) 00010000:00010000:3.0:1746065190.733868:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065190.733868:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354700 00000100:00100000:0.0:1746065190.733868:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:31912:x1830881263180416:12345-192.168.202.46@tcp:35:multiop.0 00010000:00010000:3.0:1746065190.733878:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065190.733881:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8357 00000100:00100000:1.0:1746065190.733886:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263180160:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065190.733889:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260399744:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.733893:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263179520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 2014us (2425us total) trans 0 rc 28672/28672 00000100:00100000:2.0:1746065190.733900:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8355 00002000:00100000:2.0:1746065190.733907:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2125823) req@ffff880095355180 x1830881263179520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 28672/28672 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.733914:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355180 with x1830881263179520 ext(2097152->2125823) 00010000:00010000:2.0:1746065190.733919:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065190.733924:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.734014:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:31912:x1830881263180416:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 145us (202us total) trans 8589944275 rc 0/0 00010000:00010000:2.0:1746065190.734019:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065190.734020:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4300 00002000:00010000:2.0:1746065190.734026:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095355180 00000100:00100000:0.0:1746065190.734714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.734779:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263180672 00000100:00100000:2.0:1746065190.734783:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263180672 00002000:00100000:2.0:1746065190.734796:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880095356d80 x1830881263180672/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.734803:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356d80 with x1830881263180672 ext(1048576->2097151) 00002000:00010000:2.0:1746065190.734806:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095356d80 00000100:00100000:3.0:1746065190.734847:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8358 00000100:00100000:3.0:1746065190.734853:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263180672:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065190.735302:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260399744:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.735319:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [4194304->4841471] (req 4194304->4841471) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.735328:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b2e00, rc 0) 00000100:00100000:2.0:1746065190.735346:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:31915:x1830881263179904:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1580us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.735352:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14858 00000100:00100000:0.0:1746065190.739912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.740008:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263180800 00000100:00100000:2.0:1746065190.740016:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263180800 00002000:00100000:2.0:1746065190.740054:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2125824->3108863) req@ffff880095357b80 x1830881263180800/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.740064:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095357b80 with x1830881263180800 ext(2125824->3108863) 00010000:00010000:2.0:1746065190.740073:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065190.740085:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065190.740091:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095357b80 00000100:00100000:2.0:1746065190.740440:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2538 00000100:00100000:2.0:1746065190.740449:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263180800:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065190.743292:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263180160:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 9399us (9576us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065190.743302:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8357 00002000:00100000:1.0:1746065190.743310:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880095354700 x1830881263180160/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.743318:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354700 with x1830881263180160 ext(1048576->2097151) 00002000:00010000:1.0:1746065190.743322:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095354700 00000100:00100000:3.0:1746065190.743785:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263180672:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8931us (9071us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.743792:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8358 00002000:00100000:3.0:1746065190.743798:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880095356d80 x1830881263180672/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.743804:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095356d80 with x1830881263180672 ext(1048576->2097151) 00002000:00010000:3.0:1746065190.743808:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095356d80 00000100:00100000:2.0:1746065190.750662:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.750767:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263180928 00000100:00100000:3.0:1746065190.750774:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263180928 00000100:00100000:3.0:1746065190.750835:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14859 00000100:00100000:3.0:1746065190.750842:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:31918:x1830881263180928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.750859:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.750872:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611a7 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.750894:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065190.750895:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065190.750899:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.750909:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.750916:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b2400, rc 0) 00000100:00100000:2.0:1746065190.753302:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263180800:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12848us (13393us total) trans 21474840940 rc 0/0 00000100:00100000:2.0:1746065190.753312:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2538 00002000:00100000:2.0:1746065190.753321:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2125824->3108863) req@ffff880095357b80 x1830881263180800/t21474840940(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/448 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.753329:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095357b80 with x1830881263180800 ext(2125824->3108863) 00010000:00010000:2.0:1746065190.753337:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065190.753351:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065190.753362:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095357b80 00000100:00100000:3.0:1746065190.753444:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:31918:x1830881263180928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2602us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.753451:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14859 00000100:00100000:0.0:1746065190.756436:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.756632:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263181184 00000100:00100000:2.0:1746065190.756639:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263181184 00002000:00100000:2.0:1746065190.756673:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3108864->3145727) req@ffff880095354a80 x1830881263181184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.756683:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354a80 with x1830881263181184 ext(3108864->3145727) 00010000:00010000:2.0:1746065190.756691:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065190.756705:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065190.756711:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095354a80 00000100:00100000:3.0:1746065190.759361:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2539 00000100:00100000:3.0:1746065190.759386:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881263181184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.762313:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881263181184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 2934us (5876us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1746065190.762323:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2539 00002000:00100000:3.0:1746065190.762332:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3108864->3145727) req@ffff880095354a80 x1830881263181184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 36864/36864 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.762341:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354a80 with x1830881263181184 ext(3108864->3145727) 00010000:00010000:3.0:1746065190.762350:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065190.762365:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065190.762372:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095354a80 00000100:00100000:0.0:1746065190.764424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.764538:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263181312 00000100:00100000:3.0:1746065190.764546:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263181312 00000100:00100000:3.0:1746065190.764687:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14860 00000100:00100000:3.0:1746065190.764694:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31921:x1830881263181312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.764709:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.764723:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611ae expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.764760:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.764767:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065190.764769:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065190.764772:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.764798:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.764807:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 11 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065190.764948:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260399872:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.765222:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.766197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.767038:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263181440 00000100:00100000:1.0:1746065190.767045:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263181440 00010000:00010000:1.0:1746065190.767070:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065190.767096:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7621 00000100:00100000:1.0:1746065190.767102:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263181440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.767112:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065190.767126:0:7080:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065190 -> 1746065191 00010000:00010000:1.0:1746065190.767131:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065190.767140:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065190.767160:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73c800/0x14b4f8542d4fd91d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2125824->3108863) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61192 expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065190.767185:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.767187:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.767277:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.767286:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.767293:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.767294:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.767297:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.767304:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.767550:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.767564:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260400000:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065190.767632:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.767640:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260400128:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065190.767657:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065190.767865:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260399872:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.767885:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.767896:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b3000, rc 0) 00000100:00100000:3.0:1746065190.767921:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31921:x1830881263181312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3228us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065190.767928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.768006:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14860 00000100:00100000:3.0:1746065190.768032:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263181568 00000100:00100000:3.0:1746065190.768035:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263181568 00002000:00100000:3.0:1746065190.768054:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3923968->4194303) req@ffff880095354380 x1830881263181568/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.768063:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354380 with x1830881263181568 ext(3923968->4194303) 00010000:00010000:3.0:1746065190.768068:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 12 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065190.768078:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 12 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065190.768083:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095354380 00000100:00100000:3.0:1746065190.768104:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2540 00000100:00100000:3.0:1746065190.768110:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263181568:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065190.769884:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260400000:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065190.769897:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260400128:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065190.769916:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.769963:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881263181440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2861us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.769972:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7621 00000100:00100000:0.0:1746065190.772966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.773040:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263181824 00000100:00100000:2.0:1746065190.773046:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263181824 00002000:00100000:2.0:1746065190.773078:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4837376->4841471) req@ffff88009ba3e680 x1830881263181824/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.773087:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3e680 with x1830881263181824 ext(4837376->4841471) 00002000:00010000:2.0:1746065190.773091:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3e680 00000100:00100000:2.0:1746065190.773165:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8359 00000100:00100000:2.0:1746065190.773173:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263181824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065190.773279:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263181824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 107us (320us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065190.773286:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8359 00002000:00100000:2.0:1746065190.773291:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4837376->4841471) req@ffff88009ba3e680 x1830881263181824/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.773298:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3e680 with x1830881263181824 ext(4837376->4841471) 00002000:00010000:2.0:1746065190.773300:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3e680 00000100:00100000:0.0:1746065190.773620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.773763:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263182080 00000100:00100000:1.0:1746065190.773767:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263182080 00002000:00100000:1.0:1746065190.773783:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009ba3e300 x1830881263182080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.773790:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3e300 with x1830881263182080 ext(2097152->3145727) 00002000:00010000:1.0:1746065190.773794:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3e300 00000100:00100000:1.0:1746065190.773869:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8360 00000100:00100000:1.0:1746065190.773875:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263182080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.773887:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263181568:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5775us (5957us total) trans 17179873660 rc 0/0 00000100:00100000:3.0:1746065190.773895:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2540 00002000:00100000:3.0:1746065190.773901:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3923968->4194303) req@ffff880095354380 x1830881263181568/t17179873660(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/448 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.773908:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354380 with x1830881263181568 ext(3923968->4194303) 00010000:00010000:3.0:1746065190.773915:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065190.773928:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065190.773934:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095354380 00000100:00100000:0.0:1746065190.776430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.776581:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263182336 00000100:00100000:2.0:1746065190.776588:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263182336 00000100:00100000:2.0:1746065190.776619:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4301 00000100:00100000:2.0:1746065190.776625:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:31915:x1830881263182336:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065190.777673:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:31915:x1830881263182336:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1045us (1246us total) trans 8589944276 rc 0/0 00000100:00100000:2.0:1746065190.777679:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4301 00000100:00100000:1.0:1746065190.777869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.778019:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263182464 00000100:00100000:0.0:1746065190.778023:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263182464 00010000:00010000:0.0:1746065190.778047:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065190.778080:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7622 00000100:00100000:0.0:1746065190.778086:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263182464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.778095:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065190.778113:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.778123:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.778142:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a61c00/0x14b4f8542d4fd924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61199 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.778166:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.778168:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.778174:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.778181:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.778205:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.778215:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260400256:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065190.778274:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.780328:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260400256:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.780348:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.780397:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263182464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2310us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.780406:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7622 00000100:00100000:2.0:1746065190.781538:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263182080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7659us (7914us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.781546:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8360 00002000:00100000:2.0:1746065190.781554:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009ba3e300 x1830881263182080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.781562:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3e300 with x1830881263182080 ext(2097152->3145727) 00002000:00010000:2.0:1746065190.781567:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3e300 00000100:00100000:0.0:1746065190.782229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.782912:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263182720 00000100:00100000:2.0:1746065190.782919:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263182720 00002000:00100000:2.0:1746065190.782957:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009ba3d500 x1830881263182720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.782964:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d500 with x1830881263182720 ext(2097152->3145727) 00002000:00010000:2.0:1746065190.782968:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3d500 00000100:00100000:2.0:1746065190.783081:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8361 00000100:00100000:2.0:1746065190.783088:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263182720:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065190.785332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.785421:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263182848 00000100:00100000:3.0:1746065190.785427:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263182848 00000100:00100000:3.0:1746065190.785471:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14861 00000100:00100000:3.0:1746065190.785478:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:31918:x1830881263182848:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.785490:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.785504:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611b5 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.785524:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.785526:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.785532:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.785547:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.785556:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944b7800, rc 0) 00000100:00100000:3.0:1746065190.785602:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:31918:x1830881263182848:12345-192.168.202.46@tcp:101:cat.0 Request processed in 124us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.785608:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14861 00000100:00100000:0.0:1746065190.792968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.793059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.793085:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.793317:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263183232 00000100:00100000:2.0:1746065190.793325:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263183232 00000100:00100000:1.0:1746065190.793344:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263183360 00000100:00100000:1.0:1746065190.793347:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263183360 00002000:00100000:2.0:1746065190.793365:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009ba3c000 x1830881263183232/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.793365:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009ba3dc00 x1830881263183360/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.793374:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c000 with x1830881263183232 ext(2097152->3145727) 00002000:00100000:1.0:1746065190.793374:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3dc00 with x1830881263183360 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.793379:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3c000 00002000:00010000:1.0:1746065190.793379:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3dc00 00000100:00100000:2.0:1746065190.793393:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263183616 00000100:00100000:2.0:1746065190.793395:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263183616 00002000:00100000:2.0:1746065190.793407:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba3fb80 x1830881263183616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065190.793410:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8362 00002000:00100000:2.0:1746065190.793413:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3fb80 with x1830881263183616 ext(3145728->4194303) 00000100:00100000:1.0:1746065190.793415:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263183232:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:2.0:1746065190.793416:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba3fb80 00000100:00100000:2.0:1746065190.793434:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8363 00000100:00100000:2.0:1746065190.793438:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263183360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.794333:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8364 00000100:00100000:3.0:1746065190.794342:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263183616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065190.796837:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263182720:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13742us (14601us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.796847:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8361 00002000:00100000:2.0:1746065190.796857:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009ba3d500 x1830881263182720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.796866:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3d500 with x1830881263182720 ext(2097152->3145727) 00002000:00010000:2.0:1746065190.796871:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3d500 00000100:00100000:2.0:1746065190.806431:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263183360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12984us (13363us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.806440:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8363 00002000:00100000:2.0:1746065190.806450:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009ba3dc00 x1830881263183360/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.806458:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3dc00 with x1830881263183360 ext(3145728->4194303) 00002000:00010000:2.0:1746065190.806464:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3dc00 00000100:00100000:0.0:1746065190.806934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.807170:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263183744 00000100:00100000:3.0:1746065190.807176:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263183744 00000100:00100000:3.0:1746065190.807908:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14862 00000100:00100000:3.0:1746065190.807916:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:31921:x1830881263183744:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.807928:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.807940:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611bc expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.807963:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.807969:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065190.807971:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065190.807973:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.807999:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.808009:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065190.808018:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260400384:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.808078:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065190.809337:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263183232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15919us (16375us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065190.809345:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8362 00002000:00100000:1.0:1746065190.809353:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009ba3c000 x1830881263183232/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065190.809361:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3c000 with x1830881263183232 ext(2097152->3145727) 00002000:00010000:1.0:1746065190.809365:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba3c000 00000100:00100000:3.0:1746065190.810472:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260400384:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065190.810494:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.810504:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944b6400, rc 0) 00000100:00100000:3.0:1746065190.810539:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:31921:x1830881263183744:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2624us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065190.810545:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14862 00000100:00100000:0.0:1746065190.813752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.813970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.814323:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263184000 00000100:00100000:3.0:1746065190.814325:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263183616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19983us (21237us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065190.814329:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263184000 00000100:00100000:3.0:1746065190.814335:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8364 00002000:00100000:3.0:1746065190.814344:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba3fb80 x1830881263183616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.814352:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3fb80 with x1830881263183616 ext(3145728->4194303) 00010000:00010000:3.0:1746065190.814359:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065190.814359:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14863 00000100:00100000:2.0:1746065190.814365:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:31918:x1830881263184000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.814371:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065190.814376:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746065190.814378:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3fb80 00010000:00010000:2.0:1746065190.814388:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611c3 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.814391:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263183872 00000100:00100000:3.0:1746065190.814394:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263183872 00010000:00010000:2.0:1746065190.814407:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065190.814411:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065190.814412:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4841471) req@ffff88009ba3f800 x1830881263183872/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.814419:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f800 with x1830881263183872 ext(4194304->4841471) 00010000:00010000:2.0:1746065190.814421:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.814422:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065190.814429:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065190.814430:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b88800, rc 0) 00002000:00010000:3.0:1746065190.814435:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3f800 00000100:00100000:2.0:1746065190.814450:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:31918:x1830881263184000:12345-192.168.202.46@tcp:101:cat.0 Request processed in 85us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.814455:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14863 00000100:00100000:3.0:1746065190.814494:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2541 00000100:00100000:3.0:1746065190.814500:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263183872:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065190.821356:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263183872:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6847us (7612us total) trans 21474840941 rc 0/0 00000100:00100000:3.0:1746065190.821367:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2541 00002000:00100000:3.0:1746065190.821377:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4841471) req@ffff88009ba3f800 x1830881263183872/t21474840941(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/448 e 0 to 0 dl 1746065201 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.821386:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba3f800 with x1830881263183872 ext(4194304->4841471) 00010000:00010000:3.0:1746065190.821396:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065190.821409:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065190.821415:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba3f800 00000100:00100000:0.0:1746065190.826106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.826316:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263184128 00000100:00100000:2.0:1746065190.826325:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263184128 00010000:00010000:2.0:1746065190.826361:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065190.826397:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7623 00000100:00100000:2.0:1746065190.826404:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263184128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065190.826416:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065190.826433:0:7080:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065190 -> 1746065191 00010000:00010000:2.0:1746065190.826439:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065190.826450:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065190.826473:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2e00/0x14b4f8542d4fd92b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4194304->4841471) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a0 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065190.826504:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.826506:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.826513:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.826520:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.826527:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.826529:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065190.826532:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.826538:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.826566:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.826577:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260400512:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.826659:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.826667:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260400640:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065190.826685:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.829109:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260400640:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065190.829771:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260400512:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.829790:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.831775:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263184128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5363us (5670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.831786:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7623 00000100:00100000:1.0:1746065190.832769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.832803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.832835:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263184384 00000100:00100000:3.0:1746065190.832842:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263184384 00000100:00100000:1.0:1746065190.832871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065190.832875:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009b9ff800 x1830881263184384/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.832883:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff800 with x1830881263184384 ext(3145728->4194303) 00002000:00010000:3.0:1746065190.832888:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9ff800 00000100:00100000:3.0:1746065190.832900:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263184768 00000100:00100000:3.0:1746065190.832902:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263184768 00000100:00100000:0.0:1746065190.832935:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263184896 00000100:00100000:0.0:1746065190.832939:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263184896 00002000:00100000:0.0:1746065190.832958:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009b9fdf80 x1830881263184896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.832964:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdf80 with x1830881263184896 ext(3145728->4194303) 00002000:00010000:0.0:1746065190.832968:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fdf80 00000100:00100000:0.0:1746065190.832980:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8365 00000100:00100000:0.0:1746065190.832986:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263184384:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065190.833117:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009b9ff480 x1830881263184768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.833123:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff480 with x1830881263184768 ext(3145728->4194303) 00002000:00010000:3.0:1746065190.833126:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9ff480 00000100:00100000:3.0:1746065190.833143:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8366 00000100:00100000:3.0:1746065190.833147:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263184896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.833211:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8367 00000100:00100000:3.0:1746065190.833543:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263184768:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065190.850552:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263184896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17394us (17671us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.850567:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8366 00002000:00100000:3.0:1746065190.850579:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009b9fdf80 x1830881263184896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.850588:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fdf80 with x1830881263184896 ext(3145728->4194303) 00002000:00010000:3.0:1746065190.850593:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b9fdf80 00000100:00100000:0.0:1746065190.854719:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263184384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21725us (21944us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065190.854730:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8365 00002000:00100000:0.0:1746065190.854750:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009b9ff800 x1830881263184384/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.854759:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff800 with x1830881263184384 ext(3145728->4194303) 00002000:00010000:0.0:1746065190.854764:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9ff800 00000100:00100000:3.0:1746065190.856773:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263184768:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23550us (23963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065190.856781:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8367 00002000:00100000:3.0:1746065190.856789:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009b9ff480 x1830881263184768/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.856797:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff480 with x1830881263184768 ext(3145728->4194303) 00002000:00010000:3.0:1746065190.856801:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9ff480 00000100:00100000:0.0:1746065190.862889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.863569:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263185152 00000100:00100000:2.0:1746065190.863577:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263185152 00000100:00100000:1.0:1746065190.863598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065190.863643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.863662:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263185408 00000100:00100000:0.0:1746065190.863665:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263185408 00000100:00100000:2.0:1746065190.863690:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10026 00000100:00100000:3.0:1746065190.863773:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263185664 00000100:00100000:3.0:1746065190.863777:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263185664 00002000:00100000:0.0:1746065190.863799:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009b9fe680 x1830881263185408/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065190.863810:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fe680 with x1830881263185408 ext(4194304->5013503) 00002000:00010000:0.0:1746065190.863860:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fe680 00000100:00100000:0.0:1746065190.863878:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8368 00000100:00100000:0.0:1746065190.863883:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263185408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065190.863928:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:31925:x1830881263185152:12345-192.168.202.46@tcp:101:multiop.0 00002000:00100000:3.0:1746065190.863929:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009b9fd500 x1830881263185664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065190.863935:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fd500 with x1830881263185664 ext(4194304->5013503) 00002000:00010000:3.0:1746065190.863938:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fd500 00010000:00010000:2.0:1746065190.863941:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065190.863953:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8369 00010000:00010000:2.0:1746065190.863954:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae600/0x14b4f8542d4fd955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611ca expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.863957:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263185664:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065190.864077:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864087:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864096:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864106:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864110:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864115:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864259:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864266:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864271:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065190.864281:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065190.864336:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864341:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864346:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864352:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982afc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.864356:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864361:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864371:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065190.864374:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065190.864377:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864382:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982afc00/0x14b4f8542d4fd96a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864397:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864402:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864406:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864413:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982af200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.864415:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864419:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864424:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065190.864426:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065190.864427:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864431:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af200/0x14b4f8542d4fd95c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864438:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864442:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864446:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864450:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982ae000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065190.864452:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864456:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864460:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f200) 00010000:00010000:2.0:1746065190.864462:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065190.864464:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864468:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae000/0x14b4f8542d4fd963 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065190.864497:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae600/0x14b4f8542d4fd955 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ca expref: 254 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.864504:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982ae600/0x14b4f8542d4fd955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ca expref: 254 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.864510:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982ae600, rc 0) 00000100:00100000:2.0:1746065190.864543:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31925:x1830881263185152:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 847us (1663us total) trans 8589944277 rc 301/301 00000100:00100000:2.0:1746065190.864548:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10026 00000100:00100000:2.0:1746065190.870888:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263185408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6995us (7280us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065190.870898:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8368 00002000:00100000:2.0:1746065190.870908:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009b9fe680 x1830881263185408/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.870917:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fe680 with x1830881263185408 ext(4194304->5013503) 00002000:00010000:2.0:1746065190.870922:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fe680 00000100:00100000:0.0:1746065190.871057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.871156:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263185792 00000100:00100000:0.0:1746065190.871163:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263185792 00000100:00100000:1.0:1746065190.871564:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14864 00000100:00100000:1.0:1746065190.871573:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31925:x1830881263185792:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065190.871585:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065190.871600:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611d1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.871623:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.871630:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.871635:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.871637:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.871639:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3002368->3145727] (req 3002368->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.871661:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.871670:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065190.871680:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260400768:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065190.871750:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 24 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.871762:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 24 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065190.871770:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260400896:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065190.871788:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065190.871920:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263185664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7961us (8274us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065190.871925:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8369 00002000:00100000:2.0:1746065190.871930:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009b9fd500 x1830881263185664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/440 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.871942:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fd500 with x1830881263185664 ext(4194304->5013503) 00002000:00010000:2.0:1746065190.871945:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fd500 00000100:00100000:1.0:1746065190.874959:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260400768:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065190.874969:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260400896:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065190.874994:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3002368->3145727] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 24 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065190.875009:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9a000, rc 0) 00000100:00100000:1.0:1746065190.875051:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:31925:x1830881263185792:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3478us (3992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.875058:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14864 00000100:00100000:0.0:1746065190.877067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.877104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.877145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.877165:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263186176 00000100:00100000:0.0:1746065190.877165:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263186048 00000100:00100000:2.0:1746065190.877171:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263186176 00000100:00100000:0.0:1746065190.877171:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263186048 00000100:00100000:1.0:1746065190.877225:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263185920 00000100:00100000:1.0:1746065190.877229:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263185920 00010000:00010000:0.0:1746065190.877319:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 24 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065190.877346:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7624 00000100:00100000:0.0:1746065190.877353:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881263186048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.877363:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065190.877381:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 24 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.877390:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 24 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.877408:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b3000/0x14b4f8542d4fd939 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ae expref: 24 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.877422:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.877427:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14865 00000100:00100000:1.0:1746065190.877433:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263185920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065190.877445:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065190.877448:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263186048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 97us (344us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065190.877453:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b9b400/0x14b4f8542d4fd97f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611d8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.877454:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065190.877454:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7624 00010000:00010000:1.0:1746065190.877466:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065190.877468:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7625 00010000:00010000:1.0:1746065190.877472:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b9b400/0x14b4f8542d4fd97f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d8 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065190.877472:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263186176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065190.877477:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.877480:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b9b400/0x14b4f8542d4fd97f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d8 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065190.877483:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 16 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.877491:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.877500:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944b7800/0x14b4f8542d4fd940 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611b5 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065190.877507:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065190.877508:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065190.877513:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9b400, rc 0) 00010000:00010000:0.0:1746065190.877514:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065190.877520:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065190.877529:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263185920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 97us (467us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065190.877534:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14865 00010000:00010000:0.0:1746065190.877543:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065190.877554:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260401024:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065190.877615:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.877677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.877730:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263186304 00000100:00100000:2.0:1746065190.877744:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263186304 00000100:00100000:2.0:1746065190.877761:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14866 00000100:00100000:2.0:1746065190.877765:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263186304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065190.877772:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065190.877777:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982af200/0x14b4f8542d4fd986 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611df expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065190.877797:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260401152:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065190.877856:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.880137:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.880192:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260401024:192.168.202.46@tcp:105: 00002000:00010000:3.0:1746065190.880195:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065190 -> 1746065191 00010000:00010000:2.0:1746065190.880205:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065190.880210:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260401152:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065190.880230:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982af200/0x14b4f8542d4fd986 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611df expref: 24 pid: 8851 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065190.880232:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263186176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2759us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.880239:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7625 00010000:00010000:3.0:1746065190.880240:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982af200/0x14b4f8542d4fd986 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611df expref: 24 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.880251:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982af200, rc 0) 00000100:00100000:3.0:1746065190.880268:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263186304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2503us (2591us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065190.880273:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14866 00000100:00100000:0.0:1746065190.880361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.880428:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263186560 00000100:00100000:2.0:1746065190.880433:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263186560 00002000:00100000:2.0:1746065190.880457:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3002368->3006463) req@ffff88009f9cd500 x1830881263186560/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.880471:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd500 with x1830881263186560 ext(3002368->3006463) 00002000:00010000:2.0:1746065190.880474:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cd500 00000100:00100000:2.0:1746065190.880496:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8370 00000100:00100000:2.0:1746065190.880502:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263186560:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065190.880513:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263186688 00000100:00100000:3.0:1746065190.880516:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263186688 00000100:00100000:3.0:1746065190.880542:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14867 00000100:00100000:3.0:1746065190.880547:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263186688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065190.880553:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.880561:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093966400/0x14b4f8542d4fd98d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611e6 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.880589:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260401280:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065190.880611:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263186560:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 109us (479us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065190.880617:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8370 00002000:00100000:2.0:1746065190.880621:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3002368->3006463) req@ffff88009f9cd500 x1830881263186560/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.880628:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cd500 with x1830881263186560 ext(3002368->3006463) 00002000:00010000:2.0:1746065190.880630:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cd500 00000100:00100000:3.0:1746065190.880640:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065190.882981:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260401280:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065190.883011:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093966400/0x14b4f8542d4fd98d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611e6 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.883022:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093966400/0x14b4f8542d4fd98d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611e6 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065190.883036:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093966400, rc 0) 00000100:00100000:3.0:1746065190.883067:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263186688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2519us (2706us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065190.883073:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14867 00000100:00100000:2.0:1746065190.883486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065190.883675:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263186816 00000100:00100000:3.0:1746065190.883680:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263186816 00000100:00100000:3.0:1746065190.883762:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14868 00000100:00100000:3.0:1746065190.883769:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:31925:x1830881263186816:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065190.883779:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065190.883790:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611ed expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.883810:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.883938:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.883944:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.883945:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.883948:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->3198975] (req 3145728->3198975) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.884035:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.884045:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065190.884054:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260401408:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065190.884346:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.884354:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 18 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065190.884361:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260401536:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.884382:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065190.888441:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.888480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065190.888543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.888648:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263187072 00000100:00100000:2.0:1746065190.888658:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263187072 00000100:00100000:2.0:1746065190.888690:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263187328 00000100:00100000:2.0:1746065190.888691:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263187328 00000100:00100000:2.0:1746065190.888702:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4302 00000100:00100000:2.0:1746065190.888708:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094493450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:31921:x1830881263187072:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065190.888992:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4303 00000100:00100000:0.0:1746065190.888998:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:31918:x1830881263187328:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065190.889166:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:31918:x1830881263187328:12345-192.168.202.46@tcp:35:cat.0 Request processed in 168us (685us total) trans 8589944278 rc 0/0 00000100:00100000:0.0:1746065190.889173:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4303 00000100:00100000:1.0:1746065190.889177:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263187456 00000100:00100000:1.0:1746065190.889181:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263187456 00010000:00010000:1.0:1746065190.889198:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065190.889216:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7626 00000100:00100000:1.0:1746065190.889220:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263187456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065190.889228:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065190.889243:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065190.889253:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 14 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065190.889273:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065190.889291:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263187456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065190.889296:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7626 00000100:00100000:0.0:1746065190.889745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.889846:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094493450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31921:x1830881263187072:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1137us (1412us total) trans 8589944279 rc 0/0 00000100:00100000:2.0:1746065190.889852:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4302 00010000:00010000:2.0:1746065190.889905:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b88800/0x14b4f8542d4fd94e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611c3 expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065190.889916:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260401408:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065190.889925:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260401536:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065190.889970:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263187584 00000100:00100000:3.0:1746065190.889974:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263187584 00010000:00010000:3.0:1746065190.890137:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 19 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065190.890334:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7627 00000100:00100000:3.0:1746065190.890342:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263187584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065190.890349:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065190.890358:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 19 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065190.890367:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 19 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065190.890378:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944b6400/0x14b4f8542d4fd947 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611bc expref: 19 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065190.890386:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.890388:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065190.890393:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.890399:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065190.890420:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065190.890430:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260401664:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065190.890474:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065190.890981:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 18 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065190.890989:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e46400, rc 0) 00000100:00100000:2.0:1746065190.891017:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:31925:x1830881263186816:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7248us (7532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.891022:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14868 00000100:00100000:2.0:1746065190.892111:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260401664:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065190.892121:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065190.892140:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263187584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1800us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065190.892146:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7627 00000100:00100000:0.0:1746065190.895887:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.895984:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263187840 00000100:00100000:2.0:1746065190.895991:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263187840 00002000:00100000:2.0:1746065190.896024:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3194880->3198975) req@ffff88009f9cc380 x1830881263187840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/0 e 0 to 0 dl 1746065201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.896033:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc380 with x1830881263187840 ext(3194880->3198975) 00002000:00010000:2.0:1746065190.896037:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cc380 00000100:00100000:2.0:1746065190.896054:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8371 00000100:00100000:2.0:1746065190.896060:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263187840:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065190.896197:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263187840:12345-192.168.202.46@tcp:3:cat.0 Request processed in 137us (316us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065190.896203:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8371 00002000:00100000:2.0:1746065190.896208:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3194880->3198975) req@ffff88009f9cc380 x1830881263187840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:106/0 lens 488/4536 e 0 to 0 dl 1746065201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065190.896215:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cc380 with x1830881263187840 ext(3194880->3198975) 00002000:00010000:2.0:1746065190.896217:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cc380 00000100:00100000:0.0:1746065190.897623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065190.897687:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263188096 00000100:00100000:2.0:1746065190.897693:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263188096 00000100:00100000:2.0:1746065190.897925:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4304 00000100:00100000:2.0:1746065190.897932:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:31925:x1830881263188096:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065190.898117:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:31925:x1830881263188096:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 185us (496us total) trans 8589944280 rc 0/0 00000100:00100000:2.0:1746065190.898124:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4304 00010000:00010000:2.0:1746065191.011975:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065191.013236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.013332:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263188352 00000100:00100000:2.0:1746065191.013341:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263188352 00000100:00080000:3.0:1746065191.013441:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065191.013477:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10027 00000100:00100000:2.0:1746065191.013486:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:31930:x1830881263188352:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065191.013505:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.013551:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47400/0x14b4f8542d4fd99b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611f4 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.013645:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013655:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013664:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013676:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013682:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013688:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013788:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013795:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013801:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065191.013808:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065191.013897:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013903:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013908:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013913:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982af600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.013916:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013922:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013931:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.013934:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065191.013937:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013941:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982af600/0x14b4f8542d4fd9b0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013957:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013962:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013970:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013974:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e46a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.013976:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013981:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013986:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065191.013988:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.013991:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.013994:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e46a00/0x14b4f8542d4fd9a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.014002:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.014006:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.014011:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.014014:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff2e600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.014015:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.014019:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.014026:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f200) 00010000:00010000:2.0:1746065191.014028:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.014030:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.014033:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff2e600/0x14b4f8542d4fd9a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.014064:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47400/0x14b4f8542d4fd99b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611f4 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.014071:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e47400/0x14b4f8542d4fd99b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611f4 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.014077:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e47400, rc 0) 00000100:00100000:2.0:1746065191.014125:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:31930:x1830881263188352:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 641us (897us total) trans 8589944281 rc 301/301 00000100:00100000:2.0:1746065191.014131:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10027 00000100:00100000:0.0:1746065191.017798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.017900:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263188480 00000100:00100000:2.0:1746065191.017908:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263188480 00000100:00080000:3.0:1746065191.017963:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065191.017964:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14869 00000100:00100000:2.0:1746065191.017972:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:31930:x1830881263188480:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065191.017988:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.018003:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e611fb expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.018030:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.018042:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 14 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.018049:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.018054:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.018056:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.018059:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 6/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1179648->1204223] (req 1179648->1204223) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.018085:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.018095:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 7 pid: 2463 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746065191.018312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.018376:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263188736 00000100:00100000:3.0:1746065191.018380:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263188736 00000100:00100000:3.0:1746065191.018423:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10028 00000100:00100000:3.0:1746065191.018429:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:31935:x1830881263188736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065191.018439:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.018448:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093967000/0x14b4f8542d4fd9c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61202 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.018530:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018539:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018546:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018557:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018562:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018565:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018650:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018658:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018666:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065191.018674:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065191.018751:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018756:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018760:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018765:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012edc1400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065191.018768:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018773:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018785:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.018788:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065191.018792:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018796:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012edc1400/0x14b4f8542d4fd9da lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018812:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018835:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018843:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018847:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093967600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065191.018849:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018854:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018863:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065191.018865:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065191.018867:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018872:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093967600/0x14b4f8542d4fd9cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018885:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018889:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018893:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018896:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093967400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065191.018898:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018902:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018910:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fab00) 00010000:00010000:3.0:1746065191.018912:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065191.018915:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018918:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093967400/0x14b4f8542d4fd9d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.018946:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093967000/0x14b4f8542d4fd9c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61202 expref: 257 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.018953:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093967000/0x14b4f8542d4fd9c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61202 expref: 257 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.018960:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093967000, rc 0) 00000100:00100000:2.0:1746065191.018994:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260401792:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.018996:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31935:x1830881263188736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 567us (684us total) trans 8589944282 rc 301/301 00000100:00100000:3.0:1746065191.019002:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10028 00010000:00010000:2.0:1746065191.019058:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 14 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.019067:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 14 pid: 21998 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746065191.019075:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260401920:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.019101:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.019109:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 22 pid: 9716 timeout: 890 lvb_type: 1 00000100:00100000:2.0:1746065191.019116:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260402048:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065191.019131:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065191.019434:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065191.019468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.019546:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263188992 00000100:00100000:1.0:1746065191.019551:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263188992 00000100:00100000:1.0:1746065191.019582:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10029 00000100:00100000:1.0:1746065191.019588:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:31936:x1830881263188992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.019598:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.019604:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fd9e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61209 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.019649:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019656:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019662:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019670:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019675:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019679:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019905:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019912:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019918:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065191.019925:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065191.019965:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019971:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019975:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019980:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a27000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065191.019983:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019987:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.019995:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065191.019997:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065191.019999:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020003:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a27000/0x14b4f8542d4fd9fd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020026:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020030:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020034:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020042:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b9ae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065191.020044:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020048:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020054:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065191.020056:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065191.020058:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020100:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9ae00/0x14b4f8542d4fd9ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020108:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020113:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020117:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020121:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b9b400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065191.020123:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020128:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020134:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18600) 00010000:00010000:1.0:1746065191.020135:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065191.020138:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020141:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9b400/0x14b4f8542d4fd9f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.020163:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fd9e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61209 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.020169:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b9a600/0x14b4f8542d4fd9e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61209 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.020174:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9a600, rc 0) 00000100:00100000:1.0:1746065191.020761:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:31936:x1830881263188992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1171us (1292us total) trans 8589944283 rc 301/301 00000100:00100000:1.0:1746065191.020767:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10029 00000100:00100000:0.0:1746065191.023511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.024542:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189120 00000100:00100000:1.0:1746065191.024550:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189120 00000100:00100000:1.0:1746065191.024588:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14870 00000100:00100000:1.0:1746065191.024594:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881263189120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.024609:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.024623:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a26c00/0x14b4f8542d4fda0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61210 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065191.024809:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260401920:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065191.024834:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260401792:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065191.024859:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.024860:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260402048:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.024886:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1179648->1204223] (req 1179648->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065191.024889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065191.024898:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982ae600, rc 0) 00000100:00100000:0.0:1746065191.024916:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189248 00000100:00100000:0.0:1746065191.024919:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189248 00000100:00100000:2.0:1746065191.024935:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:31930:x1830881263188480:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6964us (7144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.024941:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14869 00000100:00100000:0.0:1746065191.024941:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10030 00000100:00100000:0.0:1746065191.024946:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:31936:x1830881263189248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065191.024955:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065191.024966:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61217 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.025013:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189376 00000100:00100000:3.0:1746065191.025017:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189376 00010000:00010000:3.0:1746065191.025040:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 8 pid: 2463 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746065191.025069:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7628 00000100:00100000:3.0:1746065191.025074:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263189376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.025082:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.025097:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 8 pid: 2463 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.025108:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 8 pid: 2463 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.025124:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc82800/0x14b4f8542d4fd83d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6110d expref: 8 pid: 2463 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.025144:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.025159:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263189376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.025164:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7628 00000100:00080000:3.0:1746065191.025186:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065191.025665:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260402176:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065191.025751:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.025762:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.025770:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065191.025792:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:0.0:1746065191.025796:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065191.025809:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.025850:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda12 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.025865:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.025871:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065191.025873:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065191.025875:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9c00, rc 0) 00000100:00100000:1.0:1746065191.025907:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.026052:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:31936:x1830881263189248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1104us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065191.026059:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10030 00000100:00100000:2.0:1746065191.026245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.026278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.026388:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189504 00000100:00100000:3.0:1746065191.026391:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189504 00010000:00010000:3.0:1746065191.026406:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 14 pid: 21998 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746065191.026422:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189632 00000100:00100000:3.0:1746065191.026424:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189632 00010000:00010000:3.0:1746065191.026434:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 23 pid: 9716 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746065191.026447:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7629 00000100:00100000:3.0:1746065191.026451:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263189504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.026458:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.026467:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 14 pid: 21998 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.026481:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 14 pid: 21998 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.026492:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc83600/0x14b4f8542d4fd8bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6114c expref: 14 pid: 21998 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.026510:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.026537:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263189504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.026543:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7629 00000100:00100000:3.0:1746065191.026570:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7630 00000100:00100000:3.0:1746065191.026575:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263189632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.026580:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.026587:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 23 pid: 9716 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.026595:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 23 pid: 9716 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.026606:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938fc800/0x14b4f8542d4fd7d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610d5 expref: 23 pid: 9716 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.026614:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.026615:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.026620:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.026628:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.026645:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.026653:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260402304:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065191.026680:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.029019:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260402304:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.029032:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260402176:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065191.029034:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065191.029054:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136a26c00/0x14b4f8542d4fda0b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61210 expref: 18 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.029066:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a26c00/0x14b4f8542d4fda0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61210 expref: 18 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.029075:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a26c00, rc 0) 00000100:00100000:3.0:1746065191.029077:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263189632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2499us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.029085:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7630 00000100:00100000:1.0:1746065191.029094:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881263189120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4500us (5589us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065191.029100:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14870 00000100:00100000:0.0:1746065191.029607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.029646:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263189888 00000100:00100000:2.0:1746065191.029652:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263189888 00002000:00100000:2.0:1746065191.029680:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1179648->1183743) req@ffff880094a13100 x1830881263189888/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.029688:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13100 with x1830881263189888 ext(1179648->1183743) 00002000:00010000:2.0:1746065191.029693:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13100 00000100:00100000:2.0:1746065191.029716:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8372 00000100:00100000:2.0:1746065191.029722:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263189888:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065191.030245:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263189888:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 523us (638us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.030251:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8372 00002000:00100000:2.0:1746065191.030256:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1179648->1183743) req@ffff880094a13100 x1830881263189888/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.030262:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13100 with x1830881263189888 ext(1179648->1183743) 00002000:00010000:2.0:1746065191.030265:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13100 00000100:00100000:0.0:1746065191.030383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.030470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.030551:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190016 00000100:00100000:1.0:1746065191.030554:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190016 00000100:00100000:1.0:1746065191.030578:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190144 00000100:00100000:1.0:1746065191.030580:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190144 00000100:00100000:1.0:1746065191.030594:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14871 00000100:00100000:1.0:1746065191.030598:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263190016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.030606:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.030618:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b916e00/0x14b4f8542d4fda20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6121e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.030652:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260402432:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065191.030697:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065191.030712:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14872 00000100:00100000:1.0:1746065191.030718:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263190144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.030723:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.030740:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b916600/0x14b4f8542d4fda27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61225 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.030769:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260402560:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065191.030788:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00080000:1.0:1746065191.030808:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065191.034412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.034437:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190400 00000100:00100000:2.0:1746065191.034444:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190400 00002000:00100000:2.0:1746065191.035369:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1200128->1204223) req@ffff88009ba1e300 x1830881263190400/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.035379:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e300 with x1830881263190400 ext(1200128->1204223) 00002000:00010000:2.0:1746065191.035383:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1e300 00000100:00100000:2.0:1746065191.035407:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8373 00000100:00100000:2.0:1746065191.035415:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263190400:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065191.035871:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.035888:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190528 00000100:00100000:0.0:1746065191.035891:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190528 00000100:00100000:0.0:1746065191.035911:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14873 00000100:00100000:0.0:1746065191.035916:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31935:x1830881263190528:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065191.035925:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065191.035939:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6122c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.035959:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.035966:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065191.035967:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065191.035971:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.035994:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.036004:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065191.036014:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260402688:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.036062:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260402560:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065191.036062:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e600 going to sleep for 11 seconds 00010000:00010000:3.0:1746065191.036087:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b916600/0x14b4f8542d4fda27 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61225 expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.036096:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b916600/0x14b4f8542d4fda27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61225 expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.036108:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b916600, rc 0) 00000100:00100000:3.0:1746065191.036127:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263190144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5410us (5657us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065191.036133:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14872 00000100:00100000:3.0:1746065191.036170:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260402432:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065191.036185:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b916e00/0x14b4f8542d4fda20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6121e expref: 14 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.036192:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b916e00/0x14b4f8542d4fda20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6121e expref: 14 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.036199:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b916e00, rc 0) 00000100:00100000:3.0:1746065191.036218:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263190016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5620us (5836us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065191.036223:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14871 00000100:00100000:2.0:1746065191.036528:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263190400:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 146us (1155us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.036536:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8373 00002000:00100000:2.0:1746065191.036542:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1200128->1204223) req@ffff88009ba1e300 x1830881263190400/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.036553:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e300 with x1830881263190400 ext(1200128->1204223) 00010000:00010000:2.0:1746065191.036559:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.036569:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.036574:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba1e300 00000100:00100000:0.0:1746065191.041809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.042939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.042953:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190784 00000100:00100000:2.0:1746065191.042961:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190784 00000100:00100000:2.0:1746065191.043000:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4305 00000100:00100000:2.0:1746065191.043006:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:31930:x1830881263190784:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065191.043726:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260402688:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065191.043759:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 23 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.043771:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8a00, rc 0) 00000100:00100000:2.0:1746065191.043805:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:31930:x1830881263190784:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 798us (2003us total) trans 8589944284 rc 0/0 00000100:00100000:2.0:1746065191.043812:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4305 00000100:00100000:3.0:1746065191.043890:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263190912 00000100:00100000:3.0:1746065191.043893:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263190912 00002000:00100000:3.0:1746065191.043917:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1179648->1204223) req@ffff88009b9ff100 x1830881263190912/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.043926:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff100 with x1830881263190912 ext(1179648->1204223) 00010000:00010000:3.0:1746065191.043931:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.043942:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 13 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065191.043948:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b9ff100 00000100:00100000:3.0:1746065191.043961:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2542 00000100:00100000:3.0:1746065191.043966:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263190912:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065191.044058:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31935:x1830881263190528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8141us (8187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065191.044063:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14873 00000100:00100000:1.0:1746065191.044187:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.045199:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263191168 00000100:00100000:0.0:1746065191.045204:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263191168 00002000:00100000:0.0:1746065191.045223:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009b9fca80 x1830881263191168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.045231:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fca80 with x1830881263191168 ext(0->1048575) 00002000:00010000:0.0:1746065191.045235:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fca80 00000100:00100000:0.0:1746065191.045259:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8374 00000100:00100000:0.0:1746065191.045265:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263191168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065191.049787:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263190912:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5810us (6839us total) trans 17179873661 rc 0/0 00000100:00100000:3.0:1746065191.049798:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2542 00002000:00100000:3.0:1746065191.049809:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1179648->1204223) req@ffff88009b9ff100 x1830881263190912/t17179873661(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.049844:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9ff100 with x1830881263190912 ext(1179648->1204223) 00010000:00010000:3.0:1746065191.049855:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.049866:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065191.049873:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b9ff100 00000100:00100000:1.0:1746065191.060256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.062103:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263191296 00000100:00100000:2.0:1746065191.062112:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263191296 00010000:00010000:2.0:1746065191.062141:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065191.062175:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7631 00000100:00100000:2.0:1746065191.062182:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263191296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065191.062192:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065191.062208:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065190 -> 1746065191 00002000:00010000:2.0:1746065191.062211:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065190 -> 1746065191 00010000:00010000:2.0:1746065191.062218:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.062229:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.062248:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982ae600/0x14b4f8542d4fd9be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1204223) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611fb expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.063347:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.063354:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.063363:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.063374:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.063407:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 22 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065191.063419:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260402816:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065191.063619:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.063807:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263191168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18540us (19617us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065191.063832:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8374 00002000:00100000:0.0:1746065191.063840:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009b9fca80 x1830881263191168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.063848:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fca80 with x1830881263191168 ext(0->1048575) 00002000:00010000:0.0:1746065191.063852:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fca80 00000100:00100000:2.0:1746065191.067502:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260402816:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065191.067523:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065191.067577:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263191296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5393us (7326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.067586:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7631 00000100:00100000:0.0:1746065191.072091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.072247:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263191552 00000100:00100000:2.0:1746065191.072256:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263191552 00002000:00100000:2.0:1746065191.072303:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094a13800 x1830881263191552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.072313:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13800 with x1830881263191552 ext(1048576->2097151) 00002000:00010000:2.0:1746065191.072318:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13800 00000100:00100000:2.0:1746065191.072349:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8375 00000100:00100000:2.0:1746065191.072356:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263191552:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.081088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.081793:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263191680 00000100:00100000:2.0:1746065191.081801:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263191680 00000100:00100000:2.0:1746065191.081876:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14874 00000100:00100000:2.0:1746065191.081884:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:31936:x1830881263191680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.081900:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.081915:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61233 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.081938:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.081939:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.081945:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.081959:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.081968:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092775c00, rc 0) 00000100:00100000:2.0:1746065191.082013:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:31936:x1830881263191680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 130us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.082022:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14874 00000100:00100000:2.0:1746065191.088251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.088328:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263191936 00000100:00100000:3.0:1746065191.088336:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263191936 00002000:00100000:3.0:1746065191.088374:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009ba1d180 x1830881263191936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.088385:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d180 with x1830881263191936 ext(1048576->2097151) 00002000:00010000:3.0:1746065191.088389:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d180 00000100:00100000:3.0:1746065191.088406:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8376 00000100:00100000:3.0:1746065191.088412:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263191936:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.089077:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263191552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16719us (16994us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065191.089085:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8375 00002000:00100000:0.0:1746065191.089091:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094a13800 x1830881263191552/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.089098:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a13800 with x1830881263191552 ext(1048576->2097151) 00002000:00010000:0.0:1746065191.089101:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a13800 00000100:00100000:3.0:1746065191.099151:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263191936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10728us (10898us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065191.099163:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8376 00002000:00100000:3.0:1746065191.099174:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009ba1d180 x1830881263191936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.099190:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d180 with x1830881263191936 ext(1048576->2097151) 00002000:00010000:3.0:1746065191.099195:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d180 00000100:00100000:0.0:1746065191.101451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.101519:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192064 00000100:00100000:2.0:1746065191.101527:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192064 00000100:00100000:2.0:1746065191.101583:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14875 00000100:00100000:2.0:1746065191.101591:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:31935:x1830881263192064:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.101609:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.101625:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6123a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.101649:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.101651:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.101658:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.101670:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.101679:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092774c00, rc 0) 00000100:00100000:2.0:1746065191.101723:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:31935:x1830881263192064:12345-192.168.202.46@tcp:101:cat.0 Request processed in 132us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.101729:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14875 00000100:00100000:0.0:1746065191.117424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.117679:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.117772:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192320 00000100:00100000:2.0:1746065191.117780:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192320 00000100:00100000:2.0:1746065191.117840:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192192 00000100:00100000:2.0:1746065191.117842:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192192 00000100:00100000:2.0:1746065191.117984:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14876 00000100:00100000:2.0:1746065191.117991:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263192320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.118009:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.118024:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092774000/0x14b4f8542d4fda43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61248 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065191.118070:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260402944:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065191.118148:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.118187:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14877 00000100:00100000:0.0:1746065191.118193:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263192192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065191.118201:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065191.118210:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fda4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61241 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065191.118231:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260403072:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065191.118249:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.126221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.126859:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192576 00000100:00100000:3.0:1746065191.126867:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192576 00002000:00100000:3.0:1746065191.126914:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009380ca80 x1830881263192576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.126924:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380ca80 with x1830881263192576 ext(2097152->3145727) 00002000:00010000:3.0:1746065191.126928:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380ca80 00000100:00100000:3.0:1746065191.126957:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8377 00000100:00100000:3.0:1746065191.126964:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881263192576:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.128020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.128050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.128333:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263192832 00000100:00100000:1.0:1746065191.128338:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263192832 00002000:00100000:1.0:1746065191.128357:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3198976->4194303) req@ffff88009380c000 x1830881263192832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.128364:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380c000 with x1830881263192832 ext(3198976->4194303) 00002000:00010000:1.0:1746065191.128368:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380c000 00000100:00100000:1.0:1746065191.128386:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193088 00000100:00100000:1.0:1746065191.128388:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193088 00000100:00100000:2.0:1746065191.128399:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8378 00002000:00100000:1.0:1746065191.128400:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3289087) req@ffff88009380ce00 x1830881263193088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 504/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.128406:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380ce00 with x1830881263193088 ext(2097152->3289087) 00002000:00010000:1.0:1746065191.128408:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009380ce00 00000100:00100000:2.0:1746065191.128413:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263192832:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065191.128422:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8379 00000100:00100000:1.0:1746065191.128426:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263193088:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.128533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.129323:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193344 00000100:00100000:2.0:1746065191.129329:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193344 00002000:00100000:2.0:1746065191.129352:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3289088->4194303) req@ffff88009380ed80 x1830881263193344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.129361:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380ed80 with x1830881263193344 ext(3289088->4194303) 00002000:00010000:2.0:1746065191.129365:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009380ed80 00000100:00100000:2.0:1746065191.129382:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8380 00000100:00100000:2.0:1746065191.129387:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263193344:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:0.0:1746065191.130573:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065191 -> 1746065192 00000100:00100000:0.0:1746065191.130589:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260403072:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065191.130617:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fda4a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61241 expref: 14 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065191.130634:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fda4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61241 expref: 14 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065191.130647:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9200, rc 0) 00000100:00100000:0.0:1746065191.130674:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263192192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 12481us (12995us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065191.130680:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14877 00002000:00010000:3.0:1746065191.130934:0:8429:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065191 -> 1746065192 00000100:00100000:3.0:1746065191.130943:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260402944:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065191.130961:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092774000/0x14b4f8542d4fda43 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61248 expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.130971:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092774000/0x14b4f8542d4fda43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61248 expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.130982:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092774000, rc 0) 00000100:00100000:3.0:1746065191.131002:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263192320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 13011us (13588us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065191.131008:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14876 00000100:00100000:3.0:1746065191.140672:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263192576:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13699us (14449us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065191.140687:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8377 00002000:00100000:3.0:1746065191.140697:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009380ca80 x1830881263192576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.140705:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380ca80 with x1830881263192576 ext(2097152->3145727) 00002000:00010000:3.0:1746065191.140710:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380ca80 00000100:00100000:0.0:1746065191.146536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.146593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.146693:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193472 00000100:00100000:3.0:1746065191.146701:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193472 00000100:00100000:3.0:1746065191.146748:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14878 00000100:00100000:3.0:1746065191.146755:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:31936:x1830881263193472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065191.146769:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065191.146788:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193728 00000100:00100000:1.0:1746065191.146792:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193728 00000100:00100000:1.0:1746065191.146835:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10031 00000100:00100000:1.0:1746065191.146840:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:31940:x1830881263193728:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065191.146852:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.146863:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a200/0x14b4f8542d4fda51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61256 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.146879:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6124f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.146898:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.146905:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065191.146906:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065191.146909:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.146933:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.146942:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.146943:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 26 pid: 8428 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.146952:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065191.146958:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260403200:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065191.146959:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.146968:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.146972:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.146976:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065191.147019:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d180 going to sleep for 11 seconds 00010000:00010000:1.0:1746065191.147152:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147159:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147165:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065191.147172:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065191.147230:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147239:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147244:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147249:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5be00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065191.147252:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147257:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147264:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065191.147267:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065191.147269:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147273:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5be00/0x14b4f8542d4fda6d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147287:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147291:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147296:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147299:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5a800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065191.147301:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147308:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147313:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065191.147314:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065191.147316:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147320:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a800/0x14b4f8542d4fda5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147326:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147330:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147335:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147338:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5a000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065191.147340:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147344:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147348:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18600) 00010000:00010000:1.0:1746065191.147349:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065191.147351:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147355:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a000/0x14b4f8542d4fda66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065191.147381:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a200/0x14b4f8542d4fda51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61256 expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.147387:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5a200/0x14b4f8542d4fda51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61256 expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.147394:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5a200, rc 0) 00000100:00100000:1.0:1746065191.147420:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31940:x1830881263193728:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 580us (826us total) trans 8589944285 rc 301/301 00000100:00100000:1.0:1746065191.147426:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10031 00000100:00100000:1.0:1746065191.150781:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263193088:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22342us (22718us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065191.150793:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8379 00002000:00100000:1.0:1746065191.150805:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3289087) req@ffff88009380ce00 x1830881263193088/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 504/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.151053:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380ce00 with x1830881263193088 ext(2097152->3289087) 00010000:00010000:1.0:1746065191.151066:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 25 pid: 8428 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.151081:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 25 pid: 8428 timeout: 890 lvb_type: 0 00002000:00010000:1.0:1746065191.151087:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009380ce00 00000100:00100000:2.0:1746065191.155749:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263193344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 26354us (27422us total) trans 0 rc 905216/905216 00000100:00100000:2.0:1746065191.155760:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8380 00002000:00100000:2.0:1746065191.155769:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3289088->4194303) req@ffff88009380ed80 x1830881263193344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.155778:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380ed80 with x1830881263193344 ext(3289088->4194303) 00010000:00010000:2.0:1746065191.155786:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 23 pid: 8428 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.155804:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 23 pid: 8428 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.155811:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009380ed80 00000100:00100000:0.0:1746065191.157978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.158140:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193856 00000100:00100000:3.0:1746065191.158148:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193856 00002000:00100000:3.0:1746065191.158183:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3002368->3145727) req@ffff88008fc5b480 x1830881263193856/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.158192:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b480 with x1830881263193856 ext(3002368->3145727) 00010000:00010000:3.0:1746065191.158199:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 23 pid: 8428 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.158211:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 23 pid: 8428 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065191.158217:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5b480 00000100:00100000:3.0:1746065191.158493:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2543 00000100:00100000:3.0:1746065191.158501:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263193856:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065191.159022:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260403200:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.159043:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.159055:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f758600, rc 0) 00000100:00100000:2.0:1746065191.159073:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:31936:x1830881263193472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 12319us (12546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.159078:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14878 00000100:00100000:0.0:1746065191.174547:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.174584:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263193984 00000100:00100000:0.0:1746065191.174591:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263193984 00000100:00100000:0.0:1746065191.174643:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14879 00000100:00100000:0.0:1746065191.174650:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31940:x1830881263193984:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065191.174665:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065191.175971:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263193856:12345-192.168.202.46@tcp:4:cat.0 Request processed in 17467us (17996us total) trans 17179873662 rc 0/0 00000100:00100000:3.0:1746065191.175981:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2543 00002000:00100000:3.0:1746065191.175990:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3002368->3145727) req@ffff88008fc5b480 x1830881263193856/t17179873662(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.175998:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b480 with x1830881263193856 ext(3002368->3145727) 00010000:00010000:3.0:1746065191.176006:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 26 pid: 8428 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.176019:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 26 pid: 8428 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065191.176025:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5b480 00000100:00100000:3.0:1746065191.176447:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881263192832:12345-192.168.202.46@tcp:3:cat.0 Request processed in 48040us (48427us total) trans 0 rc 995328/995328 00000100:00100000:3.0:1746065191.176453:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8378 00002000:00100000:3.0:1746065191.176458:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3198976->4194303) req@ffff88009380c000 x1830881263192832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 995328/995328 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.176465:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380c000 with x1830881263192832 ext(3198976->4194303) 00002000:00010000:3.0:1746065191.176469:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380c000 00010000:00010000:0.0:1746065191.176635:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6125d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.176676:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065191.176678:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065191.176683:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->3563519] (req 3375104->3563519) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.176694:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->3563519] (req 3375104->3563519) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.176707:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9a00, rc 0) 00000100:00100000:0.0:1746065191.176726:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31940:x1830881263193984:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2077us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065191.176742:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14879 00000100:00100000:1.0:1746065191.182802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.182915:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194368 00000100:00100000:2.0:1746065191.182922:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194368 00000100:00100000:2.0:1746065191.182967:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14880 00000100:00100000:2.0:1746065191.182975:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31935:x1830881263194368:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.182989:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.183003:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6126b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.183024:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065191.183029:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->3563519] (req 3375104->3563519) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.183036:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065191.183040:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.183069:0:8429:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->3563519] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.183079:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.183088:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e8b0200, rc 0) 00000100:00100000:2.0:1746065191.183122:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31935:x1830881263194368:12345-192.168.202.46@tcp:101:cat.0 Request processed in 148us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.183129:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14880 00000100:00100000:0.0:1746065191.183639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.183882:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194240 00000100:00100000:2.0:1746065191.183885:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194240 00000100:00100000:2.0:1746065191.183913:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10032 00000100:00100000:2.0:1746065191.183918:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:31942:x1830881263194240:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065191.183930:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.183939:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0800/0x14b4f8542d4fda89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61264 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.184018:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184028:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184037:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184051:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184056:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184062:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184148:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184156:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184161:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065191.184168:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065191.184248:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184254:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184260:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184265:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e8b0c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.184269:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184275:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184284:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.184287:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065191.184290:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184295:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0c00/0x14b4f8542d4fda9e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184631:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184637:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184642:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184646:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e8b1e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.184648:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184653:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184660:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065191.184662:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.184665:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184669:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b1e00/0x14b4f8542d4fda90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184677:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184683:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065191.184683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065191.184687:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184691:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e8b0e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.184693:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184697:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184702:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fa00) 00010000:00010000:2.0:1746065191.184704:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.184706:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184710:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0e00/0x14b4f8542d4fda97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.184750:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0800/0x14b4f8542d4fda89 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61264 expref: 15 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.184758:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e8b0800/0x14b4f8542d4fda89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61264 expref: 15 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.184764:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e8b0800, rc 0) 00000100:00100000:3.0:1746065191.184777:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194496 00000100:00100000:3.0:1746065191.184781:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194496 00000100:00100000:2.0:1746065191.184799:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:31942:x1830881263194240:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 881us (1368us total) trans 8589944286 rc 301/301 00010000:00010000:3.0:1746065191.184800:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 27 pid: 8428 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065191.184808:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10032 00000100:00100000:3.0:1746065191.184840:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7632 00000100:00100000:3.0:1746065191.184846:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263194496:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.184854:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.185039:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 27 pid: 8428 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.185051:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 27 pid: 8428 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.185069:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b9a000/0x14b4f8542d4fd978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611d1 expref: 27 pid: 8428 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.185094:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.185096:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.185101:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.185108:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.185115:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.185116:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.185119:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.185125:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.185147:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.185157:0:7078:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.185167:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260403456:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065191.185242:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.185250:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260403584:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065191.185267:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.191281:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260403584:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.191649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.191737:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263194752 00000100:00100000:2.0:1746065191.191743:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263194752 00002000:00100000:2.0:1746065191.191780:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3375104->3379199) req@ffff880095351500 x1830881263194752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.191788:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351500 with x1830881263194752 ext(3375104->3379199) 00010000:00010000:2.0:1746065191.191797:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 27 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.191809:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 27 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.191830:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095351500 00000100:00100000:3.0:1746065191.192066:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260403456:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065191.192083:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.192249:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263194496:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7402us (7565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.192257:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7632 00000100:00100000:2.0:1746065191.192633:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2544 00000100:00100000:2.0:1746065191.192641:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263194752:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065191.192799:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263194752:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 159us (1151us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.192805:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2544 00002000:00100000:2.0:1746065191.192810:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3375104->3379199) req@ffff880095351500 x1830881263194752/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.192834:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351500 with x1830881263194752 ext(3375104->3379199) 00010000:00010000:2.0:1746065191.192840:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.192852:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.192858:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095351500 00000100:00100000:0.0:1746065191.193313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.193717:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195008 00000100:00100000:2.0:1746065191.193722:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195008 00002000:00100000:2.0:1746065191.193747:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fc5ad80 x1830881263195008/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.193754:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5ad80 with x1830881263195008 ext(2097152->3145727) 00002000:00010000:2.0:1746065191.193758:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5ad80 00000100:00100000:2.0:1746065191.193780:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8381 00000100:00100000:2.0:1746065191.193786:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263195008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.204274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.205518:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195264 00000100:00100000:2.0:1746065191.205530:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195264 00002000:00100000:2.0:1746065191.205576:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3559424->3563519) req@ffff88008fc58380 x1830881263195264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.205586:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58380 with x1830881263195264 ext(3559424->3563519) 00010000:00010000:2.0:1746065191.205595:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.205609:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.205616:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc58380 00000100:00100000:2.0:1746065191.207790:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2545 00000100:00100000:2.0:1746065191.207807:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263195264:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065191.208020:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263195264:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 220us (3755us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.208027:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2545 00002000:00100000:2.0:1746065191.208033:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3559424->3563519) req@ffff88008fc58380 x1830881263195264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.208041:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc58380 with x1830881263195264 ext(3559424->3563519) 00010000:00010000:2.0:1746065191.208049:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.208062:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.208068:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc58380 00000100:00100000:2.0:1746065191.212555:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263195008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18756us (19230us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065191.212570:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8381 00002000:00100000:2.0:1746065191.212584:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fc5ad80 x1830881263195008/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.212594:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5ad80 with x1830881263195008 ext(2097152->3145727) 00002000:00010000:2.0:1746065191.212599:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5ad80 00000100:00100000:0.0:1746065191.214982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.215038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.215715:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195776 00000100:00100000:1.0:1746065191.215724:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195776 00000100:00100000:1.0:1746065191.215792:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4306 00000100:00100000:1.0:1746065191.215800:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:31940:x1830881263195776:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065191.216043:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31940:x1830881263195776:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 244us (1068us total) trans 8589944287 rc 0/0 00000100:00100000:1.0:1746065191.216049:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4306 00000100:00100000:0.0:1746065191.216611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.216678:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195648 00000100:00100000:2.0:1746065191.216682:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195648 00002000:00100000:2.0:1746065191.216705:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3375104->3563519) req@ffff88008fc5b800 x1830881263195648/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.216714:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b800 with x1830881263195648 ext(3375104->3563519) 00010000:00010000:2.0:1746065191.216722:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.216744:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.216751:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5b800 00000100:00100000:2.0:1746065191.216770:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2546 00000100:00100000:2.0:1746065191.216775:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263195648:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065191.217616:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263195904 00000100:00100000:1.0:1746065191.217622:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263195904 00000100:00100000:1.0:1746065191.217650:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14881 00000100:00100000:1.0:1746065191.217655:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:31936:x1830881263195904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.217665:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.217678:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61272 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.217698:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.217704:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.217705:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.217709:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.217745:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 17 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.217758:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 17 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.217769:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260403712:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065191.218329:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.221190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.221216:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196032 00000100:00100000:3.0:1746065191.221223:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196032 00002000:00100000:3.0:1746065191.221259:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3198975) req@ffff88009bee1500 x1830881263196032/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.221267:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1500 with x1830881263196032 ext(3145728->3198975) 00010000:00010000:3.0:1746065191.221274:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 18 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.221284:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 18 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065191.221290:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bee1500 00000100:00100000:3.0:1746065191.221319:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2547 00000100:00100000:3.0:1746065191.221328:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881263196032:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065191.221619:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260403712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065191.221639:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.221654:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c860a00, rc 0) 00000100:00100000:1.0:1746065191.221687:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+14:31936:x1830881263195904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4031us (5076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.221693:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14881 00000100:00100000:3.0:1746065191.223692:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263196032:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 2358us (2504us total) trans 21474840942 rc 0/0 00000100:00100000:3.0:1746065191.223700:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2547 00002000:00100000:3.0:1746065191.223709:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3198975) req@ffff88009bee1500 x1830881263196032/t21474840942(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.223717:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1500 with x1830881263196032 ext(3145728->3198975) 00010000:00010000:3.0:1746065191.223725:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 20 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.223749:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 20 pid: 8851 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065191.223755:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bee1500 00000100:00100000:2.0:1746065191.225184:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263195648:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 8404us (10141us total) trans 17179873663 rc 0/0 00000100:00100000:2.0:1746065191.225192:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2546 00002000:00100000:2.0:1746065191.225198:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3375104->3563519) req@ffff88008fc5b800 x1830881263195648/t17179873663(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.225205:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b800 with x1830881263195648 ext(3375104->3563519) 00010000:00010000:2.0:1746065191.225212:0:21486:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 28 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.225221:0:21486:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 28 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.225227:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc5b800 00000100:00100000:0.0:1746065191.226430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.226810:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196160 00000100:00100000:3.0:1746065191.226864:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196160 00010000:00010000:3.0:1746065191.226901:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 20 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.226944:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7633 00000100:00100000:3.0:1746065191.226954:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263196160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.226971:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065191.226990:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065191 -> 1746065192 00010000:00010000:3.0:1746065191.226997:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 20 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.227013:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 20 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.227037:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e46400/0x14b4f8542d4fd994 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3198975) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611ed expref: 20 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065191.227558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.227571:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196288 00000100:00100000:0.0:1746065191.227574:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196288 00010000:00010000:0.0:1746065191.227586:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 28 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065191.227608:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7634 00000100:00100000:0.0:1746065191.227615:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263196288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065191.227624:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065191.227637:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065191 -> 1746065192 00002000:00010000:0.0:1746065191.227640:0:10991:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065191 -> 1746065192 00010000:00010000:0.0:1746065191.227645:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 28 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065191.227659:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 28 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065191.227674:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fda7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->3563519) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6125d expref: 28 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065191.227703:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.227872:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.228085:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.228095:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.228104:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.228141:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 13 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.228155:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260403840:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065191.228246:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d780 going to sleep for 11 seconds 00010000:00010000:0.0:1746065191.228485:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065191.228491:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.228499:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.228526:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065191.228536:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260403968:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065191.228574:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.233195:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260403840:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065191.233215:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.233250:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881263196160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6297us (6824us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.233258:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7633 00000100:00100000:1.0:1746065191.233345:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260403968:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065191.233355:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065191.233371:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263196288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5757us (5813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.233377:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7634 00000100:00100000:2.0:1746065191.234019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.234038:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196672 00000100:00100000:2.0:1746065191.234043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.234044:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196672 00000100:00100000:3.0:1746065191.234083:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196800 00000100:00100000:3.0:1746065191.234088:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196800 00002000:00100000:3.0:1746065191.234115:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009ba1f480 x1830881263196800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.234123:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f480 with x1830881263196800 ext(3145728->4194303) 00002000:00010000:3.0:1746065191.234126:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1f480 00000100:00100000:3.0:1746065191.234150:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8382 00000100:00100000:3.0:1746065191.234156:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263196800:12345-192.168.202.46@tcp:3:multiop.0 00002000:00100000:0.0:1746065191.235188:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba1c000 x1830881263196672/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.235197:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c000 with x1830881263196672 ext(3145728->4194303) 00002000:00010000:0.0:1746065191.235200:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1c000 00000100:00100000:0.0:1746065191.235214:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8383 00000100:00100000:0.0:1746065191.235219:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263196672:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065191.247879:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263196800:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13716us (13827us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065191.247889:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8382 00002000:00100000:3.0:1746065191.247898:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009ba1f480 x1830881263196800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.247906:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f480 with x1830881263196800 ext(3145728->4194303) 00002000:00010000:3.0:1746065191.247912:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1f480 00000100:00100000:0.0:1746065191.253877:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.253988:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263196928 00000100:00100000:1.0:1746065191.253995:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263196928 00000100:00100000:1.0:1746065191.254042:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14882 00000100:00100000:1.0:1746065191.254050:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881263196928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.254067:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.254081:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61279 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.254099:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.254101:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.254109:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 20 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.254122:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 20 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.254136:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094371a00, rc 0) 00000100:00100000:1.0:1746065191.254172:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263196928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 122us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.254178:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14882 00000100:00100000:2.0:1746065191.255303:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263196672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20082us (21282us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065191.256230:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8383 00002000:00100000:2.0:1746065191.256243:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba1c000 x1830881263196672/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.256250:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c000 with x1830881263196672 ext(3145728->4194303) 00002000:00010000:2.0:1746065191.256254:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1c000 00000100:00100000:0.0:1746065191.259241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.259341:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263197184 00000100:00100000:2.0:1746065191.259349:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263197184 00002000:00100000:2.0:1746065191.259387:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fc59c00 x1830881263197184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.259402:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59c00 with x1830881263197184 ext(4194304->5013503) 00002000:00010000:2.0:1746065191.259407:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc59c00 00000100:00100000:2.0:1746065191.260087:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8384 00000100:00100000:2.0:1746065191.260095:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263197184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.263108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.263268:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263197312 00000100:00100000:1.0:1746065191.263276:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263197312 00000100:00100000:1.0:1746065191.263875:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14883 00000100:00100000:1.0:1746065191.263883:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+16:31936:x1830881263197312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.263901:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.263917:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61280 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.263938:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.263940:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.263946:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 17 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.263959:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 17 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.263969:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c757000, rc 0) 00000100:00100000:1.0:1746065191.264013:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:31936:x1830881263197312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 130us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.264018:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14883 00000100:00100000:2.0:1746065191.266609:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263197184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6505us (7366us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065191.266620:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8384 00002000:00100000:2.0:1746065191.266632:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fc59c00 x1830881263197184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.266641:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59c00 with x1830881263197184 ext(4194304->5013503) 00002000:00010000:2.0:1746065191.266646:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc59c00 00000100:00100000:0.0:1746065191.273182:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.273410:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263197568 00000100:00100000:2.0:1746065191.273418:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263197568 00002000:00100000:2.0:1746065191.273448:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fc59880 x1830881263197568/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.273454:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59880 with x1830881263197568 ext(3145728->4194303) 00002000:00010000:2.0:1746065191.273458:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc59880 00000100:00100000:2.0:1746065191.273480:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8385 00000100:00100000:2.0:1746065191.273484:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263197568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.282775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.283115:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263197824 00000100:00100000:3.0:1746065191.283123:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263197824 00000100:00100000:3.0:1746065191.283161:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4307 00000100:00100000:3.0:1746065191.283168:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31935:x1830881263197824:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065191.283329:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:31935:x1830881263197824:12345-192.168.202.46@tcp:35:cat.0 Request processed in 161us (560us total) trans 8589944288 rc 0/0 00000100:00100000:3.0:1746065191.283335:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4307 00000100:00100000:2.0:1746065191.283797:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263197568:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10310us (10622us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065191.283809:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8385 00002000:00100000:2.0:1746065191.283835:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fc59880 x1830881263197568/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.283845:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59880 with x1830881263197568 ext(3145728->4194303) 00002000:00010000:2.0:1746065191.283850:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc59880 00000100:00100000:0.0:1746065191.295740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.295880:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198080 00000100:00100000:2.0:1746065191.295890:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198080 00002000:00100000:2.0:1746065191.295937:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880135cde300 x1830881263198080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.295947:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde300 with x1830881263198080 ext(4194304->5013503) 00002000:00010000:2.0:1746065191.295952:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cde300 00000100:00100000:2.0:1746065191.296130:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8386 00000100:00100000:2.0:1746065191.296137:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263198080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065191.303482:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263198080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7336us (7751us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065191.303496:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8386 00002000:00100000:2.0:1746065191.303506:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880135cde300 x1830881263198080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.303515:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde300 with x1830881263198080 ext(4194304->5013503) 00002000:00010000:2.0:1746065191.303521:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cde300 00000100:00100000:0.0:1746065191.307489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.307676:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198336 00000100:00100000:1.0:1746065191.307683:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198336 00000100:00100000:1.0:1746065191.307741:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4308 00000100:00100000:1.0:1746065191.307748:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094493850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:31936:x1830881263198336:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065191.307951:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094493850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:31936:x1830881263198336:12345-192.168.202.46@tcp:35:cat.0 Request processed in 203us (468us total) trans 8589944289 rc 0/0 00000100:00100000:1.0:1746065191.307957:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4308 00000100:00100000:0.0:1746065191.366782:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.366848:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198464 00000100:00100000:3.0:1746065191.366857:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198464 00000100:00100000:3.0:1746065191.366908:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14884 00000100:00100000:3.0:1746065191.366915:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:31942:x1830881263198464:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065191.366931:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.366946:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61287 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.366970:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.366979:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.366985:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.366991:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.366996:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065191.366998:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065191.367001:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3047424->3145727] (req 3047424->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.367026:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.367036:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 19 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.367047:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260404096:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.367145:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.367152:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 15 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.367159:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260404224:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.367184:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.367191:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 19 pid: 21998 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746065191.367199:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260404352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.367217:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.367223:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 15 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.367230:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260404480:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.367242:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.370963:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260404096:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.370974:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260404224:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065191.371643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.371811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.372676:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260404352:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065191.372763:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198592 00000100:00100000:1.0:1746065191.372770:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198592 00010000:00010000:1.0:1746065191.372797:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.372841:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198720 00000100:00100000:1.0:1746065191.372843:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198720 00000100:00100000:3.0:1746065191.372851:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260404480:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065191.372853:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 16 pid: 8851 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.372868:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7635 00000100:00100000:1.0:1746065191.372874:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263198592:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.372882:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [3047424->3145727] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.372884:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.372895:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf7000, rc 0) 00010000:00010000:1.0:1746065191.372902:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.372912:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.372932:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092774c00/0x14b4f8542d4fda3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6123a expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065191.372968:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7636 00000100:00100000:2.0:1746065191.372975:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263198720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065191.372982:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065191.372990:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 16 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.372998:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 16 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.373008:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b2400/0x14b4f8542d4fd932 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e611a7 expref: 16 pid: 8851 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.373019:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.374361:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:31942:x1830881263198464:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7441us (7580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.374369:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14884 00000100:00100000:2.0:1746065191.374538:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263198720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1563us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.374544:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7636 00010000:00010000:1.0:1746065191.375189:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065191.376228:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263198592:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3350us (4583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.376564:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7635 00000100:00100000:3.0:1746065191.377589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.377610:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198848 00000100:00100000:1.0:1746065191.377619:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198848 00000100:00100000:3.0:1746065191.377627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065191.377643:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 19 pid: 21998 timeout: 890 lvb_type: 1 00000100:00100000:3.0:1746065191.377644:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263198976 00000100:00100000:3.0:1746065191.377647:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263198976 00010000:00010000:3.0:1746065191.377662:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 14 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.377666:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7637 00000100:00100000:1.0:1746065191.377673:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881263198848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065191.377684:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065191.377705:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 19 pid: 21998 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746065191.377715:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 19 pid: 21998 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746065191.377740:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdab3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61279 expref: 19 pid: 21998 timeout: 890 lvb_type: 1 00010000:00010000:1.0:1746065191.377752:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.377922:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7638 00000100:00100000:3.0:1746065191.377928:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263198976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.377934:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.378139:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 14 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.378148:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 14 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.378163:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c860a00/0x14b4f8542d4fdaac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61272 expref: 14 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.378173:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.378174:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.378179:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.378186:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.378212:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.378222:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260404608:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.378606:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881263198848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 932us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.378613:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7637 00000100:00100000:3.0:1746065191.378647:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065191.383715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.383905:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263199232 00000100:00100000:2.0:1746065191.383912:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263199232 00002000:00100000:2.0:1746065191.383945:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3047424->3051519) req@ffff880095352a00 x1830881263199232/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.383959:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352a00 with x1830881263199232 ext(3047424->3051519) 00002000:00010000:2.0:1746065191.383963:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095352a00 00000100:00100000:2.0:1746065191.383979:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8387 00000100:00100000:2.0:1746065191.383984:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263199232:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065191.384302:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260404608:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065191.384316:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065191.384427:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263199232:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 442us (719us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.384433:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8387 00002000:00100000:2.0:1746065191.384438:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3047424->3051519) req@ffff880095352a00 x1830881263199232/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.384444:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352a00 with x1830881263199232 ext(3047424->3051519) 00002000:00010000:2.0:1746065191.384446:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095352a00 00000100:00100000:3.0:1746065191.384491:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263198976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6564us (6863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.384497:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7638 00000100:00100000:0.0:1746065191.388062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.389619:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263199360 00000100:00100000:3.0:1746065191.389627:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263199360 00000100:00100000:3.0:1746065191.393780:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14885 00000100:00100000:3.0:1746065191.393797:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:31942:x1830881263199360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065191.393830:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.393850:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6128e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.393878:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.393885:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.393892:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.393897:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065191.393899:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065191.393902:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3043327] (req 2097152->3043327) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.393930:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.393952:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 18 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.393963:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260404736:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.394062:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.394073:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 26 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.394081:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260404864:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.394106:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.394113:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 18 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.394120:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260404992:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.394136:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.398809:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260404736:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.399037:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260404864:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.399052:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260404992:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.399086:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3043327] (req 2097152->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.399100:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c24a200, rc 0) 00000100:00100000:3.0:1746065191.399286:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:31942:x1830881263199360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5494us (11226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.399293:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14885 00000100:00100000:0.0:1746065191.401613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.401696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.401850:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263199488 00000100:00100000:3.0:1746065191.401859:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263199488 00000100:00100000:2.0:1746065191.401873:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263199616 00000100:00100000:2.0:1746065191.401877:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263199616 00010000:00010000:2.0:1746065191.401893:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.401894:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 18 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.401929:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7639 00000100:00100000:3.0:1746065191.401936:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:1958:x1830881263199488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.401946:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.401966:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 18 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.401976:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 18 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.401993:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c757000/0x14b4f8542d4fdaba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61280 expref: 18 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.402009:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.402139:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263199488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 203us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.402146:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7639 00000100:00100000:3.0:1746065191.402161:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7640 00000100:00100000:3.0:1746065191.402165:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263199616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.402171:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.402179:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.402190:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.402200:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e8b0200/0x14b4f8542d4fda82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6126b expref: 27 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.402208:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.402221:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263199616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.402226:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7640 00000100:00100000:2.0:1746065191.403390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.403437:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263199744 00000100:00100000:1.0:1746065191.403442:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263199744 00010000:00010000:1.0:1746065191.403459:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 17 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.403487:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7641 00000100:00100000:1.0:1746065191.403492:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263199744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065191.403566:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065191.403580:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 17 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.403590:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 17 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.403603:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f758600/0x14b4f8542d4fda58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6124f expref: 17 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.403772:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.403774:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.403780:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.403791:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.403841:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.403851:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260405120:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.404015:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065191.405234:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260405120:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065191.405245:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065191.405273:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263199744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1781us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.405279:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7641 00000100:00100000:0.0:1746065191.411951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.412187:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263200000 00000100:00100000:2.0:1746065191.412195:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263200000 00000100:00100000:2.0:1746065191.412248:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10033 00000100:00100000:2.0:1746065191.412255:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:31948:x1830881263200000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.412275:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.412290:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fdacf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61295 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.412382:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.412393:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.412402:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.412415:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.412420:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.412425:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413129:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413138:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413145:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065191.413153:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065191.413217:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413223:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413231:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413235:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac55600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.413238:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413243:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413252:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.413254:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065191.413257:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413261:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55600/0x14b4f8542d4fdae4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413456:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413461:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413465:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413468:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac55400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.413470:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413474:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413483:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065191.413485:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.413488:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413492:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55400/0x14b4f8542d4fdad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413498:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413502:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413506:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413509:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac54a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.413511:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413515:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413519:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fa00) 00010000:00010000:2.0:1746065191.413520:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.413522:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413525:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac54a00/0x14b4f8542d4fdadd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.413555:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fdacf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61295 expref: 261 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.413562:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fdacf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61295 expref: 261 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.413568:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55a00, rc 0) 00000100:00100000:2.0:1746065191.413904:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:31948:x1830881263200000:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1647us (1958us total) trans 8589944290 rc 301/301 00000100:00100000:2.0:1746065191.413910:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10033 00000100:00100000:0.0:1746065191.417567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.417658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.417727:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263200256 00000100:00100000:2.0:1746065191.417745:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263200256 00002000:00100000:2.0:1746065191.417778:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3039232->3043327) req@ffff880135cddf80 x1830881263200256/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.417787:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cddf80 with x1830881263200256 ext(3039232->3043327) 00002000:00010000:2.0:1746065191.417791:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cddf80 00000100:00100000:2.0:1746065191.417807:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8388 00000100:00100000:2.0:1746065191.417831:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881263200256:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065191.417966:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881263200256:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 152us (406us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.417973:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8388 00002000:00100000:2.0:1746065191.417978:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (3039232->3043327) req@ffff880135cddf80 x1830881263200256/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.417985:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cddf80 with x1830881263200256 ext(3039232->3043327) 00002000:00010000:2.0:1746065191.417987:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cddf80 00000100:00100000:3.0:1746065191.418183:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263200384 00000100:00100000:3.0:1746065191.418187:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263200384 00000100:00100000:3.0:1746065191.418209:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14886 00000100:00100000:3.0:1746065191.418214:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881263200384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065191.418223:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.418235:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fdaf2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6129c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.418274:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260405248:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065191.418332:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.419264:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.419324:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263200512 00000100:00100000:3.0:1746065191.419328:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263200512 00000100:00100000:3.0:1746065191.419351:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14887 00000100:00100000:3.0:1746065191.419356:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263200512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065191.419365:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.419376:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a325000/0x14b4f8542d4fdaf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612a3 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.419402:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260405376:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065191.420305:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d180 going to sleep for 11 seconds 00002000:00010000:3.0:1746065191.421964:0:8429:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime: 1746065191 -> 1746065192 00000100:00100000:3.0:1746065191.421987:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260405248:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065191.422015:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fdaf2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6129c expref: 19 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.422026:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fdaf2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6129c expref: 19 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.423126:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf6000, rc 0) 00000100:00100000:3.0:1746065191.423176:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881263200384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4959us (5516us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065191.423184:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14886 00000100:00100000:1.0:1746065191.423319:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.423745:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263200768 00000100:00100000:3.0:1746065191.423751:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263200768 00000100:00100000:3.0:1746065191.423778:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4309 00000100:00100000:3.0:1746065191.423784:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:31942:x1830881263200768:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065191.423919:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260405376:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065191.423942:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a325000/0x14b4f8542d4fdaf9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612a3 expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.423952:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a325000/0x14b4f8542d4fdaf9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612a3 expref: 27 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.423963:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a325000, rc 0) 00000100:00100000:2.0:1746065191.423997:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263200512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4639us (4733us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065191.424002:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14887 00000100:00100000:3.0:1746065191.424433:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:31942:x1830881263200768:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 645us (1111us total) trans 8589944291 rc 0/0 00000100:00100000:3.0:1746065191.424439:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4309 00000100:00100000:0.0:1746065191.433158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.434992:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263200896 00000100:00100000:2.0:1746065191.435003:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263200896 00000100:00100000:2.0:1746065191.435053:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14888 00000100:00100000:2.0:1746065191.435061:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881263200896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.435076:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.435092:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fdb00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612aa expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065191.435134:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260405504:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065191.435199:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.435481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.435510:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263201024 00000100:00100000:3.0:1746065191.435514:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263201024 00000100:00100000:3.0:1746065191.435608:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14889 00000100:00100000:3.0:1746065191.435614:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263201024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065191.435621:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.435634:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d02000/0x14b4f8542d4fdb07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612b1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.435657:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260405632:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065191.435694:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.437427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.437625:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263201280 00000100:00100000:2.0:1746065191.437630:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263201280 00000100:00100000:2.0:1746065191.437657:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10034 00000100:00100000:2.0:1746065191.437662:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:31951:x1830881263201280:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065191.437676:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.437688:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55200/0x14b4f8542d4fdb0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612b8 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.437780:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.437790:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.437799:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.437809:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065191.437987:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260405504:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065191.438006:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fdb00 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612aa expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.438015:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac55a00/0x14b4f8542d4fdb00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612aa expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.438022:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55a00, rc 0) 00000100:00100000:3.0:1746065191.438058:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881263200896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2996us (4905us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065191.438064:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14888 00010000:00010000:2.0:1746065191.438070:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438076:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065191.438135:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260405632:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065191.438150:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d02000/0x14b4f8542d4fdb07 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612b1 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065191.438158:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d02000/0x14b4f8542d4fdb07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612b1 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065191.438170:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d02000, rc 0) 00000100:00100000:0.0:1746065191.438187:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263201024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2574us (2707us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065191.438192:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14889 00010000:00010000:2.0:1746065191.438318:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438325:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438330:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065191.438336:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065191.438506:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438512:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438519:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438524:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c24b000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.438527:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438532:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438541:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.438543:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065191.438547:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438551:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b000/0x14b4f8542d4fdb23 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438572:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438576:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438580:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438584:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c24b800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.438585:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438589:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438597:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065191.438599:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.438601:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438605:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdb15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438613:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438617:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438621:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438625:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c24b200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.438627:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438632:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438637:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fe00) 00010000:00010000:2.0:1746065191.438639:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.438641:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438645:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b200/0x14b4f8542d4fdb1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.438674:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55200/0x14b4f8542d4fdb0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612b8 expref: 262 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.438681:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac55200/0x14b4f8542d4fdb0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612b8 expref: 262 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.438688:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac55200, rc 0) 00000100:00100000:2.0:1746065191.438719:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31951:x1830881263201280:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1056us (1296us total) trans 8589944292 rc 301/301 00000100:00100000:2.0:1746065191.438724:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10034 00000100:00100000:0.0:1746065191.443981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.444244:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263201408 00000100:00100000:2.0:1746065191.444252:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263201408 00000100:00100000:2.0:1746065191.444287:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14890 00000100:00100000:2.0:1746065191.444293:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:31948:x1830881263201408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.444307:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.444321:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612bf expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.444344:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.444350:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065191.444352:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065191.444355:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.444381:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.444395:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 12 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065191.444405:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260405760:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065191.444474:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065191.446848:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260405760:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.446871:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.446885:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e8b0000, rc 0) 00000100:00100000:2.0:1746065191.446924:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:31948:x1830881263201408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2630us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.446931:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14890 00000100:00100000:0.0:1746065191.447254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.447298:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263201536 00000100:00100000:2.0:1746065191.447303:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263201536 00002000:00100000:2.0:1746065191.447329:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3047424->3145727) req@ffff88009baa3100 x1830881263201536/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.447336:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3100 with x1830881263201536 ext(3047424->3145727) 00010000:00010000:2.0:1746065191.447342:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 13 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.447353:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 13 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.447363:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa3100 00000100:00100000:2.0:1746065191.447392:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2548 00000100:00100000:2.0:1746065191.447398:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263201536:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065191.449775:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263201536:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 2370us (2515us total) trans 21474840943 rc 0/0 00000100:00100000:2.0:1746065191.449784:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2548 00002000:00100000:2.0:1746065191.449792:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3047424->3145727) req@ffff88009baa3100 x1830881263201536/t21474840943(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.449799:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa3100 with x1830881263201536 ext(3047424->3145727) 00010000:00010000:2.0:1746065191.449806:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 15 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.449846:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 15 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.449852:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa3100 00000100:00100000:0.0:1746065191.451022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.451087:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263201664 00000100:00100000:1.0:1746065191.451094:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263201664 00010000:00010000:1.0:1746065191.451116:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 15 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.451136:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7642 00000100:00100000:1.0:1746065191.451142:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263201664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065191.451152:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065191.451165:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 15 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.451180:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 15 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.451198:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cf7000/0x14b4f8542d4fdac1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61287 expref: 15 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.451223:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.451225:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.451231:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.451238:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.451263:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.451272:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260405888:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.451331:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065191.454690:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260405888:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065191.454711:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065191.454769:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263201664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3623us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.454779:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7642 00000100:00100000:0.0:1746065191.455394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.455635:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263201920 00000100:00100000:2.0:1746065191.455644:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263201920 00002000:00100000:2.0:1746065191.455683:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009baa2a00 x1830881263201920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.455692:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2a00 with x1830881263201920 ext(2097152->3145727) 00002000:00010000:2.0:1746065191.455696:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2a00 00000100:00100000:2.0:1746065191.455746:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8389 00000100:00100000:2.0:1746065191.455754:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263201920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065191.465112:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263201920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9349us (9712us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065191.465124:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8389 00002000:00100000:2.0:1746065191.465136:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009baa2a00 x1830881263201920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.465144:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa2a00 with x1830881263201920 ext(2097152->3145727) 00002000:00010000:2.0:1746065191.465148:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baa2a00 00000100:00100000:0.0:1746065191.469592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.469638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.469700:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263202304 00000100:00100000:3.0:1746065191.470772:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263202304 00000100:00100000:3.0:1746065191.470856:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4310 00000100:00100000:3.0:1746065191.470864:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:31909:x1830881263202304:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065191.470995:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263202048 00000100:00100000:2.0:1746065191.470999:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263202048 00000100:00100000:2.0:1746065191.471023:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14891 00000100:00100000:2.0:1746065191.471028:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31948:x1830881263202048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.471037:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.471050:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612c6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.471058:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31909:x1830881263202304:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 194us (1419us total) trans 8589944293 rc 0/0 00000100:00100000:3.0:1746065191.471068:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4310 00010000:00010000:2.0:1746065191.471072:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.471079:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065191.471080:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065191.471084:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.471116:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.471130:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 15 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065191.471141:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260406016:192.168.202.46@tcp:104: 00000100:00080000:1.0:1746065191.471211:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065191.471256:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.473369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.473463:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260406016:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.473487:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.473500:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f6a00, rc 0) 00000100:00100000:2.0:1746065191.473527:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31948:x1830881263202048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2499us (3943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.473532:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14891 00000100:00100000:3.0:1746065191.473592:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263202560 00000100:00100000:3.0:1746065191.473596:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263202560 00000100:00100000:3.0:1746065191.473952:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4311 00000100:00100000:3.0:1746065191.473958:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:31909:x1830881263202560:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065191.474095:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31909:x1830881263202560:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 136us (730us total) trans 8589944294 rc 0/0 00000100:00100000:3.0:1746065191.474100:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4311 00000100:00100000:0.0:1746065191.475177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.475306:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263202688 00000100:00100000:2.0:1746065191.475310:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263202688 00002000:00100000:2.0:1746065191.475333:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3043327) req@ffff8800900c3b80 x1830881263202688/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.475341:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c3b80 with x1830881263202688 ext(2097152->3043327) 00010000:00010000:2.0:1746065191.475347:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 16 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.475358:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 16 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.475368:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900c3b80 00000100:00100000:2.0:1746065191.475389:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2549 00000100:00100000:2.0:1746065191.475395:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881263202688:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065191.477034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.477111:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263202816 00000100:00100000:3.0:1746065191.477115:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263202816 00000100:00100000:3.0:1746065191.477140:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14892 00000100:00100000:3.0:1746065191.477145:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:31951:x1830881263202816:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065191.477156:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.477169:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612cd expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.477190:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.477197:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.477198:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.477201:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2285568->2764799] (req 2285568->2764799) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.477225:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.477239:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.477255:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260406144:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.477316:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065191.483060:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260406144:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.483093:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2285568->2764799] (req 2285568->2764799) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.483111:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf6a00, rc 0) 00000100:00100000:2.0:1746065191.483166:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:31951:x1830881263202816:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6018us (6133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.483174:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14892 00000100:00100000:1.0:1746065191.486027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.486054:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263202944 00000100:00100000:1.0:1746065191.486063:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263202944 00010000:00010000:1.0:1746065191.486100:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.486129:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7643 00000100:00100000:1.0:1746065191.486136:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263202944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065191.486147:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065191.486171:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.486182:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.486204:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e8b0000/0x14b4f8542d4fdb31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612bf expref: 20 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.486905:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.486908:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.486916:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.486925:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.486957:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 19 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.486973:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260406272:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.487031:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065191.492523:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.492702:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263203200 00000100:00100000:3.0:1746065191.492709:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263203200 00002000:00100000:3.0:1746065191.492753:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2285568->2289663) req@ffff880095351880 x1830881263203200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.492763:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351880 with x1830881263203200 ext(2285568->2289663) 00002000:00010000:3.0:1746065191.492769:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351880 00000100:00100000:0.0:1746065191.492850:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260406272:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065191.492868:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065191.492906:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263202944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6769us (6886us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065191.492914:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7643 00000100:00100000:3.0:1746065191.493183:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8390 00000100:00100000:3.0:1746065191.493192:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881263203200:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065191.493429:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881263203200:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 237us (913us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065191.493434:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8390 00002000:00100000:3.0:1746065191.493439:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (2285568->2289663) req@ffff880095351880 x1830881263203200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.493445:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095351880 with x1830881263203200 ext(2285568->2289663) 00002000:00010000:3.0:1746065191.493448:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095351880 00000100:00100000:3.0:1746065191.500719:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881263202688:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 25312us (25532us total) trans 17179873664 rc 0/0 00000100:00100000:3.0:1746065191.500748:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2549 00002000:00100000:3.0:1746065191.500760:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3043327) req@ffff8800900c3b80 x1830881263202688/t17179873664(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.500769:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c3b80 with x1830881263202688 ext(2097152->3043327) 00010000:00010000:3.0:1746065191.500779:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 18 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.500793:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 18 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:3.0:1746065191.500798:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900c3b80 00000100:00100000:0.0:1746065191.502299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.502416:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263203456 00000100:00100000:3.0:1746065191.502424:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263203456 00002000:00100000:3.0:1746065191.502455:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2760704->2764799) req@ffff8800900c2a00 x1830881263203456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.502463:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c2a00 with x1830881263203456 ext(2760704->2764799) 00002000:00010000:3.0:1746065191.502466:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c2a00 00000100:00100000:3.0:1746065191.502482:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8391 00000100:00100000:3.0:1746065191.502488:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881263203456:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065191.502630:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881263203456:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 141us (334us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065191.502636:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8391 00002000:00100000:3.0:1746065191.502640:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2760704->2764799) req@ffff8800900c2a00 x1830881263203456/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.502652:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c2a00 with x1830881263203456 ext(2760704->2764799) 00002000:00010000:3.0:1746065191.502654:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c2a00 00000100:00100000:0.0:1746065191.504522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.504575:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263203584 00000100:00100000:2.0:1746065191.504747:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263203584 00010000:00010000:2.0:1746065191.504774:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 18 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065191.504846:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7644 00000100:00100000:0.0:1746065191.504855:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:1958:x1830881263203584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065191.504865:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065191.504883:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 18 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065191.504896:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 18 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065191.504919:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c24a200/0x14b4f8542d4fdac8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3043327) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6128e expref: 18 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065191.504945:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065191.504947:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065191.504953:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.504960:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.504985:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 26 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065191.504995:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260406400:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065191.505058:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.508057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.508105:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263203840 00000100:00100000:1.0:1746065191.508114:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263203840 00000100:00100000:1.0:1746065191.508719:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4312 00000100:00100000:1.0:1746065191.508736:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:31951:x1830881263203840:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065191.508921:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:31951:x1830881263203840:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 194us (872us total) trans 8589944295 rc 0/0 00000100:00100000:1.0:1746065191.508928:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4312 00000100:00100000:2.0:1746065191.510851:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260406400:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065191.510871:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065191.510906:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263203584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6052us (6389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.510915:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7644 00000100:00100000:0.0:1746065191.519560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.519991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.520028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.520050:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263204224 00000100:00100000:3.0:1746065191.520057:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263204224 00002000:00100000:3.0:1746065191.520094:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800900c2680 x1830881263204224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065191.520100:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263204352 00002000:00100000:3.0:1746065191.520103:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c2680 with x1830881263204224 ext(3145728->4194303) 00000100:00100000:2.0:1746065191.520105:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263204352 00002000:00010000:3.0:1746065191.520108:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c2680 00002000:00100000:2.0:1746065191.520122:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff8800900c3800 x1830881263204352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065191.520125:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263204480 00000100:00100000:3.0:1746065191.520127:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263204480 00002000:00100000:2.0:1746065191.520130:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c3800 with x1830881263204352 ext(2097152->3145727) 00002000:00010000:2.0:1746065191.520133:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c3800 00002000:00100000:3.0:1746065191.520138:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800900c1500 x1830881263204480/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.520145:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1500 with x1830881263204480 ext(3145728->4194303) 00002000:00010000:3.0:1746065191.520147:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c1500 00000100:00100000:2.0:1746065191.520154:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8392 00000100:00100000:3.0:1746065191.520158:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8393 00000100:00100000:2.0:1746065191.520160:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263204224:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065191.520163:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881263204352:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065191.520275:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8394 00000100:00100000:1.0:1746065191.520281:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881263204480:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065191.531309:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263204480:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11011us (11262us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065191.531320:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8394 00002000:00100000:1.0:1746065191.531329:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800900c1500 x1830881263204480/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.531339:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1500 with x1830881263204480 ext(3145728->4194303) 00002000:00010000:1.0:1746065191.531344:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c1500 00000100:00100000:2.0:1746065191.534137:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263204224:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13969us (14578us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065191.534147:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8392 00002000:00100000:2.0:1746065191.534157:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800900c2680 x1830881263204224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.534166:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c2680 with x1830881263204224 ext(3145728->4194303) 00002000:00010000:2.0:1746065191.534174:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c2680 00000100:00100000:3.0:1746065191.536911:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263204352:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 16738us (16911us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065191.536921:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8393 00002000:00100000:3.0:1746065191.536931:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff8800900c3800 x1830881263204352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065191.536936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:3.0:1746065191.536939:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c3800 with x1830881263204352 ext(2097152->3145727) 00002000:00010000:3.0:1746065191.536945:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900c3800 00000100:00100000:2.0:1746065191.537057:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263204864 00000100:00100000:2.0:1746065191.537064:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263204864 00000100:00100000:2.0:1746065191.537101:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10035 00000100:00100000:2.0:1746065191.537108:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:31956:x1830881263204864:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.537126:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.537143:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11c400/0x14b4f8542d4fdb46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612d4 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.537230:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537240:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537249:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537261:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537266:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537271:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537351:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c744600/0x14b4f8542d4fdb5b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537358:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c744600/0x14b4f8542d4fdb5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537363:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c744600/0x14b4f8542d4fdb5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065191.537370:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065191.537438:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537444:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537450:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537455:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d11d600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.537458:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537463:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537475:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065191.537478:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.537481:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537486:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11d600/0x14b4f8542d4fdb4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537510:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537513:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537516:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537520:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d11da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.537521:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537524:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537529:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fd00) 00010000:00010000:2.0:1746065191.537531:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.537533:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537537:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.537566:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d11c400/0x14b4f8542d4fdb46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612d4 expref: 19 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.537576:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c744600/0x14b4f8542d4fdb5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612d4 expref: 18 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.537581:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.537583:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065191.537585:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c744600, rc 0) 00000100:00100000:2.0:1746065191.537604:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:31956:x1830881263204864:12345-192.168.202.46@tcp:101:cat.0 Request processed in 497us (669us total) trans 8589944296 rc 0/0 00000100:00100000:2.0:1746065191.537609:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10035 00000100:00100000:0.0:1746065191.544377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.544467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.544539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.544779:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205376 00000100:00100000:1.0:1746065191.544787:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205376 00000100:00100000:2.0:1746065191.544796:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205504 00000100:00100000:2.0:1746065191.544800:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205504 00000100:00100000:3.0:1746065191.544867:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205120 00000100:00100000:3.0:1746065191.544871:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205120 00002000:00100000:3.0:1746065191.544900:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8800900c1c00 x1830881263205120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.544909:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1c00 with x1830881263205120 ext(4194304->5013503) 00002000:00010000:3.0:1746065191.544914:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c1c00 00000100:00100000:3.0:1746065191.544930:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8395 00000100:00100000:3.0:1746065191.544937:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263205120:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065191.545623:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.545679:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14893 00000100:00100000:1.0:1746065191.545685:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263205376:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065191.545686:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14894 00000100:00100000:2.0:1746065191.545693:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263205504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.545694:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.545701:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.545706:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938e8800/0x14b4f8542d4fdb69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612db expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.545711:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612e2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.545724:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.545726:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.545745:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065191.545752:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260406528:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065191.545758:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 18 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.545767:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d11da00, rc 0) 00000100:00100000:2.0:1746065191.545795:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263205504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 102us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.545800:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14894 00000100:00100000:1.0:1746065191.545810:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065191.545836:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205248 00000100:00100000:2.0:1746065191.545839:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205248 00000100:00100000:2.0:1746065191.545860:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 780 00000100:00100000:2.0:1746065191.545864:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881263205248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065191.545872:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065191.545886:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c744600/0x14b4f8542d4fdb5b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612d4 expref: 18 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.545900:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.545903:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065191.545918:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263205248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.545924:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 780 00000100:00100000:1.0:1746065191.553176:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260406528:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065191.553211:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938e8800/0x14b4f8542d4fdb69 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612db expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.553225:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e8800/0x14b4f8542d4fdb69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612db expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.553239:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e8800, rc 0) 00000100:00100000:1.0:1746065191.554763:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263205376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9068us (10285us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065191.554770:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14893 00000100:00100000:3.0:1746065191.560215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.560442:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263205120:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 15503us (16070us total) trans 0 rc 819200/819200 00000100:00100000:0.0:1746065191.560453:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8395 00002000:00100000:0.0:1746065191.560463:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8800900c1c00 x1830881263205120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 819200/819200 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.560472:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c1c00 with x1830881263205120 ext(4194304->5013503) 00002000:00010000:0.0:1746065191.560477:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c1c00 00000100:00100000:1.0:1746065191.560644:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205632 00000100:00100000:1.0:1746065191.560651:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205632 00000100:00100000:1.0:1746065191.560681:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14895 00000100:00100000:1.0:1746065191.560687:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+14:31956:x1830881263205632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.560699:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.560713:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612e9 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.560749:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.560756:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.560758:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.560761:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.560786:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.560796:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 18 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.560807:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260406656:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065191.561833:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.564977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.565604:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260406656:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065191.565630:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.565646:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e9400, rc 0) 00000100:00100000:1.0:1746065191.565697:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+15:31956:x1830881263205632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5009us (5489us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.565705:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14895 00000100:00100000:2.0:1746065191.566062:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205760 00000100:00100000:2.0:1746065191.566068:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205760 00002000:00100000:2.0:1746065191.566096:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2285568->2764799) req@ffff88009baa1f80 x1830881263205760/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.566104:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1f80 with x1830881263205760 ext(2285568->2764799) 00010000:00010000:2.0:1746065191.566109:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 19 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.566120:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 19 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.566130:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa1f80 00000100:00100000:2.0:1746065191.566142:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2550 00000100:00100000:2.0:1746065191.566147:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263205760:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065191.573750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.573965:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263205888 00000100:00100000:1.0:1746065191.573973:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263205888 00000100:00100000:1.0:1746065191.574009:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14896 00000100:00100000:1.0:1746065191.574016:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263205888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.574031:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.574044:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fdb7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612f0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.574087:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260406784:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065191.574151:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065191.575765:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263205760:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 9612us (10790us total) trans 21474840944 rc 0/0 00000100:00100000:2.0:1746065191.575775:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2550 00002000:00100000:2.0:1746065191.575785:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2285568->2764799) req@ffff88009baa1f80 x1830881263205760/t21474840944(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.575794:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baa1f80 with x1830881263205760 ext(2285568->2764799) 00010000:00010000:2.0:1746065191.575802:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 23 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.575830:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 23 pid: 8429 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.575836:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009baa1f80 00000100:00100000:1.0:1746065191.576960:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260406784:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065191.576988:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fdb7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f0 expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.576998:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fdb7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f0 expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.577023:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e9200, rc 0) 00000100:00100000:1.0:1746065191.577057:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263205888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3041us (3316us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065191.577063:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14896 00000100:00100000:0.0:1746065191.579625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.579674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.579761:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263206144 00000100:00100000:2.0:1746065191.579769:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263206144 00010000:00010000:2.0:1746065191.579802:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 21 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.580078:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263206016 00000100:00100000:1.0:1746065191.580081:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263206016 00000100:00100000:1.0:1746065191.580102:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14897 00000100:00100000:1.0:1746065191.580108:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31948:x1830881263206016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.580122:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.580133:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612f7 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.580154:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.580157:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.580160:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [5009408->5242879] (req 5009408->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.580169:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [5009408->5242879] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.580176:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e9c00, rc 0) 00000100:00100000:2.0:1746065191.580566:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7645 00000100:00100000:2.0:1746065191.580573:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263206144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065191.580584:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065191.580606:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 23 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.580615:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 23 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.580632:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdb3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2285568->2764799) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612cd expref: 23 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.580886:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31948:x1830881263206016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 776us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.580891:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14897 00010000:00010000:2.0:1746065191.580893:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.580894:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.580900:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.580907:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.580914:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.580915:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.580918:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.580924:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.580951:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065191.580966:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260406912:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065191.581226:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065191.581234:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260407040:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065191.581253:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.584043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.584618:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260406912:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065191.584630:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260407040:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065191.584646:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.584861:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263206400 00000100:00100000:3.0:1746065191.584867:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263206400 00002000:00100000:3.0:1746065191.584903:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88008fd73100 x1830881263206400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.584912:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73100 with x1830881263206400 ext(5009408->5013503) 00002000:00010000:3.0:1746065191.584916:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd73100 00000100:00100000:3.0:1746065191.584933:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8396 00000100:00100000:3.0:1746065191.584938:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263206400:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065191.585645:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263206144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5068us (5967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.585653:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7645 00000100:00100000:3.0:1746065191.586331:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263206400:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1389us (2292us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065191.586338:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8396 00002000:00100000:3.0:1746065191.586344:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88008fd73100 x1830881263206400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.586351:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73100 with x1830881263206400 ext(5009408->5013503) 00002000:00010000:3.0:1746065191.586354:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd73100 00000100:00100000:0.0:1746065191.592347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.592439:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263206656 00000100:00100000:3.0:1746065191.592446:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263206656 00000100:00100000:3.0:1746065191.592630:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4313 00000100:00100000:3.0:1746065191.592637:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+262:31948:x1830881263206656:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065191.593184:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:31948:x1830881263206656:12345-192.168.202.46@tcp:35:cat.0 Request processed in 546us (844us total) trans 8589944297 rc 0/0 00000100:00100000:3.0:1746065191.593191:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4313 00000100:00100000:0.0:1746065191.601590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.601624:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.601650:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.601674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.601763:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207168 00000100:00100000:1.0:1746065191.601771:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207168 00002000:00100000:1.0:1746065191.601804:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fd70a80 x1830881263207168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.601836:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70a80 with x1830881263207168 ext(3145728->4194303) 00002000:00010000:1.0:1746065191.601842:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70a80 00000100:00100000:1.0:1746065191.601856:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207040 00000100:00100000:1.0:1746065191.601859:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207040 00002000:00100000:1.0:1746065191.601869:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd73480 x1830881263207040/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.601875:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73480 with x1830881263207040 ext(2097152->3145727) 00002000:00010000:1.0:1746065191.601877:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd73480 00000100:00100000:1.0:1746065191.601884:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207552 00000100:00100000:1.0:1746065191.601886:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207552 00002000:00100000:1.0:1746065191.601896:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd71180 x1830881263207552/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.601907:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71180 with x1830881263207552 ext(3145728->4194303) 00002000:00010000:1.0:1746065191.601909:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71180 00000100:00100000:1.0:1746065191.601916:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207424 00000100:00100000:1.0:1746065191.601919:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207424 00000100:00100000:2.0:1746065191.601965:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8397 00000100:00100000:2.0:1746065191.601973:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263207168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.602052:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8398 00000100:00100000:0.0:1746065191.602058:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263207040:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065191.603100:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8399 00000100:00100000:2.0:1746065191.603107:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263207552:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:1.0:1746065191.604871:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88008fd72300 x1830881263207424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.604882:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72300 with x1830881263207424 ext(2097152->3145727) 00002000:00010000:1.0:1746065191.604887:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72300 00000100:00100000:1.0:1746065191.604916:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8400 00000100:00100000:1.0:1746065191.604924:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263207424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065191.616219:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263207168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14237us (14628us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065191.616230:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8397 00002000:00100000:2.0:1746065191.616241:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fd70a80 x1830881263207168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.616256:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd70a80 with x1830881263207168 ext(3145728->4194303) 00002000:00010000:2.0:1746065191.616261:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd70a80 00000100:00100000:2.0:1746065191.634114:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263207552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 30996us (32451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065191.634128:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8399 00002000:00100000:2.0:1746065191.634141:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd71180 x1830881263207552/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.634151:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71180 with x1830881263207552 ext(3145728->4194303) 00002000:00010000:2.0:1746065191.634156:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd71180 00000100:00100000:0.0:1746065191.638413:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263207040:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36347us (36780us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065191.638423:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8398 00002000:00100000:0.0:1746065191.638433:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd73480 x1830881263207040/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.638441:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd73480 with x1830881263207040 ext(2097152->3145727) 00002000:00010000:0.0:1746065191.638446:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd73480 00000100:00100000:1.0:1746065191.639042:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263207424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 34119us (37366us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065191.639049:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8400 00002000:00100000:1.0:1746065191.639054:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88008fd72300 x1830881263207424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.639060:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72300 with x1830881263207424 ext(2097152->3145727) 00002000:00010000:1.0:1746065191.639063:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72300 00000100:00100000:0.0:1746065191.649006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.649120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.649148:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263208192 00000100:00100000:0.0:1746065191.649155:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263208192 00000100:00100000:1.0:1746065191.649175:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263207936 00000100:00100000:1.0:1746065191.649178:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263207936 00002000:00100000:1.0:1746065191.649211:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd72a00 x1830881263207936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065191.649214:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10036 00002000:00100000:1.0:1746065191.649220:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72a00 with x1830881263207936 ext(4194304->5013503) 00000100:00100000:0.0:1746065191.649221:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:31959:x1830881263208192:12345-192.168.202.46@tcp:101:multiop.0 00002000:00010000:1.0:1746065191.649225:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72a00 00000100:00100000:1.0:1746065191.649237:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8401 00010000:00010000:0.0:1746065191.649240:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065191.649241:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263207936:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:0.0:1746065191.649255:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4fdb8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e612fe expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.649336:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649347:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649355:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649364:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649368:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649373:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649464:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649470:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649475:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065191.649481:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065191.649545:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649550:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649555:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649559:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f5d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065191.649562:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649567:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649575:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065191.649577:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065191.649580:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649584:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdb93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649599:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649603:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649607:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649610:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f5d400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065191.649611:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649615:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649619:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6f400) 00010000:00010000:0.0:1746065191.649621:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065191.649623:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649627:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdb9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.649656:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4fdb8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 266 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.649665:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 265 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.649671:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065191.649673:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065191.649675:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f5de00, rc 0) 00000100:00100000:0.0:1746065191.649709:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:31959:x1830881263208192:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 489us (589us total) trans 8589944298 rc 0/0 00000100:00100000:0.0:1746065191.649715:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10036 00000100:00100000:1.0:1746065191.655324:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263207936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6072us (6319us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065191.655334:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8401 00002000:00100000:1.0:1746065191.655345:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd72a00 x1830881263207936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.655353:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72a00 with x1830881263207936 ext(4194304->5013503) 00002000:00010000:1.0:1746065191.655358:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd72a00 00000100:00100000:0.0:1746065191.659673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.659759:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263208320 00000100:00100000:1.0:1746065191.659766:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263208320 00000100:00100000:1.0:1746065191.659810:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14898 00000100:00100000:1.0:1746065191.659838:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31959:x1830881263208320:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065191.659854:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.659869:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61305 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.659892:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.659899:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.659905:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.659906:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.659909:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.659935:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.659944:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 22 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.659952:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260407168:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065191.660040:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 14 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.660048:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 14 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.660055:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260407296:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065191.660072:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.662045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.662298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.662318:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263208960 00000100:00100000:2.0:1746065191.662323:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263208960 00010000:00010000:2.0:1746065191.662346:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065191.662365:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7646 00000100:00100000:2.0:1746065191.662370:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263208960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065191.662379:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065191.662395:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.662404:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.662425:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065191.662448:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263208960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.662453:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7646 00000100:00100000:3.0:1746065191.662636:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263208576 00000100:00100000:3.0:1746065191.662640:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263208576 00000100:00100000:3.0:1746065191.662663:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4314 00000100:00100000:3.0:1746065191.662667:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094491450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:31956:x1830881263208576:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065191.662848:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094491450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:31956:x1830881263208576:12345-192.168.202.46@tcp:35:cat.0 Request processed in 180us (807us total) trans 8589944299 rc 0/0 00000100:00100000:3.0:1746065191.662854:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4314 00000100:00100000:0.0:1746065191.664836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065191.665029:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9c00/0x14b4f8542d4fdb85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612f7 expref: 22 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.665047:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260407168:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065191.665057:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260407296:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065191.665078:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.665094:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e8a00, rc 0) 00000100:00100000:1.0:1746065191.665136:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31959:x1830881263208320:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5319us (5470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.665143:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14898 00000100:00100000:3.0:1746065191.666352:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263208832 00000100:00100000:3.0:1746065191.666360:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263208832 00000100:00100000:3.0:1746065191.666407:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10037 00000100:00100000:3.0:1746065191.666414:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:31961:x1830881263208832:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065191.666427:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.666440:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c000/0x14b4f8542d4fdbb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6130c expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.666514:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.666527:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 264 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.666539:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 19 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.666545:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.666551:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 6/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.666573:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 264 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.666582:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 264 pid: 14644 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.666591:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260407424:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.666859:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 19 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.666867:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 19 pid: 14644 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.666874:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260407552:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.667592:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 264 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.667600:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 264 pid: 14643 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.667608:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260407680:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.667637:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065191.667974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.668027:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263209088 00000100:00100000:3.0:1746065191.668031:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263209088 00010000:00010000:3.0:1746065191.668051:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 15 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.668078:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7647 00000100:00100000:3.0:1746065191.668083:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881263209088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.668091:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.668107:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 15 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.668116:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 15 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.668132:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9400/0x14b4f8542d4fdb77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e9 expref: 15 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.668142:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.668144:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.668150:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.668156:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.668173:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.668180:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260407808:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065191.668220:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.671095:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260407424:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.671105:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260407552:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.671111:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260407680:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.671131:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065191.671669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.671690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.671848:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260407808:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065191.671859:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065191.671902:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263209088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3818us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.671912:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7647 00000100:00100000:2.0:1746065191.671934:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263209216 00000100:00100000:2.0:1746065191.671939:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263209216 00010000:00010000:2.0:1746065191.671958:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 265 pid: 14644 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.671983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.673722:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263209472 00000100:00100000:3.0:1746065191.673739:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263209472 00000100:00100000:1.0:1746065191.673744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.673761:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263209728 00000100:00100000:1.0:1746065191.673764:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263209728 00010000:00010000:3.0:1746065191.673765:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 266 pid: 14643 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.673785:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263209344 00000100:00100000:3.0:1746065191.673787:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263209344 00002000:00100000:1.0:1746065191.673790:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3043328->3047423) req@ffff880095352680 x1830881263209728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746065191.673795:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 20 pid: 14644 timeout: 890 lvb_type: 0 00002000:00100000:1.0:1746065191.673804:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352680 with x1830881263209728 ext(3043328->3047423) 00000100:00100000:3.0:1746065191.673806:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7648 00002000:00010000:1.0:1746065191.673808:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095352680 00000100:00100000:3.0:1746065191.673812:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:1959:x1830881263209216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065191.673829:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8402 00000100:00100000:1.0:1746065191.673833:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263209728:12345-192.168.202.46@tcp:3:multiop.0 00010000:00010000:3.0:1746065191.673835:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.673841:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 266 pid: 14644 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.673849:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 266 pid: 14644 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.673865:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdba1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612fe expref: 266 pid: 14644 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.673877:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.673881:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.673887:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.673891:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.673919:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+265:1959:x1830881263209216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.673925:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7648 00000100:00100000:3.0:1746065191.673938:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7649 00000100:00100000:3.0:1746065191.673943:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:1959:x1830881263209472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.673949:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.673953:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 264 pid: 14643 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.673965:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 264 pid: 14643 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.673974:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fd90f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61184 expref: 264 pid: 14643 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.673982:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.673985:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.673990:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.673994:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.674007:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:1959:x1830881263209472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.674012:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7649 00000100:00100000:3.0:1746065191.674053:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7650 00000100:00100000:3.0:1746065191.674057:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881263209344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.674063:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.674066:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 20 pid: 14644 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.674074:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 20 pid: 14644 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.674083:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fda19 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61217 expref: 20 pid: 14644 timeout: 890 lvb_type: 0 00010000:00010000:3.0:1746065191.674089:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.674092:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065191.674482:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263209728:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 648us (739us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065191.674488:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8402 00002000:00100000:1.0:1746065191.674492:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3043328->3047423) req@ffff880095352680 x1830881263209728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.674499:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352680 with x1830881263209728 ext(3043328->3047423) 00002000:00010000:1.0:1746065191.674503:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095352680 00010000:00010000:3.0:1746065191.674586:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.674593:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.674611:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065191.674676:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065191.674683:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065191.674697:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000100:00100000:3.0:1746065191.674838:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881263209344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 779us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.674844:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7650 00010000:00010000:0.0:1746065191.675054:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c000/0x14b4f8542d4fdbb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 20 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.675068:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 19 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.675073:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065191.675075:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065191.675077:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f43c400, rc 0) 00000100:00100000:0.0:1746065191.675097:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:31961:x1830881263208832:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8684us (10268us total) trans 8589944300 rc 0/0 00000100:00100000:0.0:1746065191.675102:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10037 00000100:00100000:0.0:1746065191.677960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.678149:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263209856 00000100:00100000:1.0:1746065191.678157:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263209856 00000100:00100000:1.0:1746065191.678202:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14899 00000100:00100000:1.0:1746065191.678209:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31959:x1830881263209856:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065191.678224:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.678238:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61313 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.678262:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.678270:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.678275:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.678277:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.678280:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->2195455] (req 2097152->2195455) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.678304:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.678315:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 17 pid: 8429 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746065191.678330:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260407936:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065191.679470:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.679480:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 28 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.679489:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260408064:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065191.679512:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065191.681583:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260407936:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065191.687631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.687662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.687686:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263210112 00000100:00100000:0.0:1746065191.687693:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263210112 00000100:00100000:0.0:1746065191.687749:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14900 00000100:00100000:0.0:1746065191.687755:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:31961:x1830881263210112:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065191.687770:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065191.687782:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6131a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.687804:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.687811:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065191.687813:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065191.687837:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3502080->3739647] (req 3502080->3739647) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.687859:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.687867:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 20 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065191.687877:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260408192:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065191.687935:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.687963:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263209984 00000100:00100000:3.0:1746065191.687968:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263209984 00010000:00010000:3.0:1746065191.687987:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 18 pid: 8429 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746065191.688002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.688014:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263210240 00000100:00100000:3.0:1746065191.688016:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263210240 00010000:00010000:3.0:1746065191.688026:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 29 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:3.0:1746065191.688047:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7651 00000100:00100000:3.0:1746065191.688052:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1958:x1830881263209984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.688060:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.688078:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 18 pid: 8429 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.688087:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 18 pid: 8429 timeout: 890 lvb_type: 1 00010000:00010000:3.0:1746065191.688103:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d11da00/0x14b4f8542d4fdb70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612e2 expref: 18 pid: 8429 timeout: 890 lvb_type: 1 00000100:00100000:1.0:1746065191.688294:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7652 00000100:00100000:1.0:1746065191.688302:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263210240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065191.688309:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065191.688318:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 29 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.688326:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 29 pid: 8429 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.688338:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.688339:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.688344:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.688351:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.688374:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 29 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.688381:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260408320:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.688672:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00010000:00010000:3.0:1746065191.689280:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.689305:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263209984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1252us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.689313:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7651 00010000:00010000:2.0:1746065191.689564:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f6a00/0x14b4f8542d4fdb38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e612c6 expref: 29 pid: 8429 timeout: 890 lvb_type: 0 00000100:00100000:2.0:1746065191.689581:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260408064:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.689603:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 28 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.689612:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e9200, rc 0) 00000100:00100000:2.0:1746065191.689646:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31959:x1830881263209856:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11437us (11693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.689652:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14899 00000100:00100000:2.0:1746065191.690345:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260408192:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.690367:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3502080->3739647] (req 3502080->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.690377:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f5c400, rc 0) 00000100:00100000:2.0:1746065191.690397:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:31961:x1830881263210112:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2642us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.690403:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14900 00000100:00100000:0.0:1746065191.690669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.691201:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263210368 00000100:00100000:2.0:1746065191.691207:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263210368 00002000:00100000:2.0:1746065191.691238:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3043328->3145727) req@ffff88008fd71c00 x1830881263210368/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.691246:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71c00 with x1830881263210368 ext(3043328->3145727) 00010000:00010000:2.0:1746065191.691253:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 21 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.691263:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 21 pid: 21998 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.691269:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd71c00 00000100:00100000:2.0:1746065191.691284:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2551 00000100:00100000:2.0:1746065191.691289:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263210368:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065191.691590:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260408320:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065191.691602:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065191.691624:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263210240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3323us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.691631:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7652 00000100:00100000:0.0:1746065191.692930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.693039:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263210624 00000100:00100000:1.0:1746065191.693043:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263210624 00002000:00100000:1.0:1746065191.693069:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2191360->2195455) req@ffff88008fd71f80 x1830881263210624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.693078:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71f80 with x1830881263210624 ext(2191360->2195455) 00002000:00010000:1.0:1746065191.693082:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd71f80 00000100:00100000:1.0:1746065191.693100:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8403 00000100:00100000:1.0:1746065191.693106:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263210624:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065191.693227:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263210624:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 121us (299us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065191.693232:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8403 00002000:00100000:1.0:1746065191.693237:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2191360->2195455) req@ffff88008fd71f80 x1830881263210624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.693249:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71f80 with x1830881263210624 ext(2191360->2195455) 00002000:00010000:1.0:1746065191.693252:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd71f80 00000100:00100000:2.0:1746065191.694222:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263210368:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 2930us (3551us total) trans 21474840945 rc 0/0 00000100:00100000:2.0:1746065191.694229:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2551 00002000:00100000:2.0:1746065191.694236:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3043328->3145727) req@ffff88008fd71c00 x1830881263210368/t21474840945(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.694243:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd71c00 with x1830881263210368 ext(3043328->3145727) 00010000:00010000:2.0:1746065191.694249:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:2.0:1746065191.694261:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00002000:00010000:2.0:1746065191.694268:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd71c00 00000100:00100000:0.0:1746065191.695340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.696471:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263210880 00000100:00100000:0.0:1746065191.696537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.696563:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263210880 00000100:00100000:2.0:1746065191.696610:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4315 00000100:00100000:2.0:1746065191.696617:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+263:31959:x1830881263210880:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065191.696676:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263211008 00000100:00100000:1.0:1746065191.696680:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263211008 00010000:00010000:1.0:1746065191.696698:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00000100:00100000:1.0:1746065191.696719:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7653 00000100:00100000:1.0:1746065191.696724:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263211008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065191.696746:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065191.696805:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:31959:x1830881263210880:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 188us (1467us total) trans 8589944301 rc 0/0 00000100:00100000:2.0:1746065191.696812:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4315 00010000:00010000:1.0:1746065191.697011:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.697021:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.697039:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e8a00/0x14b4f8542d4fdbaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61305 expref: 23 pid: 21998 timeout: 890 lvb_type: 0 00010000:00010000:1.0:1746065191.697353:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.697356:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.697363:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.697371:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.697404:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.697415:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260408448:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.697712:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.702204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.702305:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260408448:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065191.702322:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065191.702358:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263211008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5633us (5822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.702369:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7653 00000100:00100000:2.0:1746065191.703223:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263211264 00000100:00100000:2.0:1746065191.703230:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263211264 00002000:00100000:2.0:1746065191.703261:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3502080->3506175) req@ffff88009a4e8a80 x1830881263211264/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.703272:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8a80 with x1830881263211264 ext(3502080->3506175) 00002000:00010000:2.0:1746065191.703276:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8a80 00000100:00100000:2.0:1746065191.703831:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8404 00000100:00100000:2.0:1746065191.703839:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263211264:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065191.703991:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263211264:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 153us (1796us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.703997:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8404 00002000:00100000:2.0:1746065191.704003:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3502080->3506175) req@ffff88009a4e8a80 x1830881263211264/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.704010:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8a80 with x1830881263211264 ext(3502080->3506175) 00002000:00010000:2.0:1746065191.704013:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8a80 00000100:00100000:0.0:1746065191.710784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.710931:0:21486:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263211520 00000100:00100000:2.0:1746065191.710939:0:21486:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263211520 00002000:00100000:2.0:1746065191.710979:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3735552->3739647) req@ffff88009a4eb800 x1830881263211520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.710989:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eb800 with x1830881263211520 ext(3735552->3739647) 00002000:00010000:2.0:1746065191.710994:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4eb800 00000100:00100000:2.0:1746065191.711014:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8405 00000100:00100000:2.0:1746065191.711020:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263211520:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065191.711167:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263211520:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 145us (389us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.711173:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8405 00002000:00100000:2.0:1746065191.711178:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x383:0x0] (3735552->3739647) req@ffff88009a4eb800 x1830881263211520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.711185:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eb800 with x1830881263211520 ext(3735552->3739647) 00002000:00010000:2.0:1746065191.711188:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4eb800 00000100:00100000:0.0:1746065191.724056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.724111:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263211776 00000100:00100000:2.0:1746065191.724120:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263211776 00000100:00100000:2.0:1746065191.724170:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10038 00000100:00100000:2.0:1746065191.724178:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+264:31967:x1830881263211776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.724200:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.724215:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdbd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61321 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.724308:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724318:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724329:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724341:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724345:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724350:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724450:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724458:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724463:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065191.724474:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065191.724538:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724543:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724548:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724553:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095334c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.724557:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724562:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724571:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065191.724574:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.724577:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724582:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095334c00/0x14b4f8542d4fdbe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724605:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724610:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724614:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724622:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53ce800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.724624:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724628:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724633:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f200) 00010000:00010000:2.0:1746065191.724634:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.724636:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724639:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce800/0x14b4f8542d4fdbe7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.724670:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094371a00/0x14b4f8542d4fdbd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 267 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.724681:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 266 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.724687:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.724689:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065191.724691:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53cea00, rc 0) 00000100:00100000:2.0:1746065191.724754:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:31967:x1830881263211776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 576us (705us total) trans 8589944302 rc 0/0 00000100:00100000:2.0:1746065191.724760:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10038 00000100:00100000:0.0:1746065191.728778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.728844:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263211904 00000100:00100000:2.0:1746065191.728852:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263211904 00000100:00100000:2.0:1746065191.728901:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14901 00000100:00100000:2.0:1746065191.728908:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263211904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.728923:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.728936:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4fdbfc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61328 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065191.728981:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260408576:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065191.729070:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065191.731605:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260408576:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065191.731639:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4fdbfc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61328 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.731652:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf400/0x14b4f8542d4fdbfc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61328 expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.731675:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53cf400, rc 0) 00000100:00100000:2.0:1746065191.731724:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263211904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2814us (2951us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065191.731740:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14901 00000100:00100000:0.0:1746065191.742886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.744244:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212032 00000100:00100000:2.0:1746065191.744255:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212032 00000100:00100000:2.0:1746065191.744320:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14902 00000100:00100000:2.0:1746065191.744327:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31967:x1830881263212032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.744340:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.744354:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6132f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.744385:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.744392:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065191.744394:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065191.744397:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.744420:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.744431:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 14 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065191.744441:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260408704:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065191.744515:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065191.749979:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260408704:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.750010:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.750024:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53cf000, rc 0) 00000100:00100000:2.0:1746065191.750075:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:31967:x1830881263212032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5747us (7197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.750082:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14902 00000100:00100000:0.0:1746065191.753956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.754022:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212160 00000100:00100000:2.0:1746065191.754029:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212160 00002000:00100000:2.0:1746065191.754064:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3502080->3739647) req@ffff88009a4e9880 x1830881263212160/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.754073:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9880 with x1830881263212160 ext(3502080->3739647) 00010000:00010000:2.0:1746065191.754081:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 15 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065191.754093:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 15 pid: 8851 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065191.754099:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e9880 00000100:00100000:2.0:1746065191.754127:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2552 00000100:00100000:2.0:1746065191.754133:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263212160:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065191.770159:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263212160:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 16018us (16203us total) trans 21474840946 rc 0/0 00000100:00100000:2.0:1746065191.770171:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2552 00002000:00100000:2.0:1746065191.770181:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3502080->3739647) req@ffff88009a4e9880 x1830881263212160/t21474840946(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.770191:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9880 with x1830881263212160 ext(3502080->3739647) 00010000:00010000:2.0:1746065191.770199:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 17 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065191.770212:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 17 pid: 8851 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065191.770223:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4e9880 00000100:00100000:0.0:1746065191.773964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.774229:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212288 00000100:00100000:1.0:1746065191.774237:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212288 00010000:00010000:1.0:1746065191.774267:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 17 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746065191.774301:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7654 00000100:00100000:1.0:1746065191.774309:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263212288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065191.774320:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065191.774342:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 17 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065191.774353:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 17 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065191.774376:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdbd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3502080->3739647) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6131a expref: 17 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065191.774400:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.774402:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065191.774408:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.774415:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.774441:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.774502:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260408832:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065191.774955:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.777212:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260408832:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065191.777228:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065191.777270:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263212288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2960us (3312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065191.777279:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7654 00000100:00100000:0.0:1746065191.793348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.793564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.793589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.793607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.793643:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212672 00000100:00100000:1.0:1746065191.793651:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212672 00000100:00100000:3.0:1746065191.793663:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263212928 00000100:00100000:3.0:1746065191.793668:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263212928 00002000:00100000:3.0:1746065191.793685:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3244032->4194303) req@ffff88008fc5b100 x1830881263212928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.793685:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2195456->3244031) req@ffff88009a4e9c00 x1830881263212672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.793694:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b100 with x1830881263212928 ext(3244032->4194303) 00002000:00100000:1.0:1746065191.793694:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9c00 with x1830881263212672 ext(2195456->3244031) 00002000:00010000:3.0:1746065191.793698:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5b100 00002000:00010000:1.0:1746065191.793698:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9c00 00000100:00100000:3.0:1746065191.793710:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213184 00000100:00100000:3.0:1746065191.793711:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213184 00002000:00100000:3.0:1746065191.793720:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fc59500 x1830881263213184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.793734:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59500 with x1830881263213184 ext(3145728->4194303) 00002000:00010000:3.0:1746065191.793737:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc59500 00000100:00100000:0.0:1746065191.793901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.794070:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213568 00000100:00100000:2.0:1746065191.794073:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213568 00000100:00100000:2.0:1746065191.794096:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10039 00000100:00100000:2.0:1746065191.794101:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:31970:x1830881263213568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.794117:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.794131:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd9800/0x14b4f8542d4fdc0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61336 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.794209:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.794218:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.794227:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065191.794273:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213056 00000100:00100000:1.0:1746065191.794276:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213056 00002000:00100000:1.0:1746065191.794288:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88008fc5aa00 x1830881263213056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.794295:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5aa00 with x1830881263213056 ext(2097152->3145727) 00002000:00010000:1.0:1746065191.794298:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5aa00 00000100:00100000:1.0:1746065191.794310:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8406 00000100:00100000:1.0:1746065191.794315:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263212928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065191.794345:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8407 00000100:00100000:3.0:1746065191.794351:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263212672:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065191.795134:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795141:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795148:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795235:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795242:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795248:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065191.795255:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000100:00100000:3.0:1746065191.795274:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8408 00000100:00100000:3.0:1746065191.795279:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263213184:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065191.795313:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795318:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795323:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795328:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012edd8400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.795330:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795335:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795344:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065191.795346:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.795349:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795353:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fdc11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795366:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795370:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795377:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795380:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53ce000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.795382:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795385:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795389:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f200) 00010000:00010000:2.0:1746065191.795391:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.795392:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795396:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.795427:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012edd9800/0x14b4f8542d4fdc0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 22 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.795435:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 21 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.795440:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.795441:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065191.795443:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a6000, rc 0) 00000100:00100000:2.0:1746065191.795461:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:31970:x1830881263213568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1360us (1561us total) trans 8589944303 rc 0/0 00000100:00100000:2.0:1746065191.795466:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10039 00000100:00100000:2.0:1746065191.795487:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8409 00000100:00100000:2.0:1746065191.795491:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263213056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065191.825905:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263212672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31546us (32555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065191.825915:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8407 00002000:00100000:3.0:1746065191.825926:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2195456->3244031) req@ffff88009a4e9c00 x1830881263212672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.825934:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9c00 with x1830881263212672 ext(2195456->3244031) 00002000:00010000:3.0:1746065191.825940:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4e9c00 00000100:00100000:0.0:1746065191.827180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.827214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.827243:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213696 00000100:00100000:2.0:1746065191.827253:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213696 00000100:00100000:2.0:1746065191.827280:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263213824 00000100:00100000:2.0:1746065191.827282:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263213824 00000100:00100000:2.0:1746065191.827294:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14903 00000100:00100000:2.0:1746065191.827300:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263213696:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065191.827312:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.827323:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6133d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.827339:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.827340:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.827347:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.827358:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.827367:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a7e00, rc 0) 00000100:00100000:1.0:1746065191.827378:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14904 00000100:00100000:1.0:1746065191.827387:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263213824:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065191.827389:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263213696:12345-192.168.202.46@tcp:101:cat.0 Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.827393:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14903 00010000:00010000:1.0:1746065191.827395:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.827403:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdc34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61344 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065191.827442:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260408960:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065191.827482:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263213056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31989us (33872us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065191.827485:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.827487:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8409 00002000:00100000:0.0:1746065191.827492:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88008fc5aa00 x1830881263213056/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.827499:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5aa00 with x1830881263213056 ext(2097152->3145727) 00002000:00010000:0.0:1746065191.827502:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5aa00 00000100:00100000:3.0:1746065191.827800:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263213184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 32519us (34208us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065191.827810:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8408 00002000:00100000:3.0:1746065191.827834:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fc59500 x1830881263213184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.827842:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59500 with x1830881263213184 ext(3145728->4194303) 00002000:00010000:3.0:1746065191.827844:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc59500 00000100:00100000:1.0:1746065191.830009:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260408960:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065191.830037:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdc34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61344 expref: 18 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.830049:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdc34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61344 expref: 18 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065191.830075:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf6a00, rc 0) 00000100:00100000:1.0:1746065191.830117:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263213824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2731us (2901us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065191.830124:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14904 00000100:00100000:2.0:1746065191.831006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.831501:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263212928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 37185us (37937us total) trans 0 rc 950272/950272 00000100:00100000:0.0:1746065191.831509:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8406 00002000:00100000:0.0:1746065191.831517:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3244032->4194303) req@ffff88008fc5b100 x1830881263212928/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.831525:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5b100 with x1830881263212928 ext(3244032->4194303) 00002000:00010000:0.0:1746065191.831529:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fc5b100 00000100:00100000:3.0:1746065191.832231:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214080 00000100:00100000:3.0:1746065191.832237:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214080 00000100:00100000:3.0:1746065191.832269:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10040 00000100:00100000:3.0:1746065191.832274:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+266:31972:x1830881263214080:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065191.832289:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.832301:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fdc3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6134b expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.832375:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.832385:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.832393:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.832406:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.832411:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.832415:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.832492:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092774000/0x14b4f8542d4fdc50 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.832498:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092774000/0x14b4f8542d4fdc50 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.832503:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092774000/0x14b4f8542d4fdc50 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065191.832510:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065191.833587:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833595:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833600:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833604:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53ce000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065191.833607:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833612:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833622:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065191.833624:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065191.833627:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833631:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53ce000/0x14b4f8542d4fdc42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833655:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833659:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833662:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833666:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092774c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065191.833668:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833672:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833677:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fab00) 00010000:00010000:3.0:1746065191.833678:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065191.833680:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833684:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092774c00/0x14b4f8542d4fdc49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.833717:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fdc3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6134b expref: 269 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.833737:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092774000/0x14b4f8542d4fdc50 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6134b expref: 268 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.833742:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.833743:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065191.833745:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092774000, rc 0) 00000100:00100000:3.0:1746065191.833784:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:31972:x1830881263214080:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1509us (2778us total) trans 8589944304 rc 0/0 00000100:00100000:3.0:1746065191.833789:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10040 00000100:00100000:0.0:1746065191.834095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.834113:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214336 00000100:00100000:0.0:1746065191.834117:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214336 00002000:00100000:0.0:1746065191.834142:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009a4e9180 x1830881263214336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.834150:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9180 with x1830881263214336 ext(4194304->5013503) 00002000:00010000:0.0:1746065191.834153:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e9180 00000100:00100000:0.0:1746065191.834165:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8410 00000100:00100000:0.0:1746065191.834169:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263214336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065191.843992:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830881260409344:0@lo:400:kworker.0 00000100:00100000:1.0:1746065191.844045:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065191.844072:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065191.844076:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260409472:0@lo:400:kworker.0 00000100:00100000:1.0:1746065191.844096:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065191.844126:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260409472 00000100:00100000:1.0:1746065191.844132:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260409472 00000100:00080000:1.0:1746065191.844155:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065191.844180:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1746065191.844185:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881260409472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844240:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830881260409216:0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844265:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065191.844279:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830881260409728:0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844294:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065191.844307:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065191.844311:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3298:1830881260409088:0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844332:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065191.844359:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260409600:0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844374:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065191.844397:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260409344 00000100:00100000:3.0:1746065191.844399:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260409344 00000100:00100000:3.0:1746065191.844420:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260409216 00000100:00100000:3.0:1746065191.844421:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260409216 00000100:00100000:3.0:1746065191.844436:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260409728 00000100:00100000:3.0:1746065191.844437:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260409728 00000100:00100000:3.0:1746065191.844448:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1746065191.844452:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830881260409344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844484:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830881260409344:12345-0@lo:400:kworker.0 Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.844489:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1746065191.844501:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1746065191.844505:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830881260409216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844527:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830881260409216:12345-0@lo:400:kworker.0 Request processed in 22us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.844532:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1746065191.844539:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1746065191.844543:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830881260409728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844560:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830881260409728:12345-0@lo:400:kworker.0 Request processed in 17us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.844564:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1746065191.844599:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830881260409216:0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844606:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830881260409728:0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844635:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260409600 00000100:00100000:3.0:1746065191.844637:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260409600 00000100:00100000:3.0:1746065191.844653:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1746065191.844657:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830881260409600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844683:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830881260409600:12345-0@lo:400:kworker.0 Request processed in 22us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.844688:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1746065191.844703:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260409600:0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844738:0:14642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260409088 00000100:00100000:3.0:1746065191.844741:0:14642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260409088 00000100:00100000:3.0:1746065191.844754:0:14642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746065191.844757:0:14642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a593fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3298:x1830881260409088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065191.844775:0:14642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a593fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3298:x1830881260409088:12345-0@lo:400:kworker.0 Request processed in 17us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.844778:0:14642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746065191.844799:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3298:1830881260409088:0@lo:400:kworker.0 00000100:00080000:1.0:1746065191.844863:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065191.844867:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065191.844882:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830881260409344:0@lo:400:kworker.0 00000100:00100000:1.0:1746065191.844905:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881260409472:12345-0@lo:400:kworker.0 Request processed in 721us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.844910:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1746065191.844928:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260409472:0@lo:400:kworker.0 00000100:00100000:0.0:1746065191.847884:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263214336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13703us (13779us total) trans 0 rc 819200/819200 00000100:00100000:0.0:1746065191.847896:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8410 00002000:00100000:0.0:1746065191.847908:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009a4e9180 x1830881263214336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.847917:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9180 with x1830881263214336 ext(4194304->5013503) 00002000:00010000:0.0:1746065191.847922:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e9180 00000100:00100000:0.0:1746065191.849512:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.849593:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.849656:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214592 00000100:00100000:2.0:1746065191.849663:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214592 00002000:00100000:2.0:1746065191.849693:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009a4e8000 x1830881263214592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.849701:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8000 with x1830881263214592 ext(2097152->3145727) 00002000:00010000:2.0:1746065191.849705:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8000 00000100:00100000:2.0:1746065191.849741:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8411 00000100:00100000:2.0:1746065191.849747:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263214592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065191.850846:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214720 00000100:00100000:1.0:1746065191.850852:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214720 00000100:00100000:1.0:1746065191.850880:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 781 00000100:00100000:1.0:1746065191.850885:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:1958:x1830881263214720:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065191.850894:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065191.850913:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092774000/0x14b4f8542d4fdc50 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6134b expref: 268 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.850933:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065191.850936:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065191.850961:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:1958:x1830881263214720:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.850967:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 781 00000100:00100000:2.0:1746065191.860029:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746065191.860047:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260409856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065191.860104:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065191.860280:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260409856 00000100:00100000:0.0:1746065191.860286:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260409856 00000100:00100000:0.0:1746065191.860404:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1746065191.860411:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260409856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065191.860428:0:8430:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 608370688 pending 15335424 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746065191.860472:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260409856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065191.860477:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1746065191.860621:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260409856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065191.863377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.863446:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263214976 00000100:00100000:3.0:1746065191.863453:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263214976 00000100:00100000:3.0:1746065191.863487:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4316 00000100:00100000:3.0:1746065191.863493:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+267:31967:x1830881263214976:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065191.864168:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263214592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14419us (14660us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065191.864278:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8411 00002000:00100000:2.0:1746065191.864287:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009a4e8000 x1830881263214592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.864294:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e8000 with x1830881263214592 ext(2097152->3145727) 00002000:00010000:2.0:1746065191.864298:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e8000 00000100:00100000:3.0:1746065191.864394:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:31967:x1830881263214976:12345-192.168.202.46@tcp:35:cat.0 Request processed in 901us (1023us total) trans 8589944305 rc 0/0 00000100:00100000:3.0:1746065191.864400:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4316 00000100:00100000:0.0:1746065191.877342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.877425:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215104 00000100:00100000:1.0:1746065191.877433:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215104 00000100:00100000:1.0:1746065191.877478:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14905 00000100:00100000:1.0:1746065191.877485:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:31970:x1830881263215104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065191.877501:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.877516:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61352 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.877540:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.877547:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.877548:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.877552:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.877577:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 26 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.877588:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 26 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746065191.877603:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260409984:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065191.877691:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065191.881064:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260409984:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065191.881088:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.881102:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9ae00, rc 0) 00000100:00100000:1.0:1746065191.881144:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:31970:x1830881263215104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3658us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.881151:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14905 00000100:00100000:0.0:1746065191.881591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.881676:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215232 00000100:00100000:3.0:1746065191.881683:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215232 00002000:00100000:3.0:1746065191.881718:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2195455) req@ffff88009c3fb480 x1830881263215232/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.881735:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb480 with x1830881263215232 ext(2097152->2195455) 00010000:00010000:3.0:1746065191.881740:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 27 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.881751:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 27 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746065191.881756:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3fb480 00000100:00100000:3.0:1746065191.882662:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2553 00000100:00100000:3.0:1746065191.882672:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263215232:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065191.886407:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263215232:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3730us (4810us total) trans 17179873665 rc 0/0 00000100:00100000:3.0:1746065191.886417:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2553 00002000:00100000:3.0:1746065191.886426:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2195455) req@ffff88009c3fb480 x1830881263215232/t17179873665(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065191.886435:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb480 with x1830881263215232 ext(2097152->2195455) 00010000:00010000:3.0:1746065191.886444:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 29 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.886456:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 29 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746065191.886462:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3fb480 00000100:00100000:0.0:1746065191.888461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.889540:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215360 00000100:00100000:1.0:1746065191.889548:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215360 00000100:00100000:1.0:1746065191.889596:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14906 00000100:00100000:1.0:1746065191.889603:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:31972:x1830881263215360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065191.889617:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065191.889633:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61359 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.890199:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.890202:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065191.890207:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->4136959] (req 3665920->4136959) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.890217:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->4136959] (req 3665920->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065191.890231:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b9aa00, rc 0) 00000100:00100000:1.0:1746065191.890508:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31972:x1830881263215360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 904us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065191.890514:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14906 00000100:00100000:0.0:1746065191.890794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.890853:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215488 00000100:00100000:3.0:1746065191.890857:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215488 00010000:00010000:3.0:1746065191.890877:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 30 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065191.890906:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7655 00000100:00100000:3.0:1746065191.890911:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881263215488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.890921:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.890938:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 30 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.890953:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 30 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.890971:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938e9200/0x14b4f8542d4fdbcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61313 expref: 30 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.890986:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.890988:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.890993:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.890999:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.891004:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.891005:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.891008:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.891014:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.891037:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.891047:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260410112:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065191.891787:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.891801:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260410240:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065191.892119:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065191.892540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.892712:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215744 00000100:00100000:2.0:1746065191.892718:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215744 00000100:00100000:3.0:1746065191.892772:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260410112:192.168.202.46@tcp:105: 00002000:00100000:2.0:1746065191.893798:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3665920->3670015) req@ffff88009c3fa300 x1830881263215744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.893807:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830881263215744 ext(3665920->3670015) 00002000:00010000:2.0:1746065191.893847:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fa300 00000100:00100000:2.0:1746065191.893875:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8412 00000100:00100000:2.0:1746065191.893883:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263215744:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065191.894021:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263215744:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 140us (1482us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065191.894027:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8412 00002000:00100000:2.0:1746065191.894032:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3665920->3670015) req@ffff88009c3fa300 x1830881263215744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065191.894039:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830881263215744 ext(3665920->3670015) 00002000:00010000:2.0:1746065191.894041:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fa300 00000100:00100000:3.0:1746065191.898748:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260410240:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065191.898769:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.898805:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263215488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7893us (8010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.898830:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7655 00000100:00100000:0.0:1746065191.900181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.900252:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263215872 00000100:00100000:3.0:1746065191.900259:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263215872 00000100:00100000:3.0:1746065191.900292:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10041 00000100:00100000:3.0:1746065191.900299:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:31974:x1830881263215872:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065191.900320:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.900334:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdc6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61360 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.900383:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.900395:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.900403:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.900417:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.900422:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.900426:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.900517:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.900526:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 20 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.900533:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.900558:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 20 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.900567:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 20 pid: 16767 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065191.900577:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260410368:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.900652:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065191.901054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.901090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.901172:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263216128 00000100:00100000:1.0:1746065191.901177:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263216128 00002000:00100000:1.0:1746065191.901200:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009ba1c700 x1830881263216128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.901207:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c700 with x1830881263216128 ext(2097152->3145727) 00002000:00010000:1.0:1746065191.901210:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1c700 00000100:00100000:1.0:1746065191.901615:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263216384 00000100:00100000:1.0:1746065191.901619:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263216384 00002000:00100000:1.0:1746065191.901633:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba1e680 x1830881263216384/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.901640:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e680 with x1830881263216384 ext(3145728->4194303) 00002000:00010000:1.0:1746065191.901643:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1e680 00000100:00100000:1.0:1746065191.901655:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8413 00000100:00100000:1.0:1746065191.901660:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263216128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065191.901755:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8414 00000100:00100000:2.0:1746065191.901762:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263216384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.906161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.906468:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260410368:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065191.906488:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065191.907179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.907265:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263216896 00000100:00100000:1.0:1746065191.907272:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263216896 00002000:00100000:1.0:1746065191.907305:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (4132864->4136959) req@ffff88009c3faa00 x1830881263216896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.907314:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830881263216896 ext(4132864->4136959) 00002000:00010000:1.0:1746065191.907319:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:2.0:1746065191.907943:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260410496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065191.907979:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065191.908011:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260410496 00000100:00100000:1.0:1746065191.908326:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8415 00000100:00100000:1.0:1746065191.908335:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263216896:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065191.908461:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263216896:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 127us (1283us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065191.908467:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8415 00002000:00100000:1.0:1746065191.908472:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (4132864->4136959) req@ffff88009c3faa00 x1830881263216896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/4536 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.908480:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830881263216896 ext(4132864->4136959) 00002000:00010000:1.0:1746065191.908483:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:2.0:1746065191.908530:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260410496 00000100:00100000:3.0:1746065191.908533:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263216640 00000100:00100000:3.0:1746065191.908538:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263216640 00000100:00100000:2.0:1746065191.908557:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1746065191.908562:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260410496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746065191.908574:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 587792384 pending 15335424 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746065191.908810:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260410496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.908832:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1746065191.908862:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260410496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065191.908896:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4317 00000100:00100000:2.0:1746065191.908901:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:15426:x1830881263216640:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065191.909300:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:15426:x1830881263216640:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 398us (3145us total) trans 8589944306 rc 0/0 00000100:00100000:2.0:1746065191.909307:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4317 00000100:00100000:0.0:1746065191.916737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.917068:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217024 00000100:00100000:3.0:1746065191.917079:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217024 00000100:00100000:1.0:1746065191.917103:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263216128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15439us (16046us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746065191.917108:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 22 pid: 16767 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746065191.917113:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8413 00002000:00100000:1.0:1746065191.917123:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009ba1c700 x1830881263216128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.917132:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c700 with x1830881263216128 ext(2097152->3145727) 00002000:00010000:1.0:1746065191.917136:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1c700 00000100:00100000:3.0:1746065191.917140:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7656 00000100:00100000:3.0:1746065191.917146:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263217024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.917157:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.917162:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 22 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.917261:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 22 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.917279:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f43c400/0x14b4f8542d4fdbbd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6130c expref: 22 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.917293:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.917298:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.917306:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.917312:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.917341:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.917373:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263217024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 227us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.917378:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7656 00010000:00010000:2.0:1746065191.917739:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917746:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065191.917779:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065191.917782:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065191.917795:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917803:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917810:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917837:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917842:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917850:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4d0800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.917853:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917858:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917867:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065191.917869:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.917872:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917876:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0800/0x14b4f8542d4fdc73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917888:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917893:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917897:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917901:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4d1e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065191.917903:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917907:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917913:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fae00) 00010000:00010000:2.0:1746065191.917915:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065191.917917:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917922:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d1e00/0x14b4f8542d4fdc7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065191.917948:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdc6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.917958:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.917963:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.917964:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065191.917966:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d0200, rc 0) 00000100:00100000:2.0:1746065191.917998:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31974:x1830881263215872:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 17699us (17821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.918004:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10041 00000100:00100000:0.0:1746065191.927452:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263216384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25682us (26352us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065191.927463:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8414 00002000:00100000:0.0:1746065191.927474:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009ba1e680 x1830881263216384/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065191.927482:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1e680 with x1830881263216384 ext(3145728->4194303) 00002000:00010000:0.0:1746065191.927486:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1e680 00000100:00100000:1.0:1746065191.928127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.928257:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217152 00000100:00100000:0.0:1746065191.928265:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217152 00000100:00100000:0.0:1746065191.928338:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14907 00000100:00100000:0.0:1746065191.928344:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263217152:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065191.928357:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065191.928371:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61367 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.928389:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065191.928391:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065191.928399:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065191.928411:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065191.928420:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f5c400, rc 0) 00000100:00100000:0.0:1746065191.929582:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263217152:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1234us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065191.929589:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14907 00000100:00100000:1.0:1746065191.929658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.929690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.929742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.929828:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217280 00000100:00100000:2.0:1746065191.929833:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217280 00000100:00100000:2.0:1746065191.929861:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14908 00000100:00100000:2.0:1746065191.929866:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263217280:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065191.929875:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.929886:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6136e expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.929901:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.929903:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065191.929909:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.929923:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065191.929931:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a6a00, rc 0) 00000100:00100000:2.0:1746065191.929952:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263217280:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.929956:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14908 00000100:00100000:2.0:1746065191.929965:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217408 00000100:00100000:2.0:1746065191.929967:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217408 00000100:00100000:2.0:1746065191.929980:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14909 00000100:00100000:2.0:1746065191.929984:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263217408:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065191.929990:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065191.929999:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdc96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61375 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.930293:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217664 00000100:00100000:3.0:1746065191.930298:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217664 00000100:00100000:3.0:1746065191.930323:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4318 00000100:00100000:3.0:1746065191.930327:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+268:31972:x1830881263217664:12345-192.168.202.46@tcp:35:multiop.0 00000100:00080000:1.0:1746065191.930475:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065191.930541:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260410624:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065191.930592:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.930671:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:31972:x1830881263217664:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 166us (752us total) trans 8589944307 rc 0/0 00000100:00100000:3.0:1746065191.930677:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4318 00000100:00100000:2.0:1746065191.933119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.933778:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217792 00000100:00100000:3.0:1746065191.933785:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217792 00000100:00100000:3.0:1746065191.934214:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14910 00000100:00100000:3.0:1746065191.934221:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+18:31970:x1830881263217792:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065191.934234:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.934248:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6137c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.934269:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.934276:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065191.934277:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065191.934280:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.934302:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.934311:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 28 pid: 8429 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065191.934326:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260410752:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065191.934472:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.935871:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260410624:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065191.935896:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdc96 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61375 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.935907:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdc96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61375 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065191.935919:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d0600, rc 0) 00000100:00100000:3.0:1746065191.935947:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263217408:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 5961us (6255us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065191.935953:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14909 00000100:00100000:3.0:1746065191.938499:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260410752:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.938523:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.938536:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec46400, rc 0) 00000100:00100000:3.0:1746065191.938575:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:31970:x1830881263217792:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4355us (5460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.938581:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14910 00000100:00100000:0.0:1746065191.944516:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.944565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.944626:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263217920 00000100:00100000:1.0:1746065191.944634:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263217920 00002000:00100000:1.0:1746065191.944675:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3665920->4136959) req@ffff88009c3fb100 x1830881263217920/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.944686:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830881263217920 ext(3665920->4136959) 00010000:00010000:1.0:1746065191.944694:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 29 pid: 8429 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065191.944707:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 29 pid: 8429 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746065191.944713:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3fb100 00000100:00100000:1.0:1746065191.944740:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2554 00000100:00100000:1.0:1746065191.944747:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263217920:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065191.944996:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263218176 00000100:00100000:3.0:1746065191.945000:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263218176 00000100:00100000:3.0:1746065191.945025:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10042 00000100:00100000:3.0:1746065191.945030:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31974:x1830881263218176:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065191.945039:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.945052:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdca4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61383 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.945121:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.945133:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.945139:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.945162:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.945171:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 10 pid: 16767 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065191.945180:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260410880:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065191.946981:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065191.954672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.954690:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260410880:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065191.954710:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065191.954722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.954748:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263218560 00000100:00100000:3.0:1746065191.954753:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263218560 00010000:00010000:3.0:1746065191.954781:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 11 pid: 16767 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065191.954811:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7657 00000100:00100000:3.0:1746065191.954833:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263218560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.954844:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.954849:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 11 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.954857:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 11 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.954873:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d0200/0x14b4f8542d4fdc81 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61360 expref: 11 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.954886:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.954889:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.954896:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.954901:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.954912:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.954938:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263218560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 107us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.954944:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7657 00010000:00010000:3.0:1746065191.954958:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.954966:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065191.954980:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000100:00100000:0.0:1746065191.954999:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263218432 00000100:00100000:0.0:1746065191.955003:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263218432 00000100:00100000:0.0:1746065191.955034:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10043 00000100:00100000:0.0:1746065191.955040:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:31976:x1830881263218432:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065191.955055:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065191.955065:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdcb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6138a expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.955146:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955154:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955161:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955169:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955174:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955178:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065191.955201:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdca4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61383 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.955212:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61383 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.955218:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.955220:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065191.955222:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec46c00, rc 0) 00000100:00100000:3.0:1746065191.955242:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31974:x1830881263218176:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 10212us (10736us total) trans 8589944308 rc 0/0 00000100:00100000:3.0:1746065191.955248:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10042 00010000:00010000:0.0:1746065191.955248:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdcce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955254:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdcce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955260:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdcce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065191.955265:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065191.955304:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955310:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955319:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955324:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f5da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065191.955326:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955332:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955338:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065191.955340:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065191.955343:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955347:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5da00/0x14b4f8542d4fdcc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955358:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955362:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955367:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955371:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f5c600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065191.955373:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955377:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955386:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6f100) 00010000:00010000:0.0:1746065191.955388:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065191.955390:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955394:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5c600/0x14b4f8542d4fdcc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.955415:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fdcb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6138a expref: 24 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.955423:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdcce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6138a expref: 23 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.955428:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065191.955430:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065191.955431:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f5d400, rc 0) 00000100:00100000:0.0:1746065191.955450:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:31976:x1830881263218432:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 410us (787us total) trans 8589944309 rc 0/0 00000100:00100000:0.0:1746065191.955455:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10043 00000100:00100000:0.0:1746065191.958296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065191.958318:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263218816 00000100:00100000:0.0:1746065191.958323:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263218816 00000100:00100000:0.0:1746065191.958360:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10044 00000100:00100000:0.0:1746065191.958366:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31974:x1830881263218816:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065191.958382:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065191.958384:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065191.958402:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fdcab lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61383 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.958413:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065191.958416:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065191.958422:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdcdc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61391 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.958474:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958481:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958488:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958496:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958499:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958504:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958507:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f5d000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065191.958511:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958518:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958524:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065191.958526:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065191.958529:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958533:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d000/0x14b4f8542d4fdce3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065191.958551:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdcdc lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61391 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.958557:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5de00/0x14b4f8542d4fdcdc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61391 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065191.958563:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f5de00, rc 0) 00000100:00100000:0.0:1746065191.958591:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31974:x1830881263218816:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 225us (301us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065191.958597:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10044 00000100:00100000:0.0:1746065191.958634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065191.958718:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263218944 00000100:00100000:2.0:1746065191.958722:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263218944 00000100:00100000:2.0:1746065191.958757:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 782 00000100:00100000:2.0:1746065191.958761:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881263218944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065191.958768:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065191.958778:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4fdcce lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6138a expref: 23 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065191.958789:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065191.958792:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065191.958808:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881263218944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065191.958833:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 782 00000100:00100000:1.0:1746065191.959654:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881263217920:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 14905us (15085us total) trans 17179873666 rc 0/0 00000100:00100000:1.0:1746065191.959662:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2554 00002000:00100000:1.0:1746065191.959670:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3665920->4136959) req@ffff88009c3fb100 x1830881263217920/t17179873666(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:107/0 lens 488/448 e 0 to 0 dl 1746065202 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.959679:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830881263217920 ext(3665920->4136959) 00010000:00010000:1.0:1746065191.959685:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 31 pid: 8429 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065191.959696:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 31 pid: 8429 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746065191.959701:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3fb100 00000100:00100000:0.0:1746065191.961275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.961349:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263219200 00000100:00100000:3.0:1746065191.961356:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263219200 00000100:00100000:3.0:1746065191.961396:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4319 00000100:00100000:3.0:1746065191.961402:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:31974:x1830881263219200:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065191.961536:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:31974:x1830881263219200:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 134us (265us total) trans 8589944310 rc 0/0 00000100:00100000:3.0:1746065191.961541:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4319 00000100:00100000:0.0:1746065191.963151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.963213:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263219328 00000100:00100000:3.0:1746065191.963217:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263219328 00010000:00010000:3.0:1746065191.963238:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 31 pid: 8429 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065191.963262:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7658 00000100:00100000:3.0:1746065191.963268:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881263219328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065191.963277:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065191.963295:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 31 pid: 8429 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.963305:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 31 pid: 8429 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.963324:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b9aa00/0x14b4f8542d4fdc65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3665920->18446744073709551615] (req 3665920->4136959) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61359 expref: 31 pid: 8429 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065191.963335:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.963337:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065191.963342:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.963349:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.963373:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 18 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065191.963382:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260411008:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065191.963435:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065191.964624:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260411008:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065191.964638:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065191.964659:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881263219328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1390us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065191.964665:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7658 00000100:00100000:0.0:1746065191.972019:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.972083:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263219584 00000100:00100000:1.0:1746065191.972090:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263219584 00002000:00100000:1.0:1746065191.972126:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009c3f9f80 x1830881263219584/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.972136:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9f80 with x1830881263219584 ext(3145728->4194303) 00002000:00010000:1.0:1746065191.972140:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9f80 00000100:00100000:1.0:1746065191.972168:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8416 00000100:00100000:1.0:1746065191.972175:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263219584:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065191.983057:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263219584:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10873us (11036us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065191.983068:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8416 00002000:00100000:1.0:1746065191.983078:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009c3f9f80 x1830881263219584/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.983087:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9f80 with x1830881263219584 ext(3145728->4194303) 00002000:00010000:1.0:1746065191.983091:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9f80 00000100:00100000:0.0:1746065191.988582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065191.989472:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263219840 00000100:00100000:1.0:1746065191.989480:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263219840 00002000:00100000:1.0:1746065191.989515:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009c3fbb80 x1830881263219840/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/0 e 0 to 0 dl 1746065202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.989524:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830881263219840 ext(4194304->5013503) 00002000:00010000:1.0:1746065191.989528:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:1.0:1746065191.989555:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8417 00000100:00100000:1.0:1746065191.989562:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263219840:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065191.995268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065191.995515:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263220096 00000100:00100000:3.0:1746065191.995523:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263220096 00000100:00100000:3.0:1746065191.995565:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10045 00000100:00100000:3.0:1746065191.995573:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+269:31981:x1830881263220096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065191.995597:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065191.995616:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdcea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61398 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.995710:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995737:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995748:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995762:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995767:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995772:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995888:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995896:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995903:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065191.995910:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065191.995976:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995982:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995987:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.995992:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ec47200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065191.995995:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.996001:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065191.996009:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263219840:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6446us (7433us total) trans 0 rc 819200/819200 00010000:00010000:3.0:1746065191.996010:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065191.996013:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065191.996016:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065191.996020:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8417 00010000:00010000:3.0:1746065191.996021:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fdcf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00002000:00100000:1.0:1746065191.996027:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009c3fbb80 x1830881263219840/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:107/0 lens 488/440 e 0 to 0 dl 1746065202 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065191.996035:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830881263219840 ext(4194304->5013503) 00002000:00010000:1.0:1746065191.996039:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fbb80 00010000:00010000:3.0:1746065191.996047:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.996057:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.996061:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.996064:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a60a6200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065191.996067:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.996071:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.996077:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fae00) 00010000:00010000:3.0:1746065191.996079:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065191.996081:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.996086:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdcf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065191.996115:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdcea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 272 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.996125:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 271 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065191.996131:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065191.996133:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065191.996134:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a7600, rc 0) 00000100:00100000:3.0:1746065191.996155:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:31981:x1830881263220096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 583us (896us total) trans 8589944311 rc 0/0 00000100:00100000:3.0:1746065191.996161:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10045 00000100:00100000:0.0:1746065192.000898:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.000990:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263220224 00000100:00100000:3.0:1746065192.000998:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263220224 00000100:00100000:3.0:1746065192.001119:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14911 00000100:00100000:3.0:1746065192.001128:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263220224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065192.001142:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.001156:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6139f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.001174:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.001176:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.001183:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.001196:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 31 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.001205:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec47200, rc 0) 00000100:00100000:3.0:1746065192.001241:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263220224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 115us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.001247:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14911 00000100:00080000:1.0:1746065192.002113:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065192.005607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.005680:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263220480 00000100:00100000:2.0:1746065192.005688:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263220480 00000100:00100000:2.0:1746065192.005794:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4320 00000100:00100000:2.0:1746065192.005802:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094492050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:31970:x1830881263220480:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065192.007942:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094492050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:31970:x1830881263220480:12345-192.168.202.46@tcp:35:cat.0 Request processed in 2136us (2338us total) trans 8589944312 rc 0/0 00000100:00100000:2.0:1746065192.007950:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4320 00010000:00010000:2.0:1746065192.018353:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065192.018858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.018892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.018932:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263220864 00000100:00100000:2.0:1746065192.018940:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263220864 00000100:00100000:1.0:1746065192.018947:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263220736 00000100:00100000:1.0:1746065192.018951:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263220736 00002000:00100000:2.0:1746065192.018976:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800a5881f80 x1830881263220864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.018976:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff8800a5882300 x1830881263220736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.018985:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881f80 with x1830881263220864 ext(3145728->4194303) 00002000:00100000:1.0:1746065192.018985:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882300 with x1830881263220736 ext(2097152->3145727) 00002000:00010000:2.0:1746065192.018990:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5881f80 00002000:00010000:1.0:1746065192.018990:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882300 00000100:00100000:2.0:1746065192.019005:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8418 00000100:00100000:2.0:1746065192.019011:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263220864:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065192.019015:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8419 00000100:00100000:1.0:1746065192.019019:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263220736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065192.033546:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263220864:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14525us (14683us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065192.033555:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8418 00002000:00100000:2.0:1746065192.033566:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800a5881f80 x1830881263220864/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.033573:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881f80 with x1830881263220864 ext(3145728->4194303) 00002000:00010000:2.0:1746065192.033578:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5881f80 00000100:00100000:1.0:1746065192.033678:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263220736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14656us (14783us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065192.033684:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8419 00002000:00100000:1.0:1746065192.033689:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff8800a5882300 x1830881263220736/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.033696:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882300 with x1830881263220736 ext(2097152->3145727) 00002000:00010000:1.0:1746065192.033698:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5882300 00000100:00100000:0.0:1746065192.045062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.045909:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263221248 00000100:00100000:2.0:1746065192.045918:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263221248 00000100:00100000:2.0:1746065192.046111:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4321 00000100:00100000:2.0:1746065192.046118:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+271:31981:x1830881263221248:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065192.046717:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:31981:x1830881263221248:12345-192.168.202.46@tcp:35:cat.0 Request processed in 598us (1664us total) trans 8589944313 rc 0/0 00000100:00100000:2.0:1746065192.046741:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4321 00000100:00100000:0.0:1746065192.061203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.061268:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263221504 00000100:00100000:3.0:1746065192.061276:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263221504 00000100:00100000:3.0:1746065192.061328:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10046 00000100:00100000:3.0:1746065192.061336:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+272:31984:x1830881263221504:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065192.061356:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.061370:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613a6 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.061445:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.061457:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 273 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.061463:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.061487:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 273 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.061497:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 273 pid: 16767 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.061507:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260411136:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.063045:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065192.064736:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260411136:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.064756:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065192.066325:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.067040:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263221632 00000100:00100000:3.0:1746065192.067048:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263221632 00010000:00010000:3.0:1746065192.067080:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 274 pid: 16767 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.067119:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7659 00000100:00100000:3.0:1746065192.067127:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:1960:x1830881263221632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.067138:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.067144:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 274 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.067154:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 274 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.067172:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fdcff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61398 expref: 274 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.067198:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065192.067202:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.067210:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.067216:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.067241:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065192.067261:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.067267:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065192.067280:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000100:00100000:3.0:1746065192.067285:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:1960:x1830881263221632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 159us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.067291:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7659 00010000:00010000:2.0:1746065192.067393:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 274 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.067410:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 273 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.067419:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.067422:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065192.067423:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a6200, rc 0) 00000100:00100000:2.0:1746065192.067447:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:31984:x1830881263221504:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6113us (6253us total) trans 8589944314 rc 0/0 00000100:00100000:2.0:1746065192.067453:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10046 00000100:00100000:0.0:1746065192.097471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.097977:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263221760 00000100:00100000:2.0:1746065192.097986:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263221760 00000100:00100000:2.0:1746065192.098568:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14912 00000100:00100000:2.0:1746065192.098576:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:31976:x1830881263221760:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065192.098592:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.098607:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613ad expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.098632:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.098640:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 18 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.098647:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.098652:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.098653:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.098657:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1482752->2097151] (req 1482752->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.098683:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 8 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.098695:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 8 pid: 2462 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.098707:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411264:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.098807:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 18 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.098839:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 18 pid: 21998 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.098847:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411392:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.101133:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 22 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.101147:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 22 pid: 9716 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.101158:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411520:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065192.102627:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.102808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.103015:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411264:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.103136:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263221888 00000100:00100000:3.0:1746065192.103142:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263221888 00000100:00100000:2.0:1746065192.103160:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411392:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.103168:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 9 pid: 2462 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746065192.103201:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7660 00000100:00100000:3.0:1746065192.103208:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263221888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.103219:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.103237:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 9 pid: 2462 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746065192.103247:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 9 pid: 2462 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746065192.103265:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f43c200/0x14b4f8542d4fd828 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61114 expref: 9 pid: 2462 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746065192.103537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.103580:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222016 00000100:00100000:2.0:1746065192.103583:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222016 00010000:00010000:2.0:1746065192.103598:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 19 pid: 21998 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.103837:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7661 00000100:00100000:2.0:1746065192.103843:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881263222016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.103850:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.104491:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 19 pid: 21998 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746065192.104500:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 19 pid: 21998 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746065192.104513:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc82600/0x14b4f8542d4fd8a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61153 expref: 19 pid: 21998 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746065192.104929:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065192.104968:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263221888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1760us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.104975:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7660 00010000:00010000:2.0:1746065192.107799:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.107867:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881263222016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4017us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.107876:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7661 00000100:00100000:2.0:1746065192.110049:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411520:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.110083:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1482752->2097151] (req 1482752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 17 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.110105:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec46600, rc 0) 00000100:00100000:2.0:1746065192.110136:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:31976:x1830881263221760:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11561us (12674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.110143:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14912 00000100:00100000:0.0:1746065192.110811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.111003:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222144 00000100:00100000:2.0:1746065192.111009:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222144 00010000:00010000:2.0:1746065192.111183:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 23 pid: 9716 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.111218:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7662 00000100:00100000:2.0:1746065192.111227:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263222144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.111238:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.111256:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 23 pid: 9716 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746065192.111268:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 23 pid: 9716 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746065192.111290:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5562200/0x14b4f8542d4fd7c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610dc expref: 23 pid: 9716 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746065192.111302:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.111304:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.111309:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.111321:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.111346:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.111356:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260411648:192.168.202.46@tcp:105: 00000100:00080000:1.0:1746065192.111835:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065192.112421:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.114203:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260411648:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.114220:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.114256:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263222144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3031us (3445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.114266:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7662 00000100:00100000:0.0:1746065192.117241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.117861:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222400 00000100:00100000:1.0:1746065192.117872:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222400 00002000:00100000:1.0:1746065192.117912:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1482752->1486847) req@ffff8800a5883480 x1830881263222400/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.117922:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883480 with x1830881263222400 ext(1482752->1486847) 00002000:00010000:1.0:1746065192.117927:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5883480 00000100:00100000:1.0:1746065192.117955:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8420 00000100:00100000:1.0:1746065192.117962:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263222400:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065192.118107:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263222400:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 144us (872us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065192.118113:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8420 00002000:00100000:1.0:1746065192.118119:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1482752->1486847) req@ffff8800a5883480 x1830881263222400/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.118125:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883480 with x1830881263222400 ext(1482752->1486847) 00002000:00010000:1.0:1746065192.118127:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5883480 00000100:00100000:0.0:1746065192.126483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.126602:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222528 00000100:00100000:2.0:1746065192.126609:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222528 00000100:00100000:2.0:1746065192.126664:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14913 00000100:00100000:2.0:1746065192.126670:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:31976:x1830881263222528:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065192.126686:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.126701:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613b4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.126733:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.126745:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 7 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.126751:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.126756:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.126757:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.126760:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->2310143] (req 2097152->2310143) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.126781:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.126791:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 18 pid: 8851 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.126802:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411776:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.128142:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 7 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.128156:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 7 pid: 21998 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.128166:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411904:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.128494:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.128503:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 21 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065192.128511:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260412032:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065192.128538:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.138372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.138397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.138431:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222784 00000100:00100000:3.0:1746065192.138440:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222784 00010000:00010000:3.0:1746065192.138469:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 8 pid: 21998 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.138479:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411776:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065192.138489:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260411904:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065192.138496:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260412032:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.138525:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->2310143] (req 2097152->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.138539:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9200, rc 0) 00000100:00100000:2.0:1746065192.138580:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+18:31976:x1830881263222528:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11910us (12105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.138587:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14913 00000100:00100000:0.0:1746065192.138634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.138750:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222656 00000100:00100000:3.0:1746065192.138753:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222656 00000100:00100000:0.0:1746065192.138762:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263222912 00010000:00010000:3.0:1746065192.138765:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 18 pid: 8851 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746065192.138766:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263222912 00000100:00100000:3.0:1746065192.138780:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7663 00010000:00010000:0.0:1746065192.138780:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 22 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.138785:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263222784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065192.138796:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7664 00010000:00010000:3.0:1746065192.138798:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065192.138802:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881263222656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065192.138809:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065192.138840:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 18 pid: 8851 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065192.138851:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 18 pid: 8851 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065192.138868:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7e00/0x14b4f8542d4fdc2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6133d expref: 18 pid: 8851 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065192.138881:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065192.138898:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263222656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.138903:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7664 00000100:00100000:0.0:1746065192.138915:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7665 00000100:00100000:0.0:1746065192.138919:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263222912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065192.138925:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065192.138931:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 22 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.138939:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 22 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.138949:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53cf000/0x14b4f8542d4fdc03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6132f expref: 22 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.138960:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065192.138973:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263222912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.138979:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7665 00010000:00010000:3.0:1746065192.139386:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 8 pid: 21998 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746065192.139397:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 8 pid: 21998 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746065192.139408:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a6a00/0x14b4f8542d4fdc8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6136e expref: 8 pid: 21998 timeout: 891 lvb_type: 1 00010000:00010000:3.0:1746065192.139532:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.139534:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.139540:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.139548:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.139573:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065192.139584:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260412160:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065192.139648:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065192.150461:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260412160:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065192.150481:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065192.150539:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263222784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 11753us (12175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.150549:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7663 00000100:00100000:0.0:1746065192.151390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.151437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.151556:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263223168 00000100:00100000:2.0:1746065192.151562:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263223168 00002000:00100000:2.0:1746065192.151595:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2306048->2310143) req@ffff8800a5880e00 x1830881263223168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.151603:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880e00 with x1830881263223168 ext(2306048->2310143) 00002000:00010000:2.0:1746065192.151607:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880e00 00000100:00100000:2.0:1746065192.151636:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8421 00000100:00100000:2.0:1746065192.151642:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263223168:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065192.151789:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263223168:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 147us (400us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065192.151794:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8421 00002000:00100000:2.0:1746065192.151799:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2306048->2310143) req@ffff8800a5880e00 x1830881263223168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.151804:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880e00 with x1830881263223168 ext(2306048->2310143) 00002000:00010000:2.0:1746065192.151807:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880e00 00000100:00100000:3.0:1746065192.152122:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263223296 00000100:00100000:3.0:1746065192.152125:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263223296 00000100:00100000:3.0:1746065192.152148:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14914 00000100:00100000:3.0:1746065192.152152:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:31984:x1830881263223296:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065192.152159:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.152171:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613bb expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.152189:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.152195:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065192.152196:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065192.152199:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.152220:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.152229:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 16 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.152239:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260412288:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.152296:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065192.156385:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260412288:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.156414:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.156428:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4800, rc 0) 00000100:00100000:3.0:1746065192.156466:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31984:x1830881263223296:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4311us (5026us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.156473:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14914 00000100:00100000:0.0:1746065192.156907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.156980:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263223552 00000100:00100000:2.0:1746065192.156986:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263223552 00000100:00100000:2.0:1746065192.157021:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4322 00000100:00100000:2.0:1746065192.157026:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:31976:x1830881263223552:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065192.157196:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+24:31976:x1830881263223552:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 169us (289us total) trans 8589944315 rc 0/0 00000100:00100000:2.0:1746065192.157201:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4322 00000100:00100000:0.0:1746065192.162912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.163707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.163923:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263223936 00000100:00100000:2.0:1746065192.163931:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263223936 00000100:00100000:2.0:1746065192.163983:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10047 00000100:00100000:2.0:1746065192.163990:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+24:31988:x1830881263223936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065192.164006:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.164021:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fdd3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613c2 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.164110:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164120:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164129:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164141:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164145:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164149:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164232:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fdd53 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164240:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fdd53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164245:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fdd53 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065192.164250:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065192.164320:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164325:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164330:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164338:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.164340:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164345:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164354:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065192.164356:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.164359:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164363:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fdd45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164377:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164381:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164385:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164389:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.164391:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164395:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164400:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f500) 00010000:00010000:2.0:1746065192.164402:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.164404:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164408:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fdd4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.164464:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fdd3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613c2 expref: 27 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.164475:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fdd53 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613c2 expref: 26 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.164480:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.164482:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065192.164484:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8800, rc 0) 00000100:00100000:2.0:1746065192.164522:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+26:31988:x1830881263223936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 533us (1615us total) trans 8589944316 rc 0/0 00000100:00100000:2.0:1746065192.164528:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10047 00000100:00100000:3.0:1746065192.165298:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263223680 00000100:00100000:3.0:1746065192.165303:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263223680 00002000:00100000:3.0:1746065192.165331:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1482752->2097151) req@ffff8800900c0000 x1830881263223680/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.165340:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0000 with x1830881263223680 ext(1482752->2097151) 00010000:00010000:3.0:1746065192.165347:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 17 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.165357:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 17 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746065192.165363:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900c0000 00000100:00100000:3.0:1746065192.165387:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2555 00000100:00100000:3.0:1746065192.165393:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263223680:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065192.170504:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.170858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.170917:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224064 00000100:00100000:3.0:1746065192.170924:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224064 00000100:00100000:3.0:1746065192.170971:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 783 00000100:00100000:3.0:1746065192.170978:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263224064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.170993:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.171013:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d8800/0x14b4f8542d4fdd53 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613c2 expref: 26 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.171028:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065192.171032:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065192.171064:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263224064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.171070:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 783 00000100:00100000:3.0:1746065192.171087:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224192 00000100:00100000:3.0:1746065192.171089:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224192 00000100:00100000:3.0:1746065192.171105:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14915 00000100:00100000:3.0:1746065192.171109:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263224192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065192.171120:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.171131:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ed4400/0x14b4f8542d4fdd61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613c9 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065192.171167:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260412416:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065192.171213:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.183609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.183644:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224448 00000100:00100000:0.0:1746065192.183650:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224448 00000100:00100000:0.0:1746065192.183683:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10048 00000100:00100000:0.0:1746065192.183689:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+273:31992:x1830881263224448:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065192.183710:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.183733:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdd68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613d0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.183834:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.183844:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.183854:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.183864:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.183868:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.183872:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.183958:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdd7d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.183966:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdd7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.183973:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdd7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065192.183980:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065192.184048:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184054:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184060:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184066:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b5a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065192.184069:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184075:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184083:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065192.184086:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065192.184089:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184093:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fdd6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184106:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184111:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184115:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184119:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c24b800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065192.184121:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184125:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184131:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800904d0d00) 00010000:00010000:0.0:1746065192.184132:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065192.184134:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184138:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdd76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065192.184165:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdd68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613d0 expref: 276 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.184174:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdd7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613d0 expref: 275 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.184178:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065192.184180:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065192.184181:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf6a00, rc 0) 00000100:00100000:0.0:1746065192.184215:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:31992:x1830881263224448:12345-192.168.202.46@tcp:101:cat.0 Request processed in 526us (613us total) trans 8589944317 rc 0/0 00000100:00100000:0.0:1746065192.184221:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10048 00002000:00010000:0.0:1746065192.184278:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065190 -> 1746065193 00002000:00010000:0.0:1746065192.184281:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065187 -> 1746065192 00002000:00010000:0.0:1746065192.184283:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065190 -> 1746065193 00000100:00100000:0.0:1746065192.184295:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260412416:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065192.184318:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ed4400/0x14b4f8542d4fdd61 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613c9 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.184328:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4400/0x14b4f8542d4fdd61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613c9 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.184335:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4400, rc 0) 00000100:00100000:0.0:1746065192.184356:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263224192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 13245us (13498us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065192.184361:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14915 00000100:00100000:3.0:1746065192.186518:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263223680:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 21114us (22807us total) trans 21474840947 rc 0/0 00000100:00100000:3.0:1746065192.186529:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2555 00002000:00100000:3.0:1746065192.186542:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1482752->2097151) req@ffff8800900c0000 x1830881263223680/t21474840947(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/448 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.186550:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0000 with x1830881263223680 ext(1482752->2097151) 00010000:00010000:3.0:1746065192.186560:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.186572:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746065192.186578:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900c0000 00000100:00100000:2.0:1746065192.188224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.188248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.188580:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224576 00000100:00100000:0.0:1746065192.188587:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224576 00000100:00100000:3.0:1746065192.189635:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224704 00000100:00100000:3.0:1746065192.189641:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224704 00000100:00100000:3.0:1746065192.189677:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 784 00000100:00100000:3.0:1746065192.189683:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+275:1959:x1830881263224704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.189695:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.189714:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fdd7d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613d0 expref: 275 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065192.190055:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14916 00000100:00100000:0.0:1746065192.190064:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263224576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065192.190076:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.190087:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4c9b400/0x14b4f8542d4fdd8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613d7 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065192.190126:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260412544:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065192.190186:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.190287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065192.190536:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065192.190541:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065192.190562:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:1959:x1830881263224704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 879us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.190569:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 784 00000100:00100000:3.0:1746065192.190582:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224832 00000100:00100000:3.0:1746065192.190584:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224832 00010000:00010000:3.0:1746065192.190595:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.191061:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7666 00000100:00100000:3.0:1746065192.191067:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263224832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.191077:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.191092:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.191101:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.191114:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.191116:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.191122:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.191128:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.191146:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065192.191153:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260412672:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065192.191931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.191945:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263224960 00000100:00100000:0.0:1746065192.191949:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263224960 00000100:00100000:0.0:1746065192.191967:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14917 00000100:00100000:0.0:1746065192.191971:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1958:x1830881263224960:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065192.191979:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.191986:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900f8c00/0x14b4f8542d4fdd92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613de expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065192.192012:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260412800:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065192.192308:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065192.192343:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.193810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.194365:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263225088 00000100:00100000:3.0:1746065192.194371:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263225088 00000100:00100000:3.0:1746065192.194398:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14918 00000100:00100000:3.0:1746065192.194403:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:31988:x1830881263225088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065192.194415:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.194426:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613e5 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.194450:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.194455:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065192.194457:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065192.194460:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.194479:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 25 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.194488:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 25 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.194497:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260412928:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.195420:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00010000:00010000:2.0:1746065192.196057:0:21998:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88009f9cce00 x1830881260412544) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.196085:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46600/0x14b4f8542d4fdd29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ad expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065192.196106:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260412544:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065192.196134:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4c9b400/0x14b4f8542d4fdd8b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613d7 expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.196143:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4c9b400/0x14b4f8542d4fdd8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613d7 expref: 25 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065192.196149:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c9b400, rc 0) 00000100:00100000:2.0:1746065192.196171:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263224576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6109us (7951us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065192.196177:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14916 00000100:00100000:1.0:1746065192.196913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.196973:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260412672:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065192.196983:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065192.197006:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263224832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5938us (6718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.197013:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7666 00000100:00100000:2.0:1746065192.197196:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263225344 00000100:00100000:2.0:1746065192.197201:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263225344 00002000:00100000:2.0:1746065192.197230:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1683456->1687551) req@ffff88009b9fd880 x1830881263225344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.197238:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fd880 with x1830881263225344 ext(1683456->1687551) 00010000:00010000:2.0:1746065192.197244:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 24 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.197253:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 24 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065192.197258:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9fd880 00000100:00100000:2.0:1746065192.197272:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2556 00000100:00100000:2.0:1746065192.197278:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263225344:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065192.197391:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263225344:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 113us (479us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065192.197397:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2556 00002000:00100000:2.0:1746065192.197401:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x382:0x0] (1683456->1687551) req@ffff88009b9fd880 x1830881263225344/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.197407:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fd880 with x1830881263225344 ext(1683456->1687551) 00010000:00010000:2.0:1746065192.197411:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 24 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.197419:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 24 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065192.197424:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9fd880 00002000:00010000:0.0:1746065192.197629:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime: 1746065192 -> 1746065193 00002000:00010000:0.0:1746065192.197633:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065192 -> 1746065193 00002000:00010000:0.0:1746065192.197634:0:8428:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime: 1746065192 -> 1746065193 00000100:00100000:0.0:1746065192.197646:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260412800:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065192.197662:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900f8c00/0x14b4f8542d4fdd92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613de expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.197670:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900f8c00/0x14b4f8542d4fdd92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613de expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.197676:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900f8c00, rc 0) 00000100:00100000:0.0:1746065192.197708:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263224960:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5735us (5778us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065192.197713:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14917 00000100:00100000:3.0:1746065192.198546:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260412928:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.198559:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.198573:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0086e00, rc 0) 00000100:00100000:3.0:1746065192.198601:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:31988:x1830881263225088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4197us (4795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.198607:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14918 00000100:00100000:0.0:1746065192.205908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.207307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.207348:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263225600 00000100:00100000:3.0:1746065192.207357:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263225600 00000100:00100000:3.0:1746065192.207406:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14919 00000100:00100000:3.0:1746065192.207413:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:31984:x1830881263225600:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065192.207428:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.207444:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613ec expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.207469:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.207475:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065192.207477:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065192.207479:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->2211839] (req 2097152->2211839) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.207500:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.207509:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 18 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.207525:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260413056:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065192.208500:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263225728 00000100:00100000:1.0:1746065192.208505:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263225728 00002000:00100000:1.0:1746065192.208530:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1683456->2097151) req@ffff88009f9cdf80 x1830881263225728/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.208538:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdf80 with x1830881263225728 ext(1683456->2097151) 00010000:00010000:1.0:1746065192.208544:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 24 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.208556:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 24 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746065192.208561:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cdf80 00000100:00100000:1.0:1746065192.208573:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2557 00000100:00100000:1.0:1746065192.208578:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263225728:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065192.208989:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.209007:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263225856 00000100:00100000:0.0:1746065192.209010:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263225856 00000100:00100000:0.0:1746065192.209026:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14920 00000100:00100000:0.0:1746065192.209031:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:31992:x1830881263225856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065192.209037:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.209045:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613f3 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.209058:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.209061:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.209070:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 26 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.209077:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c24b800, rc 0) 00000100:00100000:0.0:1746065192.209097:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31992:x1830881263225856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 66us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.209102:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14920 00000100:00100000:3.0:1746065192.210259:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065192.215983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.216249:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260413056:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.216272:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->2211839] (req 2097152->2211839) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.216287:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0087000, rc 0) 00000100:00100000:3.0:1746065192.216318:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:31984:x1830881263225600:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8906us (10418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.216325:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14919 00000100:00100000:2.0:1746065192.216428:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263225984 00000100:00100000:2.0:1746065192.216433:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263225984 00002000:00100000:2.0:1746065192.216461:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2310143) req@ffff88009b9fd180 x1830881263225984/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.216469:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fd180 with x1830881263225984 ext(2097152->2310143) 00010000:00010000:2.0:1746065192.216474:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.216484:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065192.216489:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9fd180 00000100:00100000:2.0:1746065192.216510:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2558 00000100:00100000:2.0:1746065192.216515:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263225984:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065192.218129:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263225728:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 9546us (10823us total) trans 21474840948 rc 0/0 00000100:00100000:1.0:1746065192.218137:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2557 00002000:00100000:1.0:1746065192.218143:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1683456->2097151) req@ffff88009f9cdf80 x1830881263225728/t21474840948(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/448 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.218151:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cdf80 with x1830881263225728 ext(1683456->2097151) 00010000:00010000:1.0:1746065192.218157:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 26 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.218166:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 26 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746065192.218171:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cdf80 00000100:00100000:2.0:1746065192.220807:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263225984:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4283us (4825us total) trans 21474840949 rc 0/0 00000100:00100000:2.0:1746065192.220849:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2558 00002000:00100000:2.0:1746065192.220858:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2310143) req@ffff88009b9fd180 x1830881263225984/t21474840949(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/448 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.220866:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fd180 with x1830881263225984 ext(2097152->2310143) 00010000:00010000:2.0:1746065192.220873:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.220883:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065192.220889:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b9fd180 00000100:00100000:0.0:1746065192.222883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.223586:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226240 00000100:00100000:3.0:1746065192.223594:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226240 00010000:00010000:3.0:1746065192.223624:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065192.223973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.224218:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226112 00000100:00100000:3.0:1746065192.224222:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226112 00010000:00010000:3.0:1746065192.224236:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 26 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.224260:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7667 00000100:00100000:3.0:1746065192.224267:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263226240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.224278:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.224294:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.224303:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.224321:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fdd30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613b4 expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.224347:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.224349:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.224355:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.224362:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.224388:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065192.224398:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260413184:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065192.224454:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065192.224488:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7668 00000100:00100000:1.0:1746065192.224495:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263226112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065192.224501:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065192.224512:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 26 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.224520:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 26 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.224530:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4800/0x14b4f8542d4fdd37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613bb expref: 26 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.224550:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.224551:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.224554:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.224560:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.224565:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.224566:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.224568:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.224573:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.224586:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065192.224592:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260413312:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065192.224615:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065192.224620:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260413440:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065192.224630:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.229805:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.229943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.230012:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260413312:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065192.230021:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260413440:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065192.230039:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065192.230082:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263226112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5587us (6109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.230092:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7668 00000100:00100000:1.0:1746065192.230120:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226624 00000100:00100000:1.0:1746065192.230125:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226624 00002000:00100000:1.0:1746065192.230152:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f9cfb80 x1830881263226624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.230161:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cfb80 with x1830881263226624 ext(1048576->2097151) 00002000:00010000:1.0:1746065192.230165:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cfb80 00000100:00100000:1.0:1746065192.230176:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263226752 00000100:00100000:1.0:1746065192.230178:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263226752 00002000:00100000:1.0:1746065192.230188:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f9ce680 x1830881263226752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.230193:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce680 with x1830881263226752 ext(1048576->2097151) 00002000:00010000:1.0:1746065192.230196:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9ce680 00000100:00100000:1.0:1746065192.230206:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8422 00000100:00100000:1.0:1746065192.230211:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263226624:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065192.230336:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8423 00000100:00100000:3.0:1746065192.230344:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263226752:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065192.231441:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260413184:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.231458:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.231493:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263226240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7225us (8615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.231500:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7667 00000100:00100000:0.0:1746065192.237288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.238787:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227008 00000100:00100000:1.0:1746065192.238797:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227008 00002000:00100000:1.0:1746065192.238854:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2207744->2211839) req@ffff88009f9cce00 x1830881263227008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.238864:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cce00 with x1830881263227008 ext(2207744->2211839) 00002000:00010000:1.0:1746065192.238869:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cce00 00000100:00100000:1.0:1746065192.238897:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8424 00000100:00100000:1.0:1746065192.238904:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263227008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065192.239041:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263227008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 137us (1759us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065192.239047:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8424 00002000:00100000:1.0:1746065192.239052:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2207744->2211839) req@ffff88009f9cce00 x1830881263227008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.239057:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cce00 with x1830881263227008 ext(2207744->2211839) 00002000:00010000:1.0:1746065192.239060:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cce00 00000100:00100000:1.0:1746065192.250175:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263226624:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19960us (20374us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065192.250176:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263226752:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19825us (20225us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065192.250185:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8422 00000100:00100000:3.0:1746065192.250188:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8423 00002000:00100000:1.0:1746065192.250194:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f9cfb80 x1830881263226624/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.250195:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f9ce680 x1830881263226752/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.250202:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce680 with x1830881263226752 ext(1048576->2097151) 00002000:00100000:1.0:1746065192.250202:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cfb80 with x1830881263226624 ext(1048576->2097151) 00002000:00010000:3.0:1746065192.250207:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9ce680 00002000:00010000:1.0:1746065192.250207:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cfb80 00000100:00100000:0.0:1746065192.259741:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.259847:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227264 00000100:00100000:1.0:1746065192.259855:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227264 00002000:00100000:1.0:1746065192.259892:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2211840->3260415) req@ffff88009f2c6d80 x1830881263227264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.259901:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6d80 with x1830881263227264 ext(2211840->3260415) 00002000:00010000:1.0:1746065192.259906:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c6d80 00000100:00100000:1.0:1746065192.259937:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8425 00000100:00100000:1.0:1746065192.259944:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263227264:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065192.261887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.262704:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227520 00000100:00100000:3.0:1746065192.262712:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227520 00002000:00100000:3.0:1746065192.262752:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3260416->4194303) req@ffff88009f2c6680 x1830881263227520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.262760:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6680 with x1830881263227520 ext(3260416->4194303) 00002000:00010000:3.0:1746065192.262764:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c6680 00000100:00100000:3.0:1746065192.264448:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8426 00000100:00100000:3.0:1746065192.264457:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263227520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065192.265657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.266377:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227648 00000100:00100000:0.0:1746065192.266383:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227648 00000100:00100000:0.0:1746065192.266412:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14921 00000100:00100000:0.0:1746065192.266418:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:31988:x1830881263227648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065192.266429:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.266441:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e613fa expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.266462:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.266468:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.266470:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.266473:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.266493:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.266502:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065192.266511:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260413568:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065192.266555:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.276455:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260413568:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.276482:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.276497:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd800, rc 0) 00000100:00100000:2.0:1746065192.276549:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:31988:x1830881263227648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 10129us (10893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.276558:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14921 00000100:00100000:0.0:1746065192.279805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.281687:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227776 00000100:00100000:2.0:1746065192.281698:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227776 00002000:00100000:2.0:1746065192.281745:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2211839) req@ffff88009f2c4e00 x1830881263227776/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.281754:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4e00 with x1830881263227776 ext(2097152->2211839) 00010000:00010000:2.0:1746065192.281763:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 29 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.281775:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 29 pid: 8851 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065192.281782:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c4e00 00000100:00100000:1.0:1746065192.282512:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263227264:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22566us (22777us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065192.282521:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8425 00002000:00100000:1.0:1746065192.282527:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2211840->3260415) req@ffff88009f2c6d80 x1830881263227264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.282533:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6d80 with x1830881263227264 ext(2211840->3260415) 00010000:00010000:1.0:1746065192.282538:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.282547:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746065192.282552:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c6d80 00000100:00100000:1.0:1746065192.282568:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2559 00000100:00100000:1.0:1746065192.282574:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263227776:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065192.283145:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263227520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18689us (21262us total) trans 0 rc 933888/933888 00000100:00100000:3.0:1746065192.283152:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8426 00002000:00100000:3.0:1746065192.283157:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3260416->4194303) req@ffff88009f2c6680 x1830881263227520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.283164:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c6680 with x1830881263227520 ext(3260416->4194303) 00010000:00010000:3.0:1746065192.283168:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 27 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.283175:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 27 pid: 8851 timeout: 891 lvb_type: 0 00002000:00010000:3.0:1746065192.283180:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c6680 00000100:00100000:1.0:1746065192.287395:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263227776:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4813us (7590us total) trans 21474840950 rc 0/0 00000100:00100000:1.0:1746065192.287408:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2559 00002000:00100000:1.0:1746065192.287417:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2211839) req@ffff88009f2c4e00 x1830881263227776/t21474840950(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/448 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.287424:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4e00 with x1830881263227776 ext(2097152->2211839) 00010000:00010000:1.0:1746065192.287432:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 27 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.287443:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 27 pid: 8851 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746065192.287449:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c4e00 00000100:00100000:0.0:1746065192.288384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.288628:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263227904 00000100:00100000:2.0:1746065192.288635:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263227904 00000100:00100000:2.0:1746065192.288669:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14922 00000100:00100000:2.0:1746065192.288675:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:31992:x1830881263227904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065192.288687:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.288698:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61401 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.288716:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065192.288718:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065192.288729:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.288740:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 28 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.288750:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9200, rc 0) 00000100:00100000:2.0:1746065192.288771:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:31992:x1830881263227904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.288776:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14922 00000100:00100000:0.0:1746065192.296520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.296550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.296573:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228288 00000100:00100000:0.0:1746065192.296579:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228288 00000100:00100000:0.0:1746065192.296622:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10049 00000100:00100000:0.0:1746065192.296629:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+25:31995:x1830881263228288:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065192.296659:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.296672:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fddbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61408 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.296789:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065192.296799:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065192.296808:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065192.296918:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228032 00000100:00100000:2.0:1746065192.296922:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228032 00010000:00010000:2.0:1746065192.296944:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065192.296967:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7669 00000100:00100000:2.0:1746065192.296973:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881263228032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.296982:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.296997:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.297007:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.297022:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdda0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2211839) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613ec expref: 28 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.297038:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.297039:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.297044:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.297054:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.297060:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.297061:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.297063:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.297454:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.297479:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.297489:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260413696:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.297579:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.297586:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260413824:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065192.297602:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f240 going to sleep for 11 seconds 00010000:00010000:3.0:1746065192.297973:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.297981:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.297987:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298088:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087400/0x14b4f8542d4fddd1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298095:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087400/0x14b4f8542d4fddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298100:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087400/0x14b4f8542d4fddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065192.298107:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065192.298173:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298178:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298183:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298187:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfd600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065192.298190:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298196:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298207:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065192.298209:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065192.298212:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298215:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fddc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298226:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298230:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298234:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298237:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0086a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065192.298238:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298242:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298246:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fa700) 00010000:00010000:3.0:1746065192.298248:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065192.298250:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298253:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086a00/0x14b4f8542d4fddca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.298282:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fddbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61408 expref: 28 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.298292:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087400/0x14b4f8542d4fddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61408 expref: 27 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.298297:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065192.298299:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065192.298301:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0087400, rc 0) 00000100:00100000:3.0:1746065192.298340:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:31995:x1830881263228288:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1711us (1791us total) trans 8589944318 rc 0/0 00000100:00100000:3.0:1746065192.298347:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10049 00000100:00100000:2.0:1746065192.299494:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260413696:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065192.302044:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260413824:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.302068:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.302105:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263228032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5131us (5591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.302114:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7669 00000100:00100000:0.0:1746065192.302811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.302892:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228544 00000100:00100000:1.0:1746065192.302898:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228544 00002000:00100000:1.0:1746065192.302926:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f2c7100 x1830881263228544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.302934:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c7100 with x1830881263228544 ext(3145728->4194303) 00002000:00010000:1.0:1746065192.302938:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c7100 00000100:00100000:1.0:1746065192.302960:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8427 00000100:00100000:1.0:1746065192.302965:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263228544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065192.304678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.305461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.305503:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.305564:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228928 00000100:00100000:3.0:1746065192.305571:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228928 00002000:00100000:3.0:1746065192.305600:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f2c5880 x1830881263228928/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.305609:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5880 with x1830881263228928 ext(3145728->4194303) 00002000:00010000:3.0:1746065192.305614:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c5880 00000100:00100000:3.0:1746065192.305629:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263228800 00000100:00100000:3.0:1746065192.305631:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263228800 00002000:00100000:3.0:1746065192.305639:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009fb13800 x1830881263228800/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.305646:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13800 with x1830881263228800 ext(2097152->3145727) 00002000:00010000:3.0:1746065192.305648:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13800 00000100:00100000:3.0:1746065192.305658:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8428 00000100:00100000:3.0:1746065192.305663:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263228928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065192.306844:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8429 00000100:00100000:1.0:1746065192.306855:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263228800:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065192.307397:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229184 00000100:00100000:2.0:1746065192.307402:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229184 00000100:00100000:2.0:1746065192.307432:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 785 00000100:00100000:2.0:1746065192.307437:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263229184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.307444:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.307464:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087400/0x14b4f8542d4fddd1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61408 expref: 27 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.307481:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.307485:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.307507:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+26:1960:x1830881263229184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 70us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.307512:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 785 00000100:00100000:1.0:1746065192.311993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.312103:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229312 00000100:00100000:0.0:1746065192.312112:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229312 00000100:00100000:0.0:1746065192.313332:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14923 00000100:00100000:0.0:1746065192.313341:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+19:31995:x1830881263229312:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065192.313356:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.313373:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6140f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.313398:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.313407:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.313413:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.313420:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.313422:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.313425:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3112959] (req 2863104->3112959) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.313452:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 30 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.313463:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 30 pid: 8428 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746065192.313474:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260413952:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065192.313561:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.313570:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 20 pid: 8428 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065192.313577:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260414080:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065192.313600:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 20 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.313607:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 20 pid: 8429 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065192.313619:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260414208:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065192.313635:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065192.315655:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263228544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12683us (12839us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065192.315667:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8427 00002000:00100000:1.0:1746065192.315676:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f2c7100 x1830881263228544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.315684:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c7100 with x1830881263228544 ext(3145728->4194303) 00002000:00010000:1.0:1746065192.315688:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c7100 00000100:00100000:0.0:1746065192.322847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.322869:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260413952:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065192.322878:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260414080:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065192.322885:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260414208:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.322913:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3112959] (req 2863104->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.322927:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b5600, rc 0) 00000100:00100000:2.0:1746065192.322963:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+20:31995:x1830881263229312:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9624us (10979us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.322971:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14923 00000100:00100000:1.0:1746065192.323102:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229440 00000100:00100000:1.0:1746065192.323108:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229440 00010000:00010000:1.0:1746065192.323132:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 31 pid: 8428 timeout: 891 lvb_type: 1 00000100:00100000:1.0:1746065192.323162:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7670 00000100:00100000:1.0:1746065192.323169:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263229440:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065192.323180:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065192.323198:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 31 pid: 8428 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746065192.323207:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 31 pid: 8428 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746065192.323225:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec47200/0x14b4f8542d4fdd0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6139f expref: 31 pid: 8428 timeout: 891 lvb_type: 1 00010000:00010000:1.0:1746065192.323457:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065192.323476:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263229440:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 307us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.323484:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7670 00000100:00100000:3.0:1746065192.324068:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263228928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18403us (19393us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065192.324077:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8428 00002000:00100000:3.0:1746065192.324085:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f2c5880 x1830881263228928/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.324094:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c5880 with x1830881263228928 ext(3145728->4194303) 00002000:00010000:3.0:1746065192.324099:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f2c5880 00000100:00100000:1.0:1746065192.324504:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263228800:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17651us (18999us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065192.324509:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8429 00002000:00100000:1.0:1746065192.324515:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009fb13800 x1830881263228800/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.324521:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13800 with x1830881263228800 ext(2097152->3145727) 00002000:00010000:1.0:1746065192.324524:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13800 00000100:00100000:0.0:1746065192.329289:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.329552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.329617:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229568 00000100:00100000:2.0:1746065192.329629:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229568 00000100:00100000:0.0:1746065192.329635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065192.329662:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 20 pid: 8428 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065192.329685:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229696 00000100:00100000:2.0:1746065192.329687:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229696 00010000:00010000:2.0:1746065192.329696:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 21 pid: 8429 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.329898:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229824 00000100:00100000:3.0:1746065192.329903:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229824 00000100:00100000:3.0:1746065192.329927:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14924 00000100:00100000:3.0:1746065192.329934:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:31992:x1830881263229824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065192.329950:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.329963:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61416 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.329984:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.329986:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.329993:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.330005:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.330016:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0087a00, rc 0) 00000100:00100000:3.0:1746065192.330055:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:31992:x1830881263229824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 121us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.330061:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14924 00000100:00100000:0.0:1746065192.330351:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7671 00000100:00100000:0.0:1746065192.330358:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263229568:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065192.330365:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065192.330384:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 21 pid: 8428 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.330394:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 21 pid: 8428 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.330408:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ec46400/0x14b4f8542d4fdc9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6137c expref: 21 pid: 8428 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.330422:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065192.330438:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263229568:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.330443:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7671 00000100:00100000:0.0:1746065192.330454:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7672 00000100:00100000:0.0:1746065192.330458:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263229696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065192.330464:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065192.330470:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 19 pid: 8429 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.330477:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 19 pid: 8429 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.330486:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b9ae00/0x14b4f8542d4fdc5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61352 expref: 19 pid: 8429 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.330493:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.330494:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.330498:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.330504:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.330528:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065192.330538:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260414336:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065192.330582:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.330619:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.330760:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263229952 00000100:00100000:2.0:1746065192.330763:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263229952 00000100:00100000:2.0:1746065192.330788:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14925 00000100:00100000:2.0:1746065192.330793:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:31988:x1830881263229952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065192.330799:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.330806:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6141d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.330838:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.330845:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065192.330846:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065192.330849:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.330864:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.330878:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 20 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065192.330886:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260414464:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065192.330911:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.335563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.335618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.335646:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230208 00000100:00100000:0.0:1746065192.335653:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230208 00002000:00100000:0.0:1746065192.335687:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2863104->2867199) req@ffff88009fb11880 x1830881263230208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065192.335695:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11880 with x1830881263230208 ext(2863104->2867199) 00010000:00010000:0.0:1746065192.335702:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.335713:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746065192.335718:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb11880 00000100:00100000:0.0:1746065192.335742:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230464 00000100:00100000:0.0:1746065192.335744:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230464 00002000:00100000:0.0:1746065192.335756:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb10000 x1830881263230464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065192.335761:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10000 with x1830881263230464 ext(3145728->4194303) 00002000:00010000:0.0:1746065192.335764:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10000 00000100:00100000:0.0:1746065192.335775:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2560 00000100:00100000:0.0:1746065192.335781:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263230208:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065192.335937:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263230208:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 155us (380us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065192.335944:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2560 00002000:00100000:0.0:1746065192.335948:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2863104->2867199) req@ffff88009fb11880 x1830881263230208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065192.335955:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11880 with x1830881263230208 ext(2863104->2867199) 00010000:00010000:0.0:1746065192.335959:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065192.335968:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746065192.335972:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb11880 00000100:00100000:0.0:1746065192.335991:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8430 00000100:00100000:0.0:1746065192.335996:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263230464:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065192.336481:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260414336:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065192.336496:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065192.336522:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263229696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6063us (6970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.336529:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7672 00000100:00100000:3.0:1746065192.336632:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260414464:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.336650:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.336661:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4600, rc 0) 00000100:00100000:3.0:1746065192.336681:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:31988:x1830881263229952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5888us (6063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.336686:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14925 00000100:00100000:3.0:1746065192.340866:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.341712:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230720 00000100:00100000:1.0:1746065192.341728:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230720 00002000:00100000:1.0:1746065192.341766:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3108864->3112959) req@ffff88009bee0380 x1830881263230720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.341776:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0380 with x1830881263230720 ext(3108864->3112959) 00010000:00010000:1.0:1746065192.341785:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.341798:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746065192.341804:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bee0380 00000100:00100000:1.0:1746065192.341842:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2561 00000100:00100000:1.0:1746065192.341849:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881263230720:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065192.341957:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881263230720:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 108us (1097us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065192.341963:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2561 00002000:00100000:1.0:1746065192.341968:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3108864->3112959) req@ffff88009bee0380 x1830881263230720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.341974:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0380 with x1830881263230720 ext(3108864->3112959) 00010000:00010000:1.0:1746065192.341978:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.341987:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:1.0:1746065192.341992:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bee0380 00000100:00100000:2.0:1746065192.348115:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263230464:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12110us (12487us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065192.348125:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8430 00002000:00100000:2.0:1746065192.348135:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb10000 x1830881263230464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.348144:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10000 with x1830881263230464 ext(3145728->4194303) 00002000:00010000:2.0:1746065192.348149:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb10000 00000100:00100000:0.0:1746065192.349807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.349858:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231232 00000100:00100000:2.0:1746065192.349865:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231232 00000100:00100000:0.0:1746065192.349869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.349903:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4323 00000100:00100000:2.0:1746065192.349909:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:31995:x1830881263231232:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065192.350053:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:31995:x1830881263231232:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 143us (250us total) trans 8589944319 rc 0/0 00000100:00100000:2.0:1746065192.350059:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4323 00000100:00100000:2.0:1746065192.350092:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263230976 00000100:00100000:2.0:1746065192.350094:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263230976 00002000:00100000:2.0:1746065192.350112:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2863104->3112959) req@ffff88009fb12a00 x1830881263230976/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.350128:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12a00 with x1830881263230976 ext(2863104->3112959) 00010000:00010000:2.0:1746065192.350135:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.350147:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 19 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065192.350153:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12a00 00000100:00100000:2.0:1746065192.350168:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2562 00000100:00100000:2.0:1746065192.350172:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881263230976:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065192.357596:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263230976:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 7414us (7719us total) trans 17179873667 rc 0/0 00000100:00100000:2.0:1746065192.357607:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2562 00002000:00100000:2.0:1746065192.357618:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2863104->3112959) req@ffff88009fb12a00 x1830881263230976/t17179873667(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/448 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.357626:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12a00 with x1830881263230976 ext(2863104->3112959) 00010000:00010000:2.0:1746065192.357635:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.357648:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065192.357654:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb12a00 00000100:00100000:1.0:1746065192.357977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.358080:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231360 00000100:00100000:3.0:1746065192.358088:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231360 00000100:00100000:3.0:1746065192.358118:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14926 00000100:00100000:3.0:1746065192.358124:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263231360:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065192.358136:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.358147:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0072c00/0x14b4f8542d4fddf4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61424 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.358170:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0072c00/0x14b4f8542d4fddf4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61424 expref: 32 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.358179:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0072c00/0x14b4f8542d4fddf4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61424 expref: 32 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.358191:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0072c00, rc 0) 00000100:00100000:3.0:1746065192.358210:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263231360:12345-192.168.202.46@tcp:101:cat.0 Request processed in 86us (234us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065192.358218:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14926 00000100:00100000:0.0:1746065192.361226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.361794:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231488 00000100:00100000:1.0:1746065192.361802:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231488 00010000:00010000:1.0:1746065192.361850:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:1.0:1746065192.362310:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7673 00000100:00100000:1.0:1746065192.362317:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263231488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065192.362329:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065192.362343:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065192 -> 1746065193 00002000:00010000:1.0:1746065192.362346:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065192 -> 1746065193 00010000:00010000:1.0:1746065192.362350:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.362360:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.362377:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fdddf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3112959) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6140f expref: 21 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:1.0:1746065192.362404:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.362405:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.362411:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.362417:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.362445:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065192.362455:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260414592:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065192.362527:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.363668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.363943:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263231744 00000100:00100000:2.0:1746065192.363949:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263231744 00002000:00100000:2.0:1746065192.363978:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb13100 x1830881263231744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.363987:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13100 with x1830881263231744 ext(4194304->5013503) 00002000:00010000:2.0:1746065192.363991:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13100 00000100:00100000:2.0:1746065192.364004:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8431 00000100:00100000:2.0:1746065192.364009:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263231744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065192.368840:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260414592:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065192.368860:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065192.368920:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881263231488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6602us (7699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.368932:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7673 00000100:00100000:0.0:1746065192.374689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.374735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.374880:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232128 00000100:00100000:2.0:1746065192.374887:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232128 00002000:00100000:2.0:1746065192.374922:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb11c00 x1830881263232128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.374931:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881263232128 ext(3145728->4194303) 00002000:00010000:2.0:1746065192.374936:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00000100:00100000:2.0:1746065192.374951:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232000 00000100:00100000:2.0:1746065192.374953:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232000 00002000:00100000:2.0:1746065192.374963:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fb13b80 x1830881263232000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.374969:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881263232000 ext(2097152->3145727) 00002000:00010000:2.0:1746065192.374971:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13b80 00000100:00100000:2.0:1746065192.374981:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8432 00000100:00100000:2.0:1746065192.374987:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263232128:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065192.376346:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8433 00000100:00100000:1.0:1746065192.376356:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263232000:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065192.377201:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263231744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13189us (13534us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065192.377210:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8431 00002000:00100000:3.0:1746065192.377219:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb13100 x1830881263231744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.377227:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13100 with x1830881263231744 ext(4194304->5013503) 00002000:00010000:3.0:1746065192.377232:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb13100 00000100:00100000:0.0:1746065192.384111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.384973:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232384 00000100:00100000:1.0:1746065192.384982:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232384 00000100:00100000:1.0:1746065192.385029:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14927 00000100:00100000:1.0:1746065192.385036:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263232384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065192.385051:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065192.385066:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6142b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.385085:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.385087:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.385095:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 32 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.385109:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 32 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.385117:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4800, rc 0) 00000100:00100000:1.0:1746065192.385152:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263232384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 117us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.385158:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14927 00000100:00100000:3.0:1746065192.391274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.391386:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232640 00000100:00100000:2.0:1746065192.391395:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232640 00000100:00100000:2.0:1746065192.391641:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10050 00000100:00100000:2.0:1746065192.391648:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+274:31999:x1830881263232640:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065192.391666:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.391692:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fde02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61432 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.391787:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.391798:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.391806:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.391837:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.391842:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.391848:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.391933:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fde17 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.391941:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fde17 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.391946:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fde17 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065192.391954:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065192.392021:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392030:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392035:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392040:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfce00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.392043:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392048:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392057:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065192.392059:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.392062:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392066:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fde09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392077:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392081:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392085:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392089:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfc400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.392091:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392103:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392108:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f200) 00010000:00010000:2.0:1746065192.392110:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.392111:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392115:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fde10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.392143:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fde02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61432 expref: 277 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.392151:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fde17 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61432 expref: 276 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.392157:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.392158:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065192.392160:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd200, rc 0) 00000100:00100000:2.0:1746065192.392194:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:31999:x1830881263232640:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 546us (927us total) trans 8589944320 rc 0/0 00000100:00100000:2.0:1746065192.392200:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10050 00000100:00100000:2.0:1746065192.396483:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+22:1959:x1830881263232128:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 21485us (21791us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065192.396494:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8432 00002000:00100000:2.0:1746065192.396504:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb11c00 x1830881263232128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.396517:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881263232128 ext(3145728->4194303) 00002000:00010000:2.0:1746065192.396522:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00000100:00100000:2.0:1746065192.397702:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881263232000:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 21345us (22963us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065192.397711:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8433 00002000:00100000:2.0:1746065192.397716:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fb13b80 x1830881263232000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.397754:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13b80 with x1830881263232000 ext(2097152->3145727) 00002000:00010000:2.0:1746065192.397756:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13b80 00000100:00100000:0.0:1746065192.397935:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.398073:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263232896 00000100:00100000:2.0:1746065192.398079:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263232896 00000100:00100000:2.0:1746065192.398113:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4324 00000100:00100000:2.0:1746065192.398118:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+276:31992:x1830881263232896:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065192.399223:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:31992:x1830881263232896:12345-192.168.202.46@tcp:35:cat.0 Request processed in 1102us (1286us total) trans 8589944321 rc 0/0 00000100:00100000:2.0:1746065192.399230:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4324 00000100:00100000:1.0:1746065192.399240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.399254:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233152 00000100:00100000:2.0:1746065192.399257:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233152 00000100:00100000:2.0:1746065192.399270:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4325 00000100:00100000:2.0:1746065192.399274:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:31999:x1830881263233152:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065192.399342:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:31999:x1830881263233152:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 67us (102us total) trans 8589944322 rc 0/0 00000100:00100000:2.0:1746065192.399347:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4325 00000100:00100000:0.0:1746065192.399772:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.399994:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233280 00000100:00100000:2.0:1746065192.399997:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233280 00000100:00100000:2.0:1746065192.400028:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 786 00000100:00100000:2.0:1746065192.400032:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:1958:x1830881263233280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.400039:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.400059:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fde17 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61432 expref: 278 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.400070:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.400077:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.400100:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:1958:x1830881263233280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.400105:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 786 00000100:00100000:0.0:1746065192.426318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.426416:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233536 00000100:00100000:2.0:1746065192.426424:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233536 00002000:00100000:2.0:1746065192.426460:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb12680 x1830881263233536/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.426469:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12680 with x1830881263233536 ext(4194304->5013503) 00002000:00010000:2.0:1746065192.426474:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12680 00000100:00100000:2.0:1746065192.427310:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8434 00000100:00100000:2.0:1746065192.427322:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263233536:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065192.434375:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263233536:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7048us (8056us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065192.434385:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8434 00002000:00100000:2.0:1746065192.434396:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb12680 x1830881263233536/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.434410:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12680 with x1830881263233536 ext(4194304->5013503) 00002000:00010000:2.0:1746065192.434415:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12680 00000100:00100000:0.0:1746065192.439558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.439658:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233792 00000100:00100000:2.0:1746065192.439666:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233792 00000100:00100000:2.0:1746065192.439727:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4326 00000100:00100000:2.0:1746065192.439736:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc51c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:31988:x1830881263233792:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065192.439951:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc51c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:31988:x1830881263233792:12345-192.168.202.46@tcp:35:cat.0 Request processed in 215us (399us total) trans 8589944323 rc 0/0 00000100:00100000:2.0:1746065192.439959:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4326 00000100:00100000:0.0:1746065192.479868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.481932:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263233920 00000100:00100000:3.0:1746065192.481941:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263233920 00000100:00100000:3.0:1746065192.481991:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14928 00000100:00100000:3.0:1746065192.481999:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:31999:x1830881263233920:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065192.482014:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.482028:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61439 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.482055:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.482063:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.482068:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.482070:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.482074:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2486272->3141631] (req 2486272->3141631) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.482098:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.482108:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 33 pid: 8428 timeout: 891 lvb_type: 1 00000100:00100000:3.0:1746065192.482119:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260414720:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.482214:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.482222:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 19 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.482229:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260414848:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.482247:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065192.486201:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260414720:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.486211:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260414848:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.486236:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2486272->3141631] (req 2486272->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.486251:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073600, rc 0) 00000100:00100000:3.0:1746065192.486610:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:31999:x1830881263233920:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4610us (6747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.486619:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14928 00000100:00100000:0.0:1746065192.488449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.488639:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234048 00000100:00100000:2.0:1746065192.488645:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234048 00010000:00010000:2.0:1746065192.488673:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 33 pid: 8428 timeout: 891 lvb_type: 1 00000100:00100000:2.0:1746065192.488702:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7674 00000100:00100000:2.0:1746065192.488708:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263234048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.488726:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.488746:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 33 pid: 8428 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746065192.488755:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 33 pid: 8428 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746065192.488772:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fddfb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6142b expref: 33 pid: 8428 timeout: 891 lvb_type: 1 00010000:00010000:2.0:1746065192.489458:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.489499:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263234048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 790us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.489506:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7674 00000100:00100000:1.0:1746065192.489598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.489703:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234176 00000100:00100000:2.0:1746065192.489706:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234176 00010000:00010000:2.0:1746065192.489727:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 20 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065192.489742:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7675 00000100:00100000:2.0:1746065192.489746:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263234176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.489752:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.489760:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 20 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.489767:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 20 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.489777:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4600/0x14b4f8542d4fdded lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6141d expref: 20 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.489785:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.489786:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.489791:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.489801:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.489872:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.489882:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260414976:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065192.489987:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.493049:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260414976:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.493066:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.493099:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263234176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3351us (3500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.493108:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7675 00000100:00100000:0.0:1746065192.498637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.498751:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234432 00000100:00100000:2.0:1746065192.498758:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234432 00002000:00100000:2.0:1746065192.498793:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3137536->3141631) req@ffff88009fb11500 x1830881263234432/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.498802:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881263234432 ext(3137536->3141631) 00002000:00010000:2.0:1746065192.498807:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11500 00000100:00100000:2.0:1746065192.498848:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8435 00000100:00100000:2.0:1746065192.498856:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881263234432:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065192.499703:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881263234432:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 845us (1071us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065192.499714:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8435 00002000:00100000:2.0:1746065192.499727:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3137536->3141631) req@ffff88009fb11500 x1830881263234432/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.499734:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881263234432 ext(3137536->3141631) 00002000:00010000:2.0:1746065192.499737:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11500 00000100:00100000:0.0:1746065192.592906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.593068:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234688 00000100:00100000:1.0:1746065192.593076:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234688 00000100:00100000:1.0:1746065192.593130:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10051 00000100:00100000:1.0:1746065192.593139:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:32004:x1830881263234688:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065192.593159:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065192.593174:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x14b4f8542d4fde2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61440 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.593264:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593274:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593283:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593293:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593297:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593312:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593399:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f400/0x14b4f8542d4fde41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593405:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f400/0x14b4f8542d4fde41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593411:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f400/0x14b4f8542d4fde41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065192.593421:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065192.593486:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593491:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593495:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593499:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129c6ec00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065192.593502:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593507:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593516:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065192.593518:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065192.593521:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593526:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ec00/0x14b4f8542d4fde33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593539:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593544:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593547:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593554:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129c6f200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065192.593556:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593560:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593565:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094ec8200) 00010000:00010000:1.0:1746065192.593566:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065192.593568:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593571:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f200/0x14b4f8542d4fde3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.593602:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ee00/0x14b4f8542d4fde2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61440 expref: 31 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.593612:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f400/0x14b4f8542d4fde41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61440 expref: 30 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.593617:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065192.593618:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065192.593620:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c6f400, rc 0) 00000100:00100000:1.0:1746065192.593672:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:32004:x1830881263234688:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 534us (772us total) trans 8589944324 rc 0/0 00000100:00100000:1.0:1746065192.593677:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10051 00000100:00100000:0.0:1746065192.598964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.599039:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234816 00000100:00100000:3.0:1746065192.599048:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234816 00000100:00100000:3.0:1746065192.599453:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14929 00000100:00100000:3.0:1746065192.599462:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:32004:x1830881263234816:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065192.599477:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.599491:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61447 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.599517:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.599523:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065192.599525:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065192.599528:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3280896->3387391] (req 3280896->3387391) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.599553:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 31 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.599564:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 31 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.599576:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260415104:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.599658:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.604514:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.604699:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260415104:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.604737:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3280896->3387391] (req 3280896->3387391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.604753:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073c00, rc 0) 00000100:00100000:3.0:1746065192.604886:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:32004:x1830881263234816:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5424us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.604894:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14929 00000100:00100000:0.0:1746065192.604961:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263234944 00000100:00100000:0.0:1746065192.604967:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263234944 00000100:00100000:0.0:1746065192.605005:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 787 00000100:00100000:0.0:1746065192.605011:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263234944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065192.605021:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065192.605041:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6f400/0x14b4f8542d4fde41 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61440 expref: 30 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.605058:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065192.605061:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065192.605079:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881263234944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.605084:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 787 00000100:00100000:0.0:1746065192.609018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.609940:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263235072 00000100:00100000:2.0:1746065192.609949:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263235072 00010000:00010000:2.0:1746065192.609977:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 32 pid: 21998 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065192.610000:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7676 00000100:00100000:2.0:1746065192.610007:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881263235072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.610020:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.610038:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 32 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.610049:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 32 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.610068:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0087a00/0x14b4f8542d4fdde6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61416 expref: 32 pid: 21998 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.610593:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.610596:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.610605:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.610613:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.610640:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.610649:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260415232:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065192.611009:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a556fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.613100:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260415232:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.613120:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.613165:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263235072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3157us (4153us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.613174:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7676 00000100:00100000:0.0:1746065192.613966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.614221:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263235328 00000100:00100000:2.0:1746065192.614226:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263235328 00002000:00100000:2.0:1746065192.614253:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3280896->3284991) req@ffff88009fb11f80 x1830881263235328/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.614261:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11f80 with x1830881263235328 ext(3280896->3284991) 00002000:00010000:2.0:1746065192.614265:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11f80 00000100:00100000:2.0:1746065192.614286:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8436 00000100:00100000:2.0:1746065192.614292:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263235328:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065192.614421:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263235328:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 129us (456us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065192.614426:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8436 00002000:00100000:2.0:1746065192.614430:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3280896->3284991) req@ffff88009fb11f80 x1830881263235328/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.614436:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11f80 with x1830881263235328 ext(3280896->3284991) 00002000:00010000:2.0:1746065192.614438:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11f80 00000100:00100000:0.0:1746065192.617476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.617530:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263235584 00000100:00100000:2.0:1746065192.617537:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263235584 00002000:00100000:2.0:1746065192.617564:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3383296->3387391) req@ffff88012bd3c700 x1830881263235584/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.617573:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c700 with x1830881263235584 ext(3383296->3387391) 00002000:00010000:2.0:1746065192.617577:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3c700 00000100:00100000:2.0:1746065192.617988:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8437 00000100:00100000:2.0:1746065192.617997:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263235584:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065192.618134:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263235584:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 138us (663us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065192.618140:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8437 00002000:00100000:2.0:1746065192.618146:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3383296->3387391) req@ffff88012bd3c700 x1830881263235584/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.618152:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c700 with x1830881263235584 ext(3383296->3387391) 00002000:00010000:2.0:1746065192.618155:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3c700 00000100:00100000:0.0:1746065192.621775:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.621914:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263235840 00000100:00100000:2.0:1746065192.621922:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263235840 00000100:00100000:2.0:1746065192.621958:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4327 00000100:00100000:2.0:1746065192.621965:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+29:32004:x1830881263235840:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065192.622155:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+30:32004:x1830881263235840:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 190us (386us total) trans 8589944325 rc 0/0 00000100:00100000:2.0:1746065192.622161:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4327 00000100:00100000:0.0:1746065192.648973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.649132:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236096 00000100:00100000:1.0:1746065192.649139:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236096 00000100:00100000:1.0:1746065192.652136:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10052 00000100:00100000:1.0:1746065192.652151:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+277:32008:x1830881263236096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065192.652172:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065192.652188:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fc00/0x14b4f8542d4fde56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6144e expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.652281:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652291:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652301:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652312:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652317:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652322:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652411:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e800/0x14b4f8542d4fde6b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652424:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e800/0x14b4f8542d4fde6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652429:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e800/0x14b4f8542d4fde6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065192.652436:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065192.652504:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652511:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652516:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652521:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129c6fe00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065192.652524:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652529:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652537:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065192.652540:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065192.652543:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.652547:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fe00/0x14b4f8542d4fde5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.654336:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.654348:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.654353:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.654358:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129c6ea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065192.654360:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.654367:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.654378:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012cf56b00) 00010000:00010000:1.0:1746065192.654381:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065192.654383:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.654388:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6ea00/0x14b4f8542d4fde64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.654436:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6fc00/0x14b4f8542d4fde56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6144e expref: 280 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.654446:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e800/0x14b4f8542d4fde6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6144e expref: 279 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.654451:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065192.654453:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065192.654455:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c6e800, rc 0) 00000100:00100000:1.0:1746065192.654525:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:32008:x1830881263236096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2378us (5557us total) trans 8589944326 rc 0/0 00000100:00100000:1.0:1746065192.654533:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10052 00000100:00100000:0.0:1746065192.657619:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.657664:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.657781:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236224 00000100:00100000:3.0:1746065192.657789:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236224 00000100:00100000:3.0:1746065192.657856:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14930 00000100:00100000:3.0:1746065192.657862:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263236224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065192.657877:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.657891:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fde79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61455 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065192.657935:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260415360:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065192.658001:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.658389:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236352 00000100:00100000:2.0:1746065192.658393:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236352 00000100:00100000:2.0:1746065192.658416:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 788 00000100:00100000:2.0:1746065192.658420:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:1960:x1830881263236352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.658428:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.658443:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c6e800/0x14b4f8542d4fde6b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6144e expref: 279 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.658457:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.658460:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.658481:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:1960:x1830881263236352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.658487:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 788 00002000:00010000:3.0:1746065192.661006:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065192 -> 1746065193 00000100:00100000:3.0:1746065192.661029:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260415360:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065192.661054:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fde79 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61455 expref: 32 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.661065:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fde79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61455 expref: 32 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.661088:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073a00, rc 0) 00000100:00100000:3.0:1746065192.661122:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263236224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3258us (3509us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065192.661128:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14930 00000100:00100000:1.0:1746065192.669066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.669467:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236608 00000100:00100000:2.0:1746065192.669475:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236608 00000100:00100000:2.0:1746065192.669523:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10053 00000100:00100000:2.0:1746065192.669530:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:32011:x1830881263236608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065192.669551:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.669565:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4fde80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6145c expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.669653:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669666:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669675:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669685:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669689:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669694:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669789:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fde95 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669797:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fde95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669803:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fde95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065192.669809:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065192.669891:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669897:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669902:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669911:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfc000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.669914:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669919:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669928:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065192.669931:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.669934:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669939:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fde87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669964:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669969:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669973:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669977:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfd600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.669979:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669983:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.669988:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49ff00) 00010000:00010000:2.0:1746065192.669990:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.669993:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.670001:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fde8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.670030:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc600/0x14b4f8542d4fde80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6145c expref: 33 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.670040:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fde95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6145c expref: 32 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.670046:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.670047:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065192.670049:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfda00, rc 0) 00000100:00100000:2.0:1746065192.670087:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:32011:x1830881263236608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 558us (1030us total) trans 8589944327 rc 0/0 00000100:00100000:2.0:1746065192.670092:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10053 00000100:00100000:0.0:1746065192.672349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.672429:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236736 00000100:00100000:3.0:1746065192.672436:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236736 00000100:00100000:3.0:1746065192.672480:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14931 00000100:00100000:3.0:1746065192.672486:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263236736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065192.672501:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.672513:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0073400/0x14b4f8542d4fdea3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61463 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065192.672557:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260415488:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065192.672626:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.673679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.674570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.674652:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237120 00000100:00100000:3.0:1746065192.674660:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237120 00002000:00100000:3.0:1746065192.674699:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012bd3df80 x1830881263237120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.674707:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3df80 with x1830881263237120 ext(2097152->3145727) 00002000:00010000:3.0:1746065192.674711:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3df80 00000100:00100000:3.0:1746065192.674738:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8438 00000100:00100000:3.0:1746065192.674745:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263237120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065192.675127:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263236864 00000100:00100000:2.0:1746065192.675132:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263236864 00000100:00100000:2.0:1746065192.675158:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 789 00000100:00100000:2.0:1746065192.675163:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263236864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.675171:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.675191:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fde95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6145c expref: 32 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.675205:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.675208:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.675260:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263236864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.675267:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 789 00000100:00100000:3.0:1746065192.677936:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260415488:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065192.677965:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073400/0x14b4f8542d4fdea3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61463 expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.677982:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073400/0x14b4f8542d4fdea3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61463 expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065192.678875:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073400, rc 0) 00000100:00100000:3.0:1746065192.678918:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:1960:x1830881263236736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6430us (6574us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065192.678926:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14931 00000100:00100000:0.0:1746065192.695560:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.695628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.695660:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237376 00000100:00100000:0.0:1746065192.695665:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237376 00000100:00100000:0.0:1746065192.695701:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14932 00000100:00100000:0.0:1746065192.695708:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+20:32011:x1830881263237376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065192.695734:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.695749:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61471 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.695774:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.695781:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.695782:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.695785:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.695807:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 30 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.695845:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 30 pid: 8851 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065192.695854:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260415616:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065192.696987:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065192.697055:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237248 00000100:00100000:3.0:1746065192.697061:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237248 00000100:00100000:3.0:1746065192.697089:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10054 00000100:00100000:3.0:1746065192.697094:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32012:x1830881263237248:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065192.697108:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.697119:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073a00/0x14b4f8542d4fdeb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6146a expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.697164:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.697173:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.697182:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.697191:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.697196:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.697201:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.697294:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.697303:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 277 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.697309:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.697326:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 277 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.697335:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 277 pid: 16767 timeout: 891 lvb_type: 0 00000100:00100000:3.0:1746065192.697344:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260415744:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.697364:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.698055:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263237120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23307us (23483us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065192.698064:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8438 00002000:00100000:2.0:1746065192.698072:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012bd3df80 x1830881263237120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.698080:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3df80 with x1830881263237120 ext(2097152->3145727) 00002000:00010000:2.0:1746065192.698085:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3df80 00000100:00100000:0.0:1746065192.703001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.703044:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260415744:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.703064:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065192.703067:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237760 00000100:00100000:1.0:1746065192.703072:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237760 00000100:00100000:1.0:1746065192.703112:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4328 00000100:00100000:1.0:1746065192.703118:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:27031:x1830881263237760:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065192.703683:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.703803:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:27031:x1830881263237760:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 684us (809us total) trans 8589944328 rc 0/0 00000100:00100000:1.0:1746065192.703810:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4328 00000100:00100000:2.0:1746065192.703890:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260415616:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065192.703909:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.703922:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4800, rc 0) 00000100:00100000:2.0:1746065192.703944:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:32011:x1830881263237376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8237us (8316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.703950:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14932 00000100:00100000:3.0:1746065192.704167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.705168:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237504 00000100:00100000:2.0:1746065192.705175:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237504 00002000:00100000:2.0:1746065192.705205:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2486272->3141631) req@ffff88008ec2f100 x1830881263237504/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.705214:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f100 with x1830881263237504 ext(2486272->3141631) 00010000:00010000:2.0:1746065192.705221:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 31 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.705236:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 31 pid: 8851 timeout: 891 lvb_type: 0 00002000:00010000:2.0:1746065192.705242:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec2f100 00000100:00100000:2.0:1746065192.705258:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2563 00000100:00100000:2.0:1746065192.705264:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263237504:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065192.706546:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263237888 00000100:00100000:0.0:1746065192.706553:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263237888 00000100:00100000:3.0:1746065192.707746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.707791:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238016 00000100:00100000:2.0:1746065192.707797:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238016 00010000:00010000:2.0:1746065192.707838:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 279 pid: 16767 timeout: 891 lvb_type: 0 00000100:00100000:2.0:1746065192.707860:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7677 00000100:00100000:2.0:1746065192.707867:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:1961:x1830881263238016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.707876:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.707881:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 279 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.707895:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 279 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.707914:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6200/0x14b4f8542d4fdd1b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613a6 expref: 279 pid: 16767 timeout: 891 lvb_type: 0 00010000:00010000:2.0:1746065192.708393:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.708397:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.708406:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.708411:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065192.708427:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.708456:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:1961:x1830881263238016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 589us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.708462:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7677 00010000:00010000:3.0:1746065192.709184:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709193:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065192.709228:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065192.709232:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065192.709245:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709254:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709261:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709265:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709270:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709274:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0073800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065192.709276:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709281:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709290:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065192.709293:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065192.709295:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709299:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073800/0x14b4f8542d4fdeb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709318:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709324:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709328:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709331:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0072000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065192.709333:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709336:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709342:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fa900) 00010000:00010000:3.0:1746065192.709343:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065192.709345:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709348:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fdebf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.709377:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073a00/0x14b4f8542d4fdeb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.709386:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.709392:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065192.709394:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065192.709395:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0072200, rc 0) 00000100:00100000:3.0:1746065192.709426:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:32012:x1830881263237248:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 12331us (13873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.709432:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10054 00000100:00100000:1.0:1746065192.711503:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14933 00000100:00100000:1.0:1746065192.711517:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:32008:x1830881263237888:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065192.711531:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065192.711546:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61478 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.711568:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065192.711572:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.711581:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.711588:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c6fa00, rc 0) 00000100:00100000:1.0:1746065192.711647:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32008:x1830881263237888:12345-192.168.202.46@tcp:101:cat.0 Request processed in 134us (7480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.711652:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14933 00000100:00100000:0.0:1746065192.715038:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.715056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.715091:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.715119:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238144 00000100:00100000:0.0:1746065192.715126:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238144 00000100:00100000:0.0:1746065192.715152:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238272 00000100:00100000:0.0:1746065192.715154:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238272 00000100:00100000:0.0:1746065192.715162:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238400 00000100:00100000:0.0:1746065192.715164:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238400 00000100:00100000:0.0:1746065192.715176:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14934 00000100:00100000:0.0:1746065192.715182:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263238144:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065192.715197:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.715211:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6147f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.715227:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.715229:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.715237:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.715251:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.715260:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4115600, rc 0) 00000100:00100000:0.0:1746065192.715292:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263238144:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 109us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.715298:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14934 00000100:00100000:0.0:1746065192.715313:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14935 00000100:00100000:0.0:1746065192.715317:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263238272:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065192.715322:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.715327:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61486 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.715340:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.715341:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.715345:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.715352:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.715357:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4114400, rc 0) 00000100:00100000:0.0:1746065192.715368:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263238272:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 51us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.715372:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14935 00000100:00100000:0.0:1746065192.715379:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14936 00000100:00100000:0.0:1746065192.715382:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263238400:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065192.715387:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.715394:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944b6400/0x14b4f8542d4fdee2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6148d expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065192.715421:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260415872:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065192.715463:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065192.717365:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263237504:12345-192.168.202.46@tcp:4:cat.0 Request processed in 12094us (13676us total) trans 17179873668 rc 0/0 00000100:00100000:3.0:1746065192.717374:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2563 00002000:00100000:3.0:1746065192.717381:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2486272->3141631) req@ffff88008ec2f100 x1830881263237504/t17179873668(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/448 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.717390:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f100 with x1830881263237504 ext(2486272->3141631) 00010000:00010000:3.0:1746065192.717397:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 34 pid: 8851 timeout: 891 lvb_type: 0 00010000:00010000:3.0:1746065192.717408:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 34 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746065192.717414:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec2f100 00000100:00100000:2.0:1746065192.719553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.719574:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238528 00000100:00100000:2.0:1746065192.719580:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238528 00010000:00010000:2.0:1746065192.719605:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 34 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065192.719625:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7678 00000100:00100000:2.0:1746065192.719631:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263238528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.719641:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.719658:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 34 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065192.719668:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 34 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065192.719687:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073600/0x14b4f8542d4fde25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [2486272->3145727] (req 2486272->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61439 expref: 34 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065192.719703:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.719705:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.719710:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.719727:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.719734:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.719735:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.719739:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.719744:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.719771:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.719782:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260416000:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.719866:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.719874:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260416128:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065192.719888:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.720279:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260415872:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065192.720300:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944b6400/0x14b4f8542d4fdee2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6148d expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.720314:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944b6400/0x14b4f8542d4fdee2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6148d expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065192.720324:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944b6400, rc 0) 00000100:00100000:0.0:1746065192.720348:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263238400:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 4964us (5256us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065192.720355:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14936 00000100:00100000:0.0:1746065192.723782:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260416000:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065192.723796:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260416128:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065192.724436:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065192.724804:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881263238528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5169us (5253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.724830:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7678 00000100:00100000:0.0:1746065192.726192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.726272:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263238784 00000100:00100000:3.0:1746065192.726280:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263238784 00000100:00100000:3.0:1746065192.726315:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10055 00000100:00100000:3.0:1746065192.726321:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:32012:x1830881263238784:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065192.726337:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065192.726351:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072e00/0x14b4f8542d4fdee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61494 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065192.726779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.726811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.726899:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239040 00000100:00100000:2.0:1746065192.726903:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239040 00002000:00100000:2.0:1746065192.726928:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008ec2ea00 x1830881263239040/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.726936:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ea00 with x1830881263239040 ext(2097152->3145727) 00002000:00010000:2.0:1746065192.726940:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2ea00 00000100:00100000:2.0:1746065192.726955:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239296 00000100:00100000:2.0:1746065192.726957:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239296 00002000:00100000:2.0:1746065192.726969:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008ec2c000 x1830881263239296/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.726975:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c000 with x1830881263239296 ext(2097152->3145727) 00002000:00010000:2.0:1746065192.726978:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2c000 00000100:00100000:2.0:1746065192.726993:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8439 00000100:00100000:2.0:1746065192.726998:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263239040:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065192.727036:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8440 00000100:00100000:1.0:1746065192.727042:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881263239296:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:3.0:1746065192.727880:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.727895:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.727903:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.727928:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.727937:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 12 pid: 16767 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065192.727947:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260416256:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065192.728007:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.736048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.736150:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260416256:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065192.736169:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:1.0:1746065192.736259:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239424 00000100:00100000:1.0:1746065192.736264:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239424 00010000:00010000:1.0:1746065192.736290:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 13 pid: 16767 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065192.738327:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7679 00000100:00100000:1.0:1746065192.738338:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263239424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065192.738351:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065192.738356:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 13 pid: 16767 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065192.738367:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 13 pid: 16767 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065192.738383:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fdec6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6146a expref: 13 pid: 16767 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065192.738425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.738446:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239680 00000100:00100000:2.0:1746065192.738450:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239680 00010000:00010000:1.0:1746065192.739210:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065192.739216:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065192.739225:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065192.739230:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065192.739451:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10056 00000100:00100000:2.0:1746065192.739459:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+278:32014:x1830881263239680:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065192.739474:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.739485:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fdef7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6149b expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.739565:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.739573:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.739584:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.739592:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.739597:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.739602:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065192.739958:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065192.739999:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065192.740005:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065192.740016:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065192.740101:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072e00/0x14b4f8542d4fdee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61494 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.740116:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61494 expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.740122:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065192.740124:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065192.740127:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073000, rc 0) 00010000:00010000:2.0:1746065192.740176:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fdf13 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740184:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fdf13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740189:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fdf13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065192.740195:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065192.740236:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740242:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740247:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740252:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfca00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.740255:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740261:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740268:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065192.740270:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.740272:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740276:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdefe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740286:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740291:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740295:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740298:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfcc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.740300:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740304:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740308:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f500) 00010000:00010000:2.0:1746065192.740310:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.740311:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740315:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.740337:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fdef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6149b expref: 281 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.740344:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fdf13 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6149b expref: 280 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.740349:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.740350:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065192.740352:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfdc00, rc 0) 00000100:00100000:1.0:1746065192.741937:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263239424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3597us (5891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.741949:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7679 00000100:00100000:3.0:1746065192.742005:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:32012:x1830881263238784:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 15684us (15818us total) trans 8589944329 rc 0/0 00000100:00100000:2.0:1746065192.742005:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:32014:x1830881263239680:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2547us (3580us total) trans 8589944330 rc 0/0 00000100:00100000:3.0:1746065192.742011:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10055 00000100:00100000:2.0:1746065192.742013:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10056 00000100:00100000:0.0:1746065192.742071:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263239040:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15071us (15290us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065192.742078:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8439 00002000:00100000:0.0:1746065192.742087:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008ec2ea00 x1830881263239040/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065192.742096:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ea00 with x1830881263239040 ext(2097152->3145727) 00002000:00010000:0.0:1746065192.742100:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2ea00 00000100:00100000:1.0:1746065192.742603:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881263239296:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15560us (15790us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065192.742609:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8440 00002000:00100000:1.0:1746065192.742614:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008ec2c000 x1830881263239296/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.742620:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c000 with x1830881263239296 ext(2097152->3145727) 00002000:00010000:1.0:1746065192.742623:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2c000 00000100:00100000:1.0:1746065192.756300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.756411:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239808 00000100:00100000:2.0:1746065192.756419:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239808 00000100:00100000:2.0:1746065192.756460:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 790 00000100:00100000:2.0:1746065192.756467:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:1960:x1830881263239808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.756478:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.756498:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fdf13 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6149b expref: 280 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.756514:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.756518:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.756554:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:1960:x1830881263239808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.756559:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 790 00000100:00100000:0.0:1746065192.756808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.756840:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263239936 00000100:00100000:0.0:1746065192.756844:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263239936 00000100:00100000:0.0:1746065192.756863:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14937 00000100:00100000:0.0:1746065192.756868:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+21:32011:x1830881263239936:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065192.756880:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065192.756891:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614a2 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.756912:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.756917:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.756919:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065192.756921:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.756944:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.756954:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065192.756964:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260416384:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065192.757010:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.759990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.762891:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260416384:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065192.762925:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.762947:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d0600, rc 0) 00000100:00100000:0.0:1746065192.763013:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:32011:x1830881263239936:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6143us (6205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.763021:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14937 00000100:00100000:2.0:1746065192.763103:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263240192 00000100:00100000:2.0:1746065192.763109:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263240192 00000100:00100000:2.0:1746065192.763149:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10057 00000100:00100000:2.0:1746065192.763154:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:32012:x1830881263240192:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065192.763172:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.763175:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065192.763197:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073000/0x14b4f8542d4fdef0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61494 expref: 12 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.763211:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.763214:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065192.763223:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf28 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614a9 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.763297:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763306:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763314:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763323:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763328:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763333:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763338:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfda00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.763673:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763681:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763689:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.763691:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065192.763694:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763698:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf2f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.763731:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf28 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a9 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.763736:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf28 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a9 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.763743:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc800, rc 0) 00000100:00100000:2.0:1746065192.765323:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:32012:x1830881263240192:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2160us (5331us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065192.765332:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10057 00000100:00100000:0.0:1746065192.765412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.766493:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263240448 00000100:00100000:1.0:1746065192.766502:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263240448 00002000:00100000:1.0:1746065192.766535:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3280896->3387391) req@ffff88008ec2d180 x1830881263240448/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.766543:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2d180 with x1830881263240448 ext(3280896->3387391) 00010000:00010000:1.0:1746065192.766551:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065192.766564:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065192.766570:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec2d180 00000100:00100000:1.0:1746065192.766638:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2564 00000100:00100000:1.0:1746065192.766645:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263240448:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065192.768200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.768348:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263240320 00000100:00100000:2.0:1746065192.768356:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263240320 00000100:00100000:2.0:1746065192.768418:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14938 00000100:00100000:2.0:1746065192.768427:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:32008:x1830881263240320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065192.768444:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.768461:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614b0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.768485:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065192.768491:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.768502:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 34 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.768512:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd600, rc 0) 00000100:00100000:2.0:1746065192.768554:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32008:x1830881263240320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 127us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.768561:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14938 00000100:00100000:2.0:1746065192.775288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.775617:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263240960 00000100:00100000:1.0:1746065192.775629:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263240960 00000100:00100000:1.0:1746065192.775697:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4329 00000100:00100000:1.0:1746065192.775704:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:32012:x1830881263240960:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065192.775996:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:32012:x1830881263240960:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 289us (716us total) trans 8589944331 rc 0/0 00000100:00100000:1.0:1746065192.776003:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4329 00000100:00100000:0.0:1746065192.777124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.778264:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263240704 00000100:00100000:2.0:1746065192.778273:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263240704 00000100:00100000:2.0:1746065192.779314:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10058 00000100:00100000:2.0:1746065192.779324:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:32016:x1830881263240704:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065192.779344:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.779360:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fdf3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614b7 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.779438:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779449:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779459:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779470:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779475:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779479:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779552:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779559:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779564:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065192.779571:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065192.779625:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779630:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779770:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779776:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfc800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.779779:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779785:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779795:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065192.779797:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.779800:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.779804:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc800/0x14b4f8542d4fdf44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065192.780280:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263240448:12345-192.168.202.46@tcp:4:cat.0 Request processed in 13633us (14867us total) trans 17179873669 rc 0/0 00000100:00100000:1.0:1746065192.780288:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2564 00002000:00100000:1.0:1746065192.780296:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3280896->3387391) req@ffff88008ec2d180 x1830881263240448/t17179873669(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/448 e 0 to 0 dl 1746065203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.780304:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2d180 with x1830881263240448 ext(3280896->3387391) 00010000:00010000:1.0:1746065192.780311:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 24 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065192.780323:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 24 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065192.780329:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec2d180 00010000:00010000:2.0:1746065192.780419:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.780424:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.780429:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.780433:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfda00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.780435:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.780440:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.780447:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fa00) 00010000:00010000:2.0:1746065192.780449:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.780451:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.780454:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfda00/0x14b4f8542d4fdf4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.780487:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc000/0x14b4f8542d4fdf3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 34 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.780497:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 33 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.780502:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.780504:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065192.780506:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfde00, rc 0) 00000100:00100000:2.0:1746065192.780675:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+33:32016:x1830881263240704:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1352us (3554us total) trans 8589944332 rc 0/0 00000100:00100000:2.0:1746065192.780681:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10058 00000100:00100000:2.0:1746065192.788896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.789833:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263241088 00000100:00100000:0.0:1746065192.789842:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263241088 00010000:00010000:0.0:1746065192.789874:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 24 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065192.789907:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7680 00000100:00100000:0.0:1746065192.789913:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881263241088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065192.789924:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065192.789940:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 24 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065192.789949:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 24 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065192.789967:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073c00/0x14b4f8542d4fde4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [3280896->18446744073709551615] (req 3280896->3387391) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61447 expref: 24 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065192.790906:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.790909:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.790916:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.790924:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.790932:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.790933:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065192.790935:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065192.790941:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.791008:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 33 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065192.791019:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260416512:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065192.791102:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065192.791114:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260416640:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065192.791133:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065192.797439:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260416512:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065192.797450:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260416640:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065192.797467:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065192.798884:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263241088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8965us (16205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.798895:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7680 00000100:00100000:0.0:1746065192.801341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.801389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.801704:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263241344 00000100:00100000:2.0:1746065192.801713:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263241344 00002000:00100000:2.0:1746065192.801767:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45fb80 x1830881263241344/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.801776:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45fb80 with x1830881263241344 ext(3145728->4194303) 00002000:00010000:2.0:1746065192.801781:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45fb80 00000100:00100000:2.0:1746065192.801858:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263241600 00000100:00100000:2.0:1746065192.801863:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263241600 00002000:00100000:2.0:1746065192.801881:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45e680 x1830881263241600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.801888:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e680 with x1830881263241600 ext(3145728->4194303) 00002000:00010000:2.0:1746065192.801891:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45e680 00000100:00100000:2.0:1746065192.801910:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8441 00000100:00100000:2.0:1746065192.801918:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263241344:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065192.803388:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8442 00000100:00100000:2.0:1746065192.803401:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263241600:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065192.825001:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263241344:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23076us (23658us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065192.825012:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8441 00002000:00100000:2.0:1746065192.825023:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45fb80 x1830881263241344/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.825031:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45fb80 with x1830881263241344 ext(3145728->4194303) 00002000:00010000:2.0:1746065192.825036:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45fb80 00000100:00100000:2.0:1746065192.837805:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263241600:12345-192.168.202.46@tcp:3:cat.0 Request processed in 34397us (36404us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065192.837828:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8442 00002000:00100000:2.0:1746065192.837840:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45e680 x1830881263241600/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/440 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.837849:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45e680 with x1830881263241600 ext(3145728->4194303) 00002000:00010000:2.0:1746065192.837854:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45e680 00000100:00100000:0.0:1746065192.838667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.838808:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263241856 00000100:00100000:3.0:1746065192.838829:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263241856 00000100:00100000:3.0:1746065192.838872:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4330 00000100:00100000:3.0:1746065192.838879:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+33:32011:x1830881263241856:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065192.839056:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:32011:x1830881263241856:12345-192.168.202.46@tcp:35:cat.0 Request processed in 178us (390us total) trans 8589944333 rc 0/0 00000100:00100000:3.0:1746065192.839062:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4330 00000100:00100000:0.0:1746065192.847071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.847160:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242112 00000100:00100000:1.0:1746065192.847169:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242112 00000100:00100000:1.0:1746065192.847958:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4331 00000100:00100000:1.0:1746065192.847966:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+279:32008:x1830881263242112:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065192.848164:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:32008:x1830881263242112:12345-192.168.202.46@tcp:35:cat.0 Request processed in 196us (1096us total) trans 8589944334 rc 0/0 00000100:00100000:1.0:1746065192.848171:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4331 00000100:00100000:0.0:1746065192.883319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.883429:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242240 00000100:00100000:1.0:1746065192.883438:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242240 00000100:00100000:1.0:1746065192.884168:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14939 00000100:00100000:1.0:1746065192.884176:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+21:32016:x1830881263242240:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065192.884191:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065192.884205:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614be expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.884232:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 26 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.884240:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.884247:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.884253:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.884254:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.884257:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [249856->884735] (req 249856->884735) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.884281:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 8 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.884291:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 8 pid: 2463 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746065192.884301:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260416768:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065192.885322:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.885331:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 22 pid: 21998 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746065192.885345:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260416896:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065192.886545:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 26 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.886554:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 26 pid: 2462 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746065192.886563:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260417024:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065192.887076:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.890530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.890671:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260416768:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065192.890741:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242368 00000100:00100000:2.0:1746065192.890747:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242368 00010000:00010000:2.0:1746065192.890774:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 9 pid: 2463 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746065192.890795:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7681 00000100:00100000:2.0:1746065192.890800:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263242368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.890811:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.890846:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 9 pid: 2463 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.890855:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 9 pid: 2463 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.890873:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc82e00/0x14b4f8542d4fd836 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ff expref: 9 pid: 2463 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.890899:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.892800:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263242368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1992us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.892810:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7681 00000100:00100000:1.0:1746065192.893191:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260416896:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065192.893199:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260417024:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065192.893223:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [249856->884735] (req 249856->884735) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.893236:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092770600, rc 0) 00000100:00100000:1.0:1746065192.893258:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:32016:x1830881263242240:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9084us (9948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.893263:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14939 00000100:00100000:0.0:1746065192.893774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.893850:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242624 00000100:00100000:2.0:1746065192.893855:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242624 00010000:00010000:2.0:1746065192.893873:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 27 pid: 2462 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746065192.893890:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7682 00000100:00100000:2.0:1746065192.893894:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263242624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.893902:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.893917:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 27 pid: 2462 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.893925:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 27 pid: 2462 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.893943:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c66200/0x14b4f8542d4fd7cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610c7 expref: 27 pid: 2462 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.893952:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.893978:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263242624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.893983:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7682 00000100:00100000:0.0:1746065192.894752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.894942:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242496 00000100:00100000:2.0:1746065192.894946:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242496 00010000:00010000:2.0:1746065192.894961:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 22 pid: 21998 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746065192.894977:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7683 00000100:00100000:2.0:1746065192.894982:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263242496:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.894989:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.895074:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 22 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.895084:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 22 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.895097:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc82400/0x14b4f8542d4fd8b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6113e expref: 22 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:2.0:1746065192.895109:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.895111:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.895117:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.895124:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.895150:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.895161:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260417152:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065192.895441:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.897063:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260417152:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.897075:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.897099:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263242496:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2116us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.897106:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7683 00000100:00100000:0.0:1746065192.897337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.897438:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263242880 00000100:00100000:3.0:1746065192.897443:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263242880 00002000:00100000:3.0:1746065192.897473:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x380:0x0] (249856->253951) req@ffff88012b45ed80 x1830881263242880/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.897481:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ed80 with x1830881263242880 ext(249856->253951) 00002000:00010000:3.0:1746065192.897485:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ed80 00000100:00100000:3.0:1746065192.897499:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8443 00000100:00100000:3.0:1746065192.897504:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263242880:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065192.897634:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263242880:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 129us (297us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065192.897640:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8443 00002000:00100000:3.0:1746065192.897644:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x380:0x0] (249856->253951) req@ffff88012b45ed80 x1830881263242880/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065192.897656:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ed80 with x1830881263242880 ext(249856->253951) 00002000:00010000:3.0:1746065192.897659:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ed80 00000100:00100000:0.0:1746065192.913524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.913643:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243008 00000100:00100000:1.0:1746065192.913652:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243008 00000100:00100000:1.0:1746065192.913693:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14940 00000100:00100000:1.0:1746065192.913700:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:32014:x1830881263243008:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065192.913745:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065192.913759:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614c5 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.913786:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.913794:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 7 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.913802:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.913807:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.913809:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.913812:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.913867:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.913878:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 27 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065192.913889:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260417280:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065192.913958:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 7 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065192.913972:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 7 pid: 21998 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746065192.913980:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260417408:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065192.913998:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.914727:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 20 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065192.914738:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260417536:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065192.914759:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065192.917902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.917962:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.917996:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065192.918015:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243392 00000100:00100000:3.0:1746065192.918018:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243520 00000100:00100000:0.0:1746065192.918021:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243392 00000100:00100000:3.0:1746065192.918023:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243520 00010000:00010000:3.0:1746065192.918051:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 28 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065192.918075:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7684 00000100:00100000:3.0:1746065192.918082:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881263243520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.918092:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.918110:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 28 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065192.918121:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 28 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065192.918142:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065192.918173:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881263243520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.918179:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7684 00000100:00100000:2.0:1746065192.918189:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243264 00000100:00100000:2.0:1746065192.918197:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243264 00002000:00100000:2.0:1746065192.918220:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (880640->884735) req@ffff88012b45ce00 x1830881263243264/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.918228:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ce00 with x1830881263243264 ext(880640->884735) 00002000:00010000:2.0:1746065192.918232:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ce00 00000100:00100000:2.0:1746065192.918244:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8444 00000100:00100000:2.0:1746065192.918249:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263243264:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065192.918373:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263243264:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 124us (477us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065192.918378:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8444 00002000:00100000:2.0:1746065192.918383:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (880640->884735) req@ffff88012b45ce00 x1830881263243264/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065192.918388:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ce00 with x1830881263243264 ext(880640->884735) 00002000:00010000:2.0:1746065192.918391:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ce00 00010000:00010000:1.0:1746065192.918622:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fddb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61401 expref: 28 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065192.918638:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260417280:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065192.918658:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260417408:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065192.918732:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 8 pid: 21998 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065192.918754:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7685 00000100:00100000:0.0:1746065192.918760:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263243392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065192.918766:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065192.918774:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 8 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065192.918782:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 8 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065192.918793:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4114400/0x14b4f8542d4fdedb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61486 expref: 8 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065192.918804:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065192.918836:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263243392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065192.918841:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7685 00000100:00100000:1.0:1746065192.920090:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260417536:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065192.920117:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.920127:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092771600, rc 0) 00000100:00100000:1.0:1746065192.920152:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:32014:x1830881263243008:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6452us (6636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.920160:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14940 00000100:00100000:0.0:1746065192.920619:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.920778:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243776 00000100:00100000:1.0:1746065192.920783:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243776 00000100:00100000:1.0:1746065192.921166:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4332 00000100:00100000:1.0:1746065192.921173:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b558850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:32016:x1830881263243776:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065192.921325:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b558850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+35:32016:x1830881263243776:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 152us (706us total) trans 8589944335 rc 0/0 00000100:00100000:1.0:1746065192.921331:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4332 00000100:00100000:0.0:1746065192.928907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.929002:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263243904 00000100:00100000:2.0:1746065192.929010:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263243904 00010000:00010000:2.0:1746065192.929041:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065192.929164:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7686 00000100:00100000:2.0:1746065192.929172:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263243904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065192.929184:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065192.929203:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065192.929214:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065192.929234:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fddae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613fa expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065192.929262:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.929264:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065192.929269:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.929280:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.929308:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065192.929320:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260417664:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065192.929503:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065192.930969:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260417664:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065192.930988:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065192.931031:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263243904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1860us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.931038:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7686 00000100:00100000:0.0:1746065192.933875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.933944:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263244032 00000100:00100000:1.0:1746065192.933950:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263244032 00000100:00100000:1.0:1746065192.934051:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14941 00000100:00100000:1.0:1746065192.934058:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32014:x1830881263244032:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065192.934073:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065192.934087:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614cc expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.934110:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.934117:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 35 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.934123:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.934124:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065192.934127:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->3743743] (req 3145728->3743743) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.934155:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 35 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.934165:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 35 pid: 21998 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065192.934175:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260417792:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065192.934598:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.934606:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 22 pid: 21998 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065192.934613:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260417920:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065192.934633:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065192.937758:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260417792:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065192.937769:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260417920:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065192.937794:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [3145728->3743743] (req 3145728->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065192.937808:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092771800, rc 0) 00000100:00100000:1.0:1746065192.937864:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:32014:x1830881263244032:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3805us (3994us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065192.937875:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14941 00000100:00100000:0.0:1746065192.938177:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.938287:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263244160 00000100:00100000:3.0:1746065192.938386:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263244160 00010000:00010000:3.0:1746065192.938408:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 35 pid: 21998 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065192.938425:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7687 00000100:00100000:3.0:1746065192.938431:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263244160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.938439:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.938456:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 35 pid: 21998 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065192.938464:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 35 pid: 21998 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065192.938482:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b0 expref: 35 pid: 21998 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065192.938681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065192.938844:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065192.938871:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263244160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 439us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.938876:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7687 00000100:00100000:3.0:1746065192.938886:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263244288 00000100:00100000:3.0:1746065192.938889:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263244288 00010000:00010000:3.0:1746065192.938897:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 23 pid: 21998 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065192.938911:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7688 00000100:00100000:3.0:1746065192.938915:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263244288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065192.938920:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065192.938927:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 23 pid: 21998 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065192.938939:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 23 pid: 21998 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065192.938951:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d0600/0x14b4f8542d4fdf21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614a2 expref: 23 pid: 21998 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065192.938960:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.938961:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065192.938967:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.938975:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065192.939000:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065192.939011:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260418048:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065192.939067:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065192.943627:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260418048:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065192.943646:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065192.943697:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263244288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4780us (5016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065192.943707:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7688 00000100:00100000:0.0:1746065192.951626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065192.952316:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263244544 00000100:00100000:1.0:1746065192.952325:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263244544 00002000:00100000:1.0:1746065192.952365:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3739648->3743743) req@ffff880130446300 x1830881263244544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/0 e 0 to 0 dl 1746065203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.952374:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446300 with x1830881263244544 ext(3739648->3743743) 00002000:00010000:1.0:1746065192.952378:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130446300 00000100:00100000:1.0:1746065192.953048:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8445 00000100:00100000:1.0:1746065192.953057:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263244544:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065192.953205:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263244544:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 150us (1590us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065192.953211:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8445 00002000:00100000:1.0:1746065192.953216:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x389:0x0] (3739648->3743743) req@ffff880130446300 x1830881263244544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:108/0 lens 488/4536 e 0 to 0 dl 1746065203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065192.953223:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130446300 with x1830881263244544 ext(3739648->3743743) 00002000:00010000:1.0:1746065192.953225:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130446300 00000100:00100000:0.0:1746065192.957619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065192.957680:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263244800 00000100:00100000:3.0:1746065192.957689:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263244800 00000100:00100000:3.0:1746065192.957746:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4333 00000100:00100000:3.0:1746065192.957753:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+280:32014:x1830881263244800:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065192.957963:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+281:32014:x1830881263244800:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 209us (350us total) trans 8589944336 rc 0/0 00000100:00100000:3.0:1746065192.957969:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4333 00000100:00100000:0.0:1746065192.994680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065192.995895:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263244928 00000100:00100000:2.0:1746065192.995904:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263244928 00000100:00100000:2.0:1746065192.995966:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10059 00000100:00100000:2.0:1746065192.995975:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:32022:x1830881263244928:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065192.996001:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065192.996017:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614d3 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.996073:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996085:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996094:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996105:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996111:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996116:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996220:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996228:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996234:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065192.996632:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065192.996637:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065192.996654:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996663:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996669:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996674:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996682:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996688:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfca00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.996691:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996696:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996704:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065192.996707:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.996710:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996722:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdf7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996961:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996966:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996971:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996975:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfc400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065192.996977:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.996981:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.997230:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fe00) 00010000:00010000:2.0:1746065192.997232:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065192.997234:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.997238:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdf83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065192.997268:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fdf75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.997278:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 13 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065192.997283:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065192.997285:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065192.997287:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfce00, rc 0) 00000100:00100000:2.0:1746065192.998145:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:32022:x1830881263244928:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2168us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065192.998152:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10059 00000100:00100000:0.0:1746065193.006038:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.006065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.006103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.006130:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245056 00000100:00100000:0.0:1746065193.006139:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245056 00000100:00100000:0.0:1746065193.006181:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245184 00000100:00100000:0.0:1746065193.006183:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245184 00000100:00100000:0.0:1746065193.006193:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245312 00000100:00100000:0.0:1746065193.006195:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245312 00000100:00100000:0.0:1746065193.006211:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14942 00000100:00100000:0.0:1746065193.006218:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263245056:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065193.006236:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.006252:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0086c00/0x14b4f8542d4fdf91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614da expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.006297:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260418176:192.168.202.46@tcp:106: 00000100:00080000:1.0:1746065193.006424:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065193.006427:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065193.006683:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14943 00000100:00100000:1.0:1746065193.006691:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14944 00000100:00100000:2.0:1746065193.006693:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263245184:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065193.006699:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263245312:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065193.006700:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065193.006707:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.006708:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614e1 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.006729:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092770e00/0x14b4f8542d4fdf9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614e8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065193.006747:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260418304:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065193.006760:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260418432:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065193.007018:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.007018:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.007031:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.008591:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260418432:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065193.008615:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092770e00/0x14b4f8542d4fdf9f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614e8 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.008625:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092770e00/0x14b4f8542d4fdf9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614e8 expref: 9 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.008658:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092770e00, rc 0) 00000100:00100000:0.0:1746065193.008701:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263245312:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2003us (2596us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065193.008723:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14944 00002000:00010000:2.0:1746065193.008867:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime: 1746065189 -> 1746065193 00002000:00010000:2.0:1746065193.008871:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime: 1746065189 -> 1746065193 00002000:00010000:2.0:1746065193.008873:0:8428:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime: 1746065189 -> 1746065193 00000100:00100000:2.0:1746065193.008884:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260418176:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065193.008899:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0086c00/0x14b4f8542d4fdf91 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614da expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.008907:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0086c00/0x14b4f8542d4fdf91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614da expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.008919:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0086c00, rc 0) 00000100:00100000:2.0:1746065193.008939:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263245056:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2722us (2913us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065193.008945:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14942 00000100:00100000:3.0:1746065193.009026:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260418304:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065193.009044:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf98 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614e1 expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.009052:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fdf98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614e1 expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.009064:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd600, rc 0) 00000100:00100000:3.0:1746065193.009081:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263245184:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2391us (3015us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065193.009087:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14943 00000100:00100000:0.0:1746065193.012918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.013041:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245568 00000100:00100000:2.0:1746065193.013050:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245568 00000100:00100000:2.0:1746065193.013111:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10060 00000100:00100000:2.0:1746065193.013119:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:32022:x1830881263245568:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065193.013132:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.013146:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdfa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614ef expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.013222:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065193.013236:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 34 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.013243:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.013248:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065193.013274:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.013284:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 14 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.013295:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260418560:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.013365:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 34 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.013372:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 34 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.013377:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260418688:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.013390:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746065193.013845:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065193.016021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.016044:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245696 00000100:00100000:3.0:1746065193.016050:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245696 00010000:00010000:3.0:1746065193.016078:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 15 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.016100:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7689 00000100:00100000:3.0:1746065193.016107:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881263245696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.016119:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.016124:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 15 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.016134:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 15 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.016153:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065193.016157:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065193.016164:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065193.016170:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.016201:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881263245696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 94us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.016207:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7689 00010000:00010000:2.0:1746065193.016490:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfce00/0x14b4f8542d4fdf8a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614d3 expref: 14 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.016502:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260418560:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.016511:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260418688:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.016529:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065193.017437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.017502:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263245824 00000100:00100000:1.0:1746065193.017507:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263245824 00010000:00010000:1.0:1746065193.017604:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 35 pid: 14644 timeout: 892 lvb_type: 0 00000100:00080000:0.0:1746065193.017673:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065193.017756:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7690 00000100:00100000:1.0:1746065193.017763:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+35:1961:x1830881263245824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.017773:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065193.017779:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 35 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.017788:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 35 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.017802:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fdf52 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614b7 expref: 35 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.018075:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.018079:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.018088:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.018094:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.018112:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.018140:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263245824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 377us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.018146:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7690 00010000:00010000:2.0:1746065193.018287:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065193.018293:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065193.018311:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065193.018427:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fdfa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614ef expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.018440:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614ef expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.018445:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.018447:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065193.018449:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd800, rc 0) 00000100:00100000:2.0:1746065193.018472:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:32022:x1830881263245568:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 5355us (5564us total) trans 8589944337 rc 0/0 00000100:00100000:2.0:1746065193.018478:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10060 00010000:00010000:0.0:1746065193.021380:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065193.021578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.022088:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246080 00000100:00100000:0.0:1746065193.022096:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246080 00000100:00100000:0.0:1746065193.022143:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10061 00000100:00100000:0.0:1746065193.022151:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:32022:x1830881263246080:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065193.022172:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.022175:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065193.022199:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fdfad lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614ef expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.022222:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065193.022226:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065193.022236:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086c00/0x14b4f8542d4fdfbb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614f6 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.022310:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.022322:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.022330:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065193.022341:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065193.022437:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086c00/0x14b4f8542d4fdfbb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.022450:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.022455:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065193.022458:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065193.022460:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0087000, rc 0) 00000100:00100000:0.0:1746065193.022502:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:32022:x1830881263246080:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 352us (930us total) trans 8589944338 rc 0/0 00000100:00100000:0.0:1746065193.022508:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10061 00000100:00100000:0.0:1746065193.024505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.026313:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246208 00000100:00100000:2.0:1746065193.026324:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246208 00000100:00100000:2.0:1746065193.026374:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10062 00000100:00100000:2.0:1746065193.026381:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:32022:x1830881263246208:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065193.026401:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.026417:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd000/0x14b4f8542d4fdfd0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e614fd expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.026466:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd000/0x14b4f8542d4fdfd0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614fd expref: 16 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.026479:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd000/0x14b4f8542d4fdfd0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614fd expref: 16 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.026496:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.026499:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065193.026502:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd000, rc 0) 00000100:00100000:2.0:1746065193.027636:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:32022:x1830881263246208:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 1252us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.027644:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10062 00000100:00100000:0.0:1746065193.036154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.036581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.037879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.038114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.038146:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246336 00000100:00100000:3.0:1746065193.038155:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246336 00000100:00100000:3.0:1746065193.038194:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246464 00000100:00100000:3.0:1746065193.038196:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246464 00000100:00100000:3.0:1746065193.038207:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246592 00000100:00100000:3.0:1746065193.038208:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246592 00000100:00100000:3.0:1746065193.038220:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14945 00000100:00100000:3.0:1746065193.038226:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263246336:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065193.038263:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.038283:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.038290:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065193.038292:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065193.038295:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.038321:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.038331:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 19 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.038343:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260418816:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.038397:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.038543:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246720 00000100:00100000:0.0:1746065193.038546:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246720 00000100:00100000:0.0:1746065193.038561:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14946 00000100:00100000:0.0:1746065193.038566:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263246464:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065193.038582:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.038590:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 33 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.038597:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.038608:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.038612:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.038613:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.038615:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.038627:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.038633:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 9 pid: 9716 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.038640:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094090380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260418944:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.038664:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.038671:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 21 pid: 21998 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.038677:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094092680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260419072:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.039053:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14947 00000100:00100000:2.0:1746065193.039061:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263246592:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065193.039077:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.039087:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 33 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.039093:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.039099:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.039110:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.039111:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.039113:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.039125:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 21 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.039131:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 21 pid: 8429 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.039138:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260419200:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.039160:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.039166:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 9 pid: 8429 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746065193.039172:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260419328:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.039185:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 33 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.039191:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 33 pid: 8429 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.039201:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260419456:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.039210:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.039511:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14948 00000100:00100000:3.0:1746065193.039517:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263246720:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065193.039533:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.039542:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.039548:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 8 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.039559:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.039563:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.039564:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.039566:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 6/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.039580:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 25 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.039587:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 25 pid: 8428 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.039594:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260419584:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065193.039850:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.039884:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.039893:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246848 00000100:00100000:1.0:1746065193.039896:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246848 00000100:00100000:1.0:1746065193.039907:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263246976 00000100:00100000:1.0:1746065193.039909:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263246976 00000100:00100000:1.0:1746065193.039918:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14949 00000100:00100000:1.0:1746065193.039922:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263246848:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065193.039935:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.039943:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.039947:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065193.039948:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065193.039950:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.039961:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.039967:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 25 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065193.039974:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260419712:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065193.039998:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14950 00000100:00100000:1.0:1746065193.040002:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263246976:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065193.040013:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.040020:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.040026:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.040032:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.040036:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746065193.040037:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:1.0:1746065193.040038:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 6/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.040049:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.040055:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065193.040066:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260419840:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.040697:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.040706:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 9 pid: 21998 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746065193.040723:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260419968:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.041627:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 19 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.041641:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 19 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.041649:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260420096:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.042397:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065193.042447:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d600 going to sleep for 11 seconds 00010000:00010000:2.0:1746065193.042492:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.042501:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.042510:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260420224:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.042565:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 33 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.042573:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 33 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.042580:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260420352:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.042593:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065193.042839:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 33 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065193.042847:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 33 pid: 9716 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746065193.042854:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260420480:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065193.042887:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.054472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.054548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.054570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.054591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.054611:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247104 00000100:00100000:0.0:1746065193.054618:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247104 00010000:00010000:0.0:1746065193.054647:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 11 pid: 9716 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.054671:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247488 00000100:00100000:0.0:1746065193.054673:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247488 00010000:00010000:0.0:1746065193.054682:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 12 pid: 8429 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.054696:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7691 00000100:00100000:0.0:1746065193.054702:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1959:x1830881263247104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.054725:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.054744:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 12 pid: 9716 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.054754:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 12 pid: 9716 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.054776:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.054830:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1959:x1830881263247104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 110us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.054837:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7691 00000100:00100000:0.0:1746065193.054855:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7692 00000100:00100000:0.0:1746065193.054860:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263247488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.054872:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.054882:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 11 pid: 8429 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.054889:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 11 pid: 8429 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.054899:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.054913:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263247488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.054918:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7692 00000100:00100000:0.0:1746065193.054946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.054979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.055033:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247360 00000100:00100000:0.0:1746065193.055036:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247360 00010000:00010000:0.0:1746065193.055054:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 22 pid: 8429 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.055067:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247616 00000100:00100000:0.0:1746065193.055068:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247616 00010000:00010000:0.0:1746065193.055076:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 34 pid: 8429 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.055087:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7693 00000100:00100000:0.0:1746065193.055091:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881263247360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.055097:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.055105:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 22 pid: 8429 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.055116:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 22 pid: 8429 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.055125:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.055142:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881263247360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.055147:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7693 00000100:00100000:0.0:1746065193.055157:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7694 00000100:00100000:0.0:1746065193.055162:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263247616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.055168:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.055175:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 34 pid: 8429 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.055183:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 34 pid: 8429 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.055193:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.055195:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.055199:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055206:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055220:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.055233:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263247616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.055238:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7694 00000100:00080000:0.0:1746065193.055253:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746065193.055330:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4fda35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61233 expref: 21 pid: 8429 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.055345:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260419200:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.055354:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5c400/0x14b4f8542d4fdc88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61367 expref: 10 pid: 8429 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.055361:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260419328:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.055367:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fda2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6122c expref: 33 pid: 8429 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.055373:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260419456:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.055391:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055399:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055404:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055422:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055433:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055439:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055444:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfc400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065193.055447:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055453:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055462:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.055467:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fdfe5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.055510:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263246592:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 16450us (17633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.055517:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14947 00000100:00100000:0.0:1746065193.055548:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247232 00000100:00100000:0.0:1746065193.055552:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247232 00002000:00100000:0.0:1746065193.055580:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (249856->884735) req@ffff880094090700 x1830881263247232/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.055593:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090700 with x1830881263247232 ext(249856->884735) 00010000:00010000:0.0:1746065193.055599:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 20 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.055607:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 20 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746065193.055613:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094090700 00000100:00100000:0.0:1746065193.055624:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2565 00000100:00100000:0.0:1746065193.055629:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263247232:12345-192.168.202.46@tcp:4:multiop.0 00010000:00010000:1.0:1746065193.055864:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a59b8c00/0x14b4f8542d4fd821 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61106 expref: 8 pid: 9716 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746065193.055878:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094090380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260418944:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.056006:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260418816:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.056018:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.056035:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263247872 00000100:00100000:3.0:1746065193.056038:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263247872 00000100:00100000:3.0:1746065193.056061:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10063 00000100:00100000:3.0:1746065193.056066:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:32024:x1830881263247872:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065193.056079:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.056089:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fe001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61504 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.056172:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065193.056182:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065193.056189:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065193.056199:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065193.056205:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065193.056209:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065193.056289:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065193.056298:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.056304:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065193.056326:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.056335:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 15 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.056346:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260420608:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.056399:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b63d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.056419:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260419584:192.168.202.46@tcp:104: 00000100:00080000:3.0:1746065193.056458:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065193.060036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.060058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.060160:0:21482:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248128 00000100:00100000:1.0:1746065193.060168:0:21482:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248128 00002000:00100000:1.0:1746065193.060205:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3883008->4194303) req@ffff88012bd3c000 x1830881263248128/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.060214:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c000 with x1830881263248128 ext(3883008->4194303) 00010000:00010000:1.0:1746065193.060222:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 26 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.060232:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 26 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.060241:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bd3c000 00000100:00100000:1.0:1746065193.060261:0:21482:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2566 00000100:00100000:1.0:1746065193.060268:0:21482:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263248128:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065193.060540:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094092680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260419072:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.061195:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260419840:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.061204:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260420224:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.061209:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260420352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.061232:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.061252:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260419968:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.061258:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260420096:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.061272:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.061301:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248000 00000100:00100000:3.0:1746065193.061304:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248000 00010000:00010000:3.0:1746065193.061318:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 28 pid: 8428 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.061332:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7695 00000100:00100000:3.0:1746065193.061337:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881263248000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.061344:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.061357:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 28 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.061365:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 28 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.061381:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c24b800/0x14b4f8542d4fdda7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613f3 expref: 28 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.061394:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.061410:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263248000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.061415:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7695 00000100:00100000:0.0:1746065193.061747:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260419712:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.061758:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.061856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.061868:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248256 00000100:00100000:0.0:1746065193.061871:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248256 00010000:00010000:0.0:1746065193.061884:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.061898:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7696 00000100:00100000:0.0:1746065193.061903:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263248256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.061911:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.061922:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.061930:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.061942:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129c6fa00/0x14b4f8542d4fdecd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61478 expref: 33 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.061950:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.061965:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263248256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.061970:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7696 00000100:00100000:0.0:1746065193.062006:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.062016:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248512 00000100:00100000:0.0:1746065193.062018:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248512 00010000:00010000:0.0:1746065193.062028:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.062040:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7697 00000100:00100000:0.0:1746065193.062044:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263248512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.062050:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.062056:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.062064:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.062074:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fdd99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e613e5 expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.062083:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.062096:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263248512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.062101:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7697 00000100:00100000:0.0:1746065193.062138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.062158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.062167:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248384 00000100:00100000:0.0:1746065193.062170:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248384 00010000:00010000:0.0:1746065193.062179:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 10 pid: 21998 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.062191:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7698 00000100:00100000:0.0:1746065193.062196:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263248384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.062201:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.062207:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 10 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.062214:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 10 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.062225:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4115600/0x14b4f8542d4fded4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6147f expref: 10 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.062233:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.062235:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.062239:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.062247:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.062262:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.062276:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263248384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.062281:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7698 00000100:00100000:0.0:1746065193.062312:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.062322:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248640 00000100:00100000:0.0:1746065193.062324:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248640 00010000:00010000:0.0:1746065193.062334:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.062347:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7699 00000100:00100000:0.0:1746065193.062351:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263248640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.062356:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.062363:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.062370:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.062380:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4800/0x14b4f8542d4fdeaa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61471 expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.062392:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.062406:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263248640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.062411:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7699 00000100:00100000:0.0:1746065193.062440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.062498:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263249024 00000100:00100000:3.0:1746065193.062502:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263249024 00010000:00010000:3.0:1746065193.062512:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 20 pid: 21998 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746065193.062527:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7700 00000100:00100000:3.0:1746065193.062531:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+20:1961:x1830881263249024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.062537:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.062546:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 20 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746065193.062553:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 20 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746065193.062562:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc82c00/0x14b4f8542d4fd89f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61145 expref: 20 pid: 21998 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746065193.062581:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.062593:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263249024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.062597:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7700 00010000:00010000:3.0:1746065193.062617:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.062628:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.062643:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.062649:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.062656:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.062662:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0072600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065193.062665:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.062672:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.062680:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.062686:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fdfec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.062732:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263246720:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 23215us (24618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.062739:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14948 00000100:00100000:2.0:1746065193.063024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.063623:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248768 00000100:00100000:1.0:1746065193.063628:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248768 00002000:00100000:1.0:1746065193.063654:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3743743) req@ffff880094091180 x1830881263248768/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.063662:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091180 with x1830881263248768 ext(3145728->3743743) 00010000:00010000:1.0:1746065193.063667:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 32 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.063676:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 32 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.063681:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094091180 00000100:00100000:3.0:1746065193.064313:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263248896 00000100:00100000:3.0:1746065193.064319:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263248896 00010000:00010000:3.0:1746065193.064337:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 33 pid: 9716 timeout: 892 lvb_type: 1 00000100:00100000:3.0:1746065193.064358:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7701 00000100:00100000:3.0:1746065193.064364:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881263248896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.064375:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.064393:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 33 pid: 9716 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746065193.064402:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 33 pid: 9716 timeout: 892 lvb_type: 1 00010000:00010000:3.0:1746065193.064418:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.064420:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.064424:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.064432:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.064447:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.064474:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881263248896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.064480:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7701 00000100:00100000:1.0:1746065193.064887:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2567 00000100:00100000:1.0:1746065193.064895:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263248768:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065193.065259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.065275:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263249152 00000100:00100000:0.0:1746065193.065278:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263249152 00010000:00010000:0.0:1746065193.065294:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 16 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.065311:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7702 00000100:00100000:0.0:1746065193.065316:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:1960:x1830881263249152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.065322:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.065327:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 16 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.065334:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 16 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.065347:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065193.065350:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065359:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065368:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065377:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.065392:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:1960:x1830881263249152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.065397:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7702 00010000:00010000:0.0:1746065193.065530:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5563800/0x14b4f8542d4fd7bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e610ce expref: 32 pid: 9716 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.065541:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260420480:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.065558:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065565:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065570:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065590:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065595:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065601:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065607:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0087800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065193.065610:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065615:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065624:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.065629:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0087800/0x14b4f8542d4fdfde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.065671:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263246464:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 27104us (29090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.065677:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14946 00010000:00010000:0.0:1746065193.065711:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087000/0x14b4f8542d4fdfc2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614f6 expref: 15 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.065733:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260420608:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.065742:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065748:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065752:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065193.065764:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065193.065875:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065881:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065885:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065889:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0072200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.065892:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065896:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065902:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065193.065906:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065193.065908:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065912:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe016 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065922:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065926:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065930:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065936:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0073400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.065937:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065941:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065945:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065193.065947:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.065949:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065952:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065958:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065963:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065967:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065971:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0073c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.065973:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065978:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065984:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fa900) 00010000:00010000:0.0:1746065193.065985:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.065988:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.065992:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0073c00/0x14b4f8542d4fe00f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.066025:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fe001 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61504 expref: 36 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.066031:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fe001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61504 expref: 36 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.066037:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0072000, rc 0) 00000100:00100000:0.0:1746065193.066055:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+35:32024:x1830881263247872:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9989us (11594us total) trans 8589944339 rc 301/301 00000100:00100000:0.0:1746065193.066061:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10063 00000100:00100000:1.0:1746065193.079517:0:21482:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263248128:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 19239us (19447us total) trans 21474840951 rc 0/0 00000100:00100000:1.0:1746065193.079527:0:21482:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2566 00002000:00100000:1.0:1746065193.079539:0:21482:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x383:0x0] (3883008->4194303) req@ffff88012bd3c000 x1830881263248128/t21474840951(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.079554:0:21482:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3c000 with x1830881263248128 ext(3883008->4194303) 00010000:00010000:1.0:1746065193.079562:0:21482:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 27 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.079573:0:21482:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 27 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.079579:0:21482:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bd3c000 00000100:00100000:0.0:1746065193.097727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.098020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.098145:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263249536 00000100:00100000:1.0:1746065193.098153:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263249536 00010000:00010000:1.0:1746065193.098183:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 27 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.098332:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263249408 00000100:00100000:0.0:1746065193.098335:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263249408 00000100:00100000:1.0:1746065193.099227:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7703 00000100:00100000:1.0:1746065193.099236:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263249536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.099247:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065193.099440:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10064 00000100:00100000:0.0:1746065193.099448:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+281:32029:x1830881263249408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.099463:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.099476:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6150b expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.099601:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099612:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099625:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099635:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099639:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099644:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099729:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099736:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099741:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065193.099747:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065193.099803:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099808:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099825:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099830:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0087600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.099834:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099840:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099848:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065193.099850:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065193.099853:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099857:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe039 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099873:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099877:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099881:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099884:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0086e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.099885:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099889:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099893:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065193.099894:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.099896:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099900:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099905:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099910:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099913:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099916:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0087a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.099918:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099921:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099925:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801331acd00) 00010000:00010000:0.0:1746065193.099927:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.099928:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099931:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe032 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.099957:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe024 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6150b expref: 283 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.099962:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6150b expref: 283 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.099967:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0087800, rc 0) 00000100:00100000:0.0:1746065193.100006:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:32029:x1830881263249408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 560us (1986us total) trans 8589944340 rc 301/301 00000100:00100000:0.0:1746065193.100011:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10064 00010000:00010000:1.0:1746065193.102809:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 27 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.102840:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 27 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.102859:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fdf67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614c5 expref: 27 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.102880:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.102883:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.102887:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.102894:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.102933:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.102976:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263249536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3740us (5265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.102984:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7703 00010000:00010000:1.0:1746065193.103552:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.103560:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.103581:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.103587:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.103593:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.103598:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092771200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065193.103601:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.103607:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.103616:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.103620:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fdff3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.103658:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263246848:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 63735us (63808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.103664:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14949 00000100:00080000:1.0:1746065193.103731:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065193.111696:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263247232:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 56058us (57117us total) trans 21474840952 rc 0/0 00000100:00100000:1.0:1746065193.111707:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2565 00002000:00100000:1.0:1746065193.111728:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x380:0x0] (249856->884735) req@ffff880094090700 x1830881263247232/t21474840952(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.111737:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090700 with x1830881263247232 ext(249856->884735) 00010000:00010000:1.0:1746065193.111746:0:11197:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.111760:0:11197:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 21 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.111771:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094090700 00000100:00100000:0.0:1746065193.113136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.113186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.113203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.113219:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250176 00000100:00100000:0.0:1746065193.113225:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250176 00000100:00100000:0.0:1746065193.113253:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250432 00000100:00100000:0.0:1746065193.113255:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250432 00000100:00100000:0.0:1746065193.113268:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14951 00000100:00100000:0.0:1746065193.113273:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263250176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.113285:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.113297:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a66b800/0x14b4f8542d4fe047 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61520 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.113339:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260420736:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065193.113398:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.113414:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14952 00000100:00100000:0.0:1746065193.113419:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881263250432:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.113426:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.113435:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6152e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065193.113453:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d727, atime: 0x6812d725, ctime: 0x6812d727, blocks: 0x821 00010000:00010000:0.0:1746065193.113461:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.113463:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.113469:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 34 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.113481:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 34 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.113489:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10200, rc 0) 00000100:00100000:0.0:1746065193.113509:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263250432:12345-192.168.202.46@tcp:101:cat.0 Request processed in 89us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.113513:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14952 00000100:00100000:0.0:1746065193.113549:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.113578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.113588:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250688 00000100:00100000:0.0:1746065193.113590:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250688 00000100:00100000:0.0:1746065193.113603:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14953 00000100:00100000:0.0:1746065193.113607:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881263250688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.113612:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.113619:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6153c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065193.113631:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d729, atime: 0x6812d729, ctime: 0x6812d729, blocks: 0x1687 00010000:00010000:0.0:1746065193.113637:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.113639:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.113643:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.113651:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.113658:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10800, rc 0) 00000100:00100000:0.0:1746065193.113671:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263250688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.113675:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14953 00000100:00100000:0.0:1746065193.113692:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263249792 00000100:00100000:0.0:1746065193.113694:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263249792 00000100:00100000:0.0:1746065193.113710:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250048 00000100:00100000:0.0:1746065193.113711:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250048 00000100:00100000:0.0:1746065193.113736:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10065 00000100:00100000:0.0:1746065193.113742:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+35:32032:x1830881263249792:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.113752:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.113761:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe05c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61512 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.113861:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.113871:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.113879:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.113890:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.113895:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.113900:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.113983:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.113990:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.113995:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:0.0:1746065193.114002:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065193.114059:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114065:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114069:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114074:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b11200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.114077:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114082:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114089:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065193.114092:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065193.114094:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114099:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe071 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114112:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114116:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114120:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114123:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b10e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.114125:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114128:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114133:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065193.114135:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.114137:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114141:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114145:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114149:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114153:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114157:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b11000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.114159:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114163:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114168:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b5371f00) 00010000:00010000:0.0:1746065193.114170:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.114172:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114176:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11000/0x14b4f8542d4fe06a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065193.114205:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe05c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61512 expref: 37 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.114212:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe05c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61512 expref: 37 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.114218:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10c00, rc 0) 00000100:00100000:0.0:1746065193.114234:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+36:32032:x1830881263249792:12345-192.168.202.46@tcp:101:cat.0 Request processed in 493us (1047us total) trans 8589944341 rc 301/301 00000100:00100000:3.0:1746065193.114285:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10066 00000100:00100000:3.0:1746065193.114292:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+282:32031:x1830881263250048:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065193.114301:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.114308:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe07f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61519 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.114343:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114470:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114476:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114486:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114491:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114495:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114542:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114548:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114553:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:3.0:1746065193.114562:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065193.114594:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114599:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114603:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114607:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff54c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065193.114610:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114614:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114620:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065193.114623:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065193.114624:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114628:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54c00/0x14b4f8542d4fe094 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114642:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114646:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114650:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114656:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff54800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065193.114658:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114662:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114667:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065193.114669:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065193.114671:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114674:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fe086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114682:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114686:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114689:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114692:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff54a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065193.114694:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114698:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114703:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fa800) 00010000:00010000:3.0:1746065193.114704:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065193.114706:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114711:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54a00/0x14b4f8542d4fe08d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065193.114747:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe07f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61519 expref: 284 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.114752:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe07f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61519 expref: 284 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.114758:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff54600, rc 0) 00000100:00100000:3.0:1746065193.114775:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:32031:x1830881263250048:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 485us (1226us total) trans 8589944342 rc 301/301 00000100:00100000:3.0:1746065193.114781:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10066 00000100:00100000:3.0:1746065193.114859:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.114873:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250304 00000100:00100000:3.0:1746065193.114876:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250304 00000100:00100000:3.0:1746065193.114894:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14954 00000100:00100000:3.0:1746065193.114897:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263250304:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.114904:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.114912:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61527 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065193.114925:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d727, atime: 0x6812d725, ctime: 0x6812d727, blocks: 0x821 00010000:00010000:3.0:1746065193.114933:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.114934:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.114938:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 35 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.114947:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 35 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.114953:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff55200, rc 0) 00000100:00100000:3.0:1746065193.114968:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263250304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 71us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.114973:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14954 00000100:00100000:3.0:1746065193.115019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.115028:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250560 00000100:00100000:3.0:1746065193.115030:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250560 00000100:00100000:3.0:1746065193.115044:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14955 00000100:00100000:3.0:1746065193.115048:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263250560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.115053:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.115061:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61535 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065193.115072:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d729, atime: 0x6812d728, ctime: 0x6812d729, blocks: 0x81d 00010000:00010000:3.0:1746065193.115080:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.115081:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.115084:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 30 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.115093:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 30 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.115102:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff55400, rc 0) 00000100:00100000:3.0:1746065193.115116:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881263250560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 67us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.115120:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14955 00000100:00100000:3.0:1746065193.115150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.115158:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250816 00000100:00100000:3.0:1746065193.115161:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250816 00000100:00100000:3.0:1746065193.115171:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14956 00000100:00100000:3.0:1746065193.115175:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263250816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.115180:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.115185:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff55600/0x14b4f8542d4fe0b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61543 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.115207:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260420864:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065193.115234:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5938300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065193.118886:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263248768:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 53982us (56737us total) trans 17179873670 rc 0/0 00000100:00100000:1.0:1746065193.118898:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2567 00002000:00100000:1.0:1746065193.118908:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3743743) req@ffff880094091180 x1830881263248768/t17179873670(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.118917:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094091180 with x1830881263248768 ext(3145728->3743743) 00010000:00010000:1.0:1746065193.118927:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 37 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.118939:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 37 pid: 8851 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.118946:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094091180 00000100:00100000:0.0:1746065193.121445:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10065 00000100:00100000:0.0:1746065193.121606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.122521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.122536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.123894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.124835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.124860:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263250944 00000100:00100000:2.0:1746065193.124867:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263250944 00000100:00100000:2.0:1746065193.124896:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251072 00000100:00100000:2.0:1746065193.124898:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251072 00000100:00100000:2.0:1746065193.124906:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251328 00000100:00100000:2.0:1746065193.124908:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251328 00000100:00100000:2.0:1746065193.124916:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251456 00000100:00100000:2.0:1746065193.124917:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251456 00000100:00100000:2.0:1746065193.124927:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14957 00000100:00100000:2.0:1746065193.124933:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+22:32024:x1830881263250944:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065193.124947:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.124960:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6154a expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.124983:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.124989:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.124991:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.124994:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->3543039] (req 3145728->3543039) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 23 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.125014:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.125022:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 29 pid: 8428 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746065193.125031:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260420992:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.125080:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.125097:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14958 00000100:00100000:2.0:1746065193.125101:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263251072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.125108:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.125113:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe0be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61551 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065193.125134:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260421120:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065193.125148:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.125158:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14959 00000100:00100000:2.0:1746065193.125162:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+20:1958:x1830881263251328:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.125167:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.125174:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61558 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.125182:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.125183:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.125188:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.125198:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.125205:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc600, rc 0) 00000100:00100000:2.0:1746065193.125219:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881263251328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.125224:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14959 00000100:00100000:2.0:1746065193.125233:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14960 00000100:00100000:2.0:1746065193.125237:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+20:1959:x1830881263251456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.125241:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.125245:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6155f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.125251:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.125252:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.125255:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.125261:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.125266:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc400, rc 0) 00000100:00100000:2.0:1746065193.125274:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263251456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 37us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.125278:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14960 00000100:00100000:0.0:1746065193.125676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.125690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.125727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.125744:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251200 00000100:00100000:0.0:1746065193.125747:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251200 00010000:00010000:0.0:1746065193.125763:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 25 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.125780:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7704 00000100:00100000:0.0:1746065193.125785:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263251200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.125791:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.125808:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 25 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.125833:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 25 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.125847:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.125848:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.125851:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.125857:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.125871:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.125889:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263251200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.125894:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7704 00000100:00100000:0.0:1746065193.125963:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251584 00000100:00100000:0.0:1746065193.125966:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251584 00000100:00100000:0.0:1746065193.125976:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251712 00000100:00100000:0.0:1746065193.125977:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251712 00000100:00100000:0.0:1746065193.125983:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251840 00000100:00100000:0.0:1746065193.125984:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251840 00000100:00100000:0.0:1746065193.125992:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14961 00000100:00100000:0.0:1746065193.125997:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263251584:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.126004:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.126010:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61566 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.126020:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.126021:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.126025:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.126031:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.126038:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b11a00, rc 0) 00000100:00100000:0.0:1746065193.126056:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1958:x1830881263251584:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.126061:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14961 00000100:00100000:0.0:1746065193.126072:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14962 00000100:00100000:0.0:1746065193.126076:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263251712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.126081:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.126086:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe0da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6156d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.126095:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.126100:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe0da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6156d expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.126108:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe0da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6156d expref: 27 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.126116:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b11400, rc 0) 00000100:00100000:0.0:1746065193.126129:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1959:x1830881263251712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 53us (455us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065193.126134:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14962 00000100:00100000:0.0:1746065193.126143:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14963 00000100:00100000:0.0:1746065193.126147:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881263251840:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.126153:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.126159:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b11600/0x14b4f8542d4fe0e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61574 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.126180:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260421248:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065193.126216:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e600 going to sleep for 11 seconds 00010000:00010000:3.0:1746065193.127182:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.127191:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.127214:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.127221:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.127228:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.127234:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0073600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065193.127238:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.127245:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.127255:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.127261:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0073600/0x14b4f8542d4fdfd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.127300:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263246336:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 89074us (91157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.127306:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14945 00000100:00100000:2.0:1746065193.131353:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260420992:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.131377:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->3543039] (req 3145728->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.131392:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfde00, rc 0) 00000100:00100000:2.0:1746065193.131426:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+25:32024:x1830881263250944:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6492us (9819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.131433:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14957 00010000:00010000:2.0:1746065193.131486:0:9716:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88008ec2c380 x1830881260421120) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 24 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.131517:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260421120:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065193.131534:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe0be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61551 expref: 24 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.131542:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe0be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61551 expref: 24 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.131554:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd600, rc 0) 00000100:00100000:2.0:1746065193.131569:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263251072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6467us (9050us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065193.131574:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14958 00000100:00100000:2.0:1746065193.131614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.131678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.131778:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260420864:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065193.131794:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff55600/0x14b4f8542d4fe0b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61543 expref: 36 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.131803:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff55600/0x14b4f8542d4fe0b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61543 expref: 36 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.131843:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff55600, rc 0) 00000100:00100000:3.0:1746065193.131869:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263250816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 16692us (16718us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065193.131874:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14956 00010000:00010000:1.0:1746065193.132002:0:4544:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88009c3fad80 x1830881260420736) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.132017:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fdf60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 249856->884735) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614be expref: 22 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.132020:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263251968 00000100:00100000:0.0:1746065193.132026:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263251968 00000100:00100000:1.0:1746065193.132028:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260420736:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065193.132044:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a66b800/0x14b4f8542d4fe047 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61520 expref: 30 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.132044:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 30 pid: 8428 timeout: 892 lvb_type: 1 00010000:00010000:1.0:1746065193.132056:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a66b800/0x14b4f8542d4fe047 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61520 expref: 30 pid: 4544 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065193.132059:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252096 00000100:00100000:0.0:1746065193.132062:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252096 00010000:00010000:1.0:1746065193.132068:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66b800, rc 0) 00010000:00010000:0.0:1746065193.132069:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 35 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.132081:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7705 00000100:00100000:1.0:1746065193.132086:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263250176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 18813us (18955us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065193.132086:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263251968:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065193.132090:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14951 00010000:00010000:0.0:1746065193.132095:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.132105:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 28 pid: 8428 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.132113:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 28 pid: 8428 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.132126:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe055 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6153c expref: 28 pid: 8428 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.132134:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.132136:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.132141:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 21 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.132145:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7706 00010000:00010000:0.0:1746065193.132149:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 21 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.132150:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263252096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.132157:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.132164:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 35 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.132171:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 21 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132172:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 35 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.132181:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065193.132181:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260421376:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065193.132183:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.132185:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132190:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132201:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.132212:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263252096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 62us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.132215:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.132216:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7706 00010000:00010000:3.0:1746065193.132231:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132238:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132430:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132438:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132445:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132451:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092771400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065193.132454:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132461:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132470:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.132474:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092771400/0x14b4f8542d4fdffa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.133182:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263246976:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 93177us (93294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.133189:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14950 00010000:00010000:2.0:1746065193.135400:0:8427:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff880129b0f800 x1830881260421248) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 34 pid: 8851 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.135428:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092771800/0x14b4f8542d4fdf6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614cc expref: 34 pid: 8851 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.135438:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260421248:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065193.135460:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b11600/0x14b4f8542d4fe0e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61574 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.135474:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b11600/0x14b4f8542d4fe0e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61574 expref: 22 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.135486:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b11600, rc 0) 00000100:00100000:2.0:1746065193.135515:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+21:1958:x1830881263251840:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9367us (9824us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065193.135520:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14963 00000100:00100000:0.0:1746065193.137858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.137917:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252224 00000100:00100000:2.0:1746065193.137925:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252224 00000100:00100000:2.0:1746065193.137965:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14964 00000100:00100000:2.0:1746065193.137971:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:32029:x1830881263252224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.137984:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.137998:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6157b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065193.138017:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d729, atime: 0x6812d725, ctime: 0x6812d729, blocks: 0x7b1 00010000:00010000:2.0:1746065193.138033:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.138034:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.138040:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.138051:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.138058:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfcc00, rc 0) 00000100:00100000:2.0:1746065193.138091:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:32029:x1830881263252224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 119us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.138096:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14964 00000100:00100000:0.0:1746065193.138727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.138848:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252480 00000100:00100000:2.0:1746065193.138852:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252480 00000100:00100000:2.0:1746065193.138875:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10067 00000100:00100000:2.0:1746065193.138880:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:32022:x1830881263252480:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:2.0:1746065193.138911:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.138928:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd000/0x14b4f8542d4fdfd0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e614fd expref: 15 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.138940:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.138943:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.138984:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:32022:x1830881263252480:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 104us (268us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746065193.138989:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10067 00000100:00100000:2.0:1746065193.140353:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260421376:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065193.140370:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.140405:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881263251968:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8318us (8789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.140414:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7705 00000100:00100000:0.0:1746065193.140747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.140788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.140847:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252736 00000100:00100000:2.0:1746065193.140851:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252736 00000100:00100000:0.0:1746065193.141574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.141601:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252608 00000100:00100000:2.0:1746065193.141604:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252608 00000100:00100000:3.0:1746065193.141648:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14965 00000100:00100000:3.0:1746065193.141656:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:32032:x1830881263252736:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065193.141661:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14966 00000100:00100000:1.0:1746065193.141667:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32031:x1830881263252608:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065193.141669:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065193.141673:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.141683:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61582 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.141683:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61589 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.141702:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746065193.141702:0:4544:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d729, atime: 0x6812d729, ctime: 0x6812d729, blocks: 0x1029 00010000:00010000:3.0:1746065193.141703:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.141709:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.141710:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.141711:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.141724:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 35 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.141730:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.141731:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 35 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.141738:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff55000, rc 0) 00010000:00010000:1.0:1746065193.141738:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136003e00, rc 0) 00000100:00100000:3.0:1746065193.141762:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:32032:x1830881263252736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 107us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.141767:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14965 00000100:00100000:1.0:1746065193.141920:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:32031:x1830881263252608:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 252us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.141928:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14966 00000100:00100000:1.0:1746065193.141942:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263252992 00000100:00100000:1.0:1746065193.141944:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263252992 00000100:00100000:1.0:1746065193.141961:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4334 00000100:00100000:1.0:1746065193.141965:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:32022:x1830881263252992:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065193.142094:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:32022:x1830881263252992:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 127us (519us total) trans 8589944343 rc 0/0 00000100:00100000:1.0:1746065193.142099:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4334 00000100:00100000:0.0:1746065193.142264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.142369:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263253248 00000100:00100000:1.0:1746065193.142372:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263253248 00002000:00100000:1.0:1746065193.142392:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3149823) req@ffff880129b0e300 x1830881263253248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.142400:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0e300 with x1830881263253248 ext(3145728->3149823) 00002000:00010000:1.0:1746065193.142404:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0e300 00000100:00100000:1.0:1746065193.142963:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8446 00000100:00100000:1.0:1746065193.142970:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263253248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065193.143079:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263253248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 109us (816us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065193.143085:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8446 00002000:00100000:1.0:1746065193.143091:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3149823) req@ffff880129b0e300 x1830881263253248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.143097:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0e300 with x1830881263253248 ext(3145728->3149823) 00002000:00010000:1.0:1746065193.143100:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0e300 00000100:00100000:0.0:1746065193.146355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.146485:0:11197:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263253504 00000100:00100000:2.0:1746065193.146492:0:11197:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263253504 00002000:00100000:2.0:1746065193.146527:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3420160->3424255) req@ffff880129b0d500 x1830881263253504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.146535:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0d500 with x1830881263253504 ext(3420160->3424255) 00002000:00010000:2.0:1746065193.146540:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0d500 00000100:00100000:2.0:1746065193.146591:0:11197:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8447 00000100:00100000:2.0:1746065193.146598:0:11197:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263253504:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065193.146759:0:11197:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263253504:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 160us (408us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065193.146764:0:11197:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8447 00002000:00100000:2.0:1746065193.146770:0:11197:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x389:0x0] (3420160->3424255) req@ffff880129b0d500 x1830881263253504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.146776:0:11197:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0d500 with x1830881263253504 ext(3420160->3424255) 00002000:00010000:2.0:1746065193.146779:0:11197:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0d500 00000100:00100000:0.0:1746065193.150903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.150926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.150943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.150968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.150979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.151032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.151060:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263254272 00000100:00100000:3.0:1746065193.151067:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263254272 00002000:00100000:3.0:1746065193.151105:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3538944->3543039) req@ffff880129b0c700 x1830881263254272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.151117:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c700 with x1830881263254272 ext(3538944->3543039) 00002000:00010000:3.0:1746065193.151122:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0c700 00000100:00100000:3.0:1746065193.151135:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263254016 00000100:00100000:3.0:1746065193.151137:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263254016 00002000:00100000:3.0:1746065193.151146:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880129b0f800 x1830881263254016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.151151:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f800 with x1830881263254016 ext(0->1048575) 00002000:00010000:3.0:1746065193.151153:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0f800 00000100:00100000:3.0:1746065193.151162:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263254528 00000100:00100000:3.0:1746065193.151163:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263254528 00002000:00100000:3.0:1746065193.151170:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009c7aea00 x1830881263254528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.151175:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aea00 with x1830881263254528 ext(1048576->2097151) 00002000:00010000:3.0:1746065193.151177:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7aea00 00000100:00100000:3.0:1746065193.151183:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263254784 00000100:00100000:3.0:1746065193.151184:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263254784 00002000:00100000:3.0:1746065193.151190:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009c7af100 x1830881263254784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.151195:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af100 with x1830881263254784 ext(1048576->2097151) 00002000:00010000:3.0:1746065193.151197:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7af100 00000100:00100000:3.0:1746065193.151203:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263255040 00000100:00100000:3.0:1746065193.151204:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263255040 00002000:00100000:3.0:1746065193.151210:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009c7ae300 x1830881263255040/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.151215:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ae300 with x1830881263255040 ext(1048576->2097151) 00002000:00010000:3.0:1746065193.151218:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ae300 00000100:00100000:3.0:1746065193.151227:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8448 00000100:00100000:3.0:1746065193.151232:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263254272:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065193.151372:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263254272:12345-192.168.202.46@tcp:3:cat.0 Request processed in 140us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065193.151372:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8449 00000100:00100000:3.0:1746065193.151378:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8448 00000100:00100000:1.0:1746065193.151378:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263254016:12345-192.168.202.46@tcp:3:multiop.0 00002000:00100000:3.0:1746065193.151383:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3538944->3543039) req@ffff880129b0c700 x1830881263254272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.151390:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c700 with x1830881263254272 ext(3538944->3543039) 00002000:00010000:3.0:1746065193.151392:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0c700 00000100:00100000:3.0:1746065193.151403:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8450 00000100:00100000:3.0:1746065193.151407:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263254528:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065193.151650:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8451 00000100:00100000:3.0:1746065193.151655:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263254784:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065193.152486:0:21486:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8452 00000100:00100000:0.0:1746065193.152494:0:21486:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263255040:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065193.153067:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263253760 00000100:00100000:2.0:1746065193.153073:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263253760 00000100:00100000:2.0:1746065193.153111:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4335 00000100:00100000:2.0:1746065193.153116:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:32022:x1830881263253760:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065193.153266:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:32022:x1830881263253760:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 149us (2369us total) trans 8589944344 rc 0/0 00000100:00100000:2.0:1746065193.153272:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4335 00000100:00100000:0.0:1746065193.155399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.155434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.155449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.155471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.155489:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263255424 00000100:00100000:0.0:1746065193.155495:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263255424 00002000:00100000:0.0:1746065193.155524:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009c7ad880 x1830881263255424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.155533:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ad880 with x1830881263255424 ext(0->1048575) 00002000:00010000:0.0:1746065193.155538:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ad880 00000100:00100000:0.0:1746065193.155550:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263255552 00000100:00100000:0.0:1746065193.155552:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263255552 00002000:00100000:0.0:1746065193.155561:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009c7aed80 x1830881263255552/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.155567:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aed80 with x1830881263255552 ext(1048576->2097151) 00002000:00010000:0.0:1746065193.155569:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7aed80 00000100:00100000:0.0:1746065193.155575:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263255936 00000100:00100000:0.0:1746065193.155576:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263255936 00002000:00100000:0.0:1746065193.155585:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009c7adc00 x1830881263255936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.155590:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7adc00 with x1830881263255936 ext(1048576->2097151) 00002000:00010000:0.0:1746065193.155592:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7adc00 00000100:00100000:0.0:1746065193.155599:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263255808 00000100:00100000:0.0:1746065193.155601:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263255808 00002000:00100000:0.0:1746065193.155608:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009c7ac700 x1830881263255808/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.155613:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac700 with x1830881263255808 ext(1048576->2097151) 00002000:00010000:0.0:1746065193.155616:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac700 00000100:00100000:0.0:1746065193.155624:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8453 00000100:00100000:0.0:1746065193.155629:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263255424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.156150:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8454 00000100:00100000:0.0:1746065193.156156:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263255552:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.157147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.158856:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8455 00000100:00100000:3.0:1746065193.158870:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263255936:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065193.158927:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8456 00000100:00100000:3.0:1746065193.158933:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263255808:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065193.159842:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263256320 00000100:00100000:1.0:1746065193.159849:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263256320 00000100:00100000:1.0:1746065193.159879:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4336 00000100:00100000:1.0:1746065193.159884:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+36:32024:x1830881263256320:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065193.162255:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+37:32024:x1830881263256320:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 2362us (5101us total) trans 8589944345 rc 0/0 00000100:00100000:1.0:1746065193.162266:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4336 00000100:00100000:1.0:1746065193.162351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.165537:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263256576 00000100:00100000:2.0:1746065193.165547:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263256576 00002000:00100000:2.0:1746065193.165584:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3788800->3792895) req@ffff88009f9cf800 x1830881263256576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.165599:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf800 with x1830881263256576 ext(3788800->3792895) 00002000:00010000:2.0:1746065193.165603:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cf800 00000100:00100000:2.0:1746065193.165621:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8457 00000100:00100000:2.0:1746065193.165627:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263256576:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065193.165751:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263256576:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 124us (3399us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065193.165756:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8457 00002000:00100000:2.0:1746065193.165760:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3788800->3792895) req@ffff88009f9cf800 x1830881263256576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.165765:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf800 with x1830881263256576 ext(3788800->3792895) 00002000:00010000:2.0:1746065193.165768:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f9cf800 00000100:00100000:3.0:1746065193.179686:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263255808:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20741us (24201us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.179699:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8456 00002000:00100000:3.0:1746065193.179710:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009c7ac700 x1830881263255808/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.179736:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ac700 with x1830881263255808 ext(1048576->2097151) 00002000:00010000:3.0:1746065193.179741:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ac700 00000100:00100000:2.0:1746065193.190786:0:21486:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263255040:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 38283us (39743us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.190800:0:21486:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8452 00002000:00100000:2.0:1746065193.190812:0:21486:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009c7ae300 x1830881263255040/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.190842:0:21486:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ae300 with x1830881263255040 ext(1048576->2097151) 00002000:00010000:2.0:1746065193.190847:0:21486:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ae300 00000100:00100000:0.0:1746065193.192778:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263255552:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36612us (37333us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065193.192793:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8454 00002000:00100000:0.0:1746065193.192802:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009c7aed80 x1830881263255552/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.192810:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aed80 with x1830881263255552 ext(1048576->2097151) 00002000:00010000:0.0:1746065193.192836:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7aed80 00000100:00100000:2.0:1746065193.196895:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881263254016:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 45508us (45941us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.196906:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8449 00002000:00100000:2.0:1746065193.196917:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880129b0f800 x1830881263254016/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.196926:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f800 with x1830881263254016 ext(0->1048575) 00002000:00010000:2.0:1746065193.196931:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0f800 00000100:00100000:1.0:1746065193.206436:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263255424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 50796us (51032us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065193.206447:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8453 00002000:00100000:1.0:1746065193.206459:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009c7ad880 x1830881263255424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.206468:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ad880 with x1830881263255424 ext(0->1048575) 00002000:00010000:1.0:1746065193.206474:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7ad880 00000100:00100000:0.0:1746065193.213408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.214571:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1958:x1830881263254528:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 63157us (63595us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.214580:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8450 00002000:00100000:2.0:1746065193.214590:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009c7aea00 x1830881263254528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.214599:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7aea00 with x1830881263254528 ext(1048576->2097151) 00002000:00010000:2.0:1746065193.214604:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7aea00 00000100:00100000:3.0:1746065193.214684:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263256832 00000100:00100000:3.0:1746065193.214692:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263256832 00000100:00100000:3.0:1746065193.214745:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4337 00000100:00100000:3.0:1746065193.214752:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+283:32031:x1830881263256832:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065193.214939:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:32031:x1830881263256832:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 187us (1539us total) trans 8589944346 rc 0/0 00000100:00100000:3.0:1746065193.214945:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4337 00000100:00100000:3.0:1746065193.217072:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263255936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 58198us (61613us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.217081:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8455 00002000:00100000:3.0:1746065193.217090:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009c7adc00 x1830881263255936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.217097:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7adc00 with x1830881263255936 ext(1048576->2097151) 00002000:00010000:3.0:1746065193.217102:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7adc00 00000100:00100000:3.0:1746065193.222240:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263254784:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 70575us (71250us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.222251:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8451 00002000:00100000:3.0:1746065193.222261:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009c7af100 x1830881263254784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.222270:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7af100 with x1830881263254784 ext(1048576->2097151) 00002000:00010000:3.0:1746065193.222275:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7af100 00000100:00100000:0.0:1746065193.235979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.236067:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263256960 00000100:00100000:1.0:1746065193.236076:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263256960 00000100:00100000:1.0:1746065193.236120:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14967 00000100:00100000:1.0:1746065193.236127:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:32029:x1830881263256960:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065193.236141:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065193.236154:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61590 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.236184:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.236190:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065193.236192:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065193.236194:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.236217:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 22 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.236231:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 22 pid: 21235 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065193.236242:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260421504:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065193.236320:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.239112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.239209:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263257216 00000100:00100000:3.0:1746065193.239217:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263257216 00002000:00100000:3.0:1746065193.239261:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88008fd07100 x1830881263257216/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.239270:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07100 with x1830881263257216 ext(2097152->3145727) 00010000:00010000:3.0:1746065193.239278:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 23 pid: 21235 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.239291:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 23 pid: 21235 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746065193.239298:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd07100 00000100:00100000:3.0:1746065193.239316:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2568 00000100:00100000:3.0:1746065193.239323:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263257216:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065193.240705:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260421504:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.240744:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.240761:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0044c00, rc 0) 00000100:00100000:2.0:1746065193.240793:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:32029:x1830881263256960:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4666us (4822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.240800:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14967 00000100:00100000:1.0:1746065193.240920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.241622:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263257344 00000100:00100000:0.0:1746065193.241629:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263257344 00002000:00100000:0.0:1746065193.241652:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3543039) req@ffff88009f9cca80 x1830881263257344/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.241661:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cca80 with x1830881263257344 ext(3145728->3543039) 00010000:00010000:0.0:1746065193.241671:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.241682:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746065193.241688:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cca80 00000100:00100000:0.0:1746065193.241722:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2569 00000100:00100000:0.0:1746065193.241730:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263257344:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065193.250956:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263257216:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11625us (11841us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.250967:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2568 00002000:00100000:3.0:1746065193.250978:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88008fd07100 x1830881263257216/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.250985:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07100 with x1830881263257216 ext(2097152->3145727) 00010000:00010000:3.0:1746065193.250994:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.251008:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746065193.251019:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd07100 00000100:00100000:1.0:1746065193.253668:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263257344:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11928us (12738us total) trans 21474840953 rc 0/0 00000100:00100000:1.0:1746065193.253679:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2569 00002000:00100000:1.0:1746065193.253689:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3543039) req@ffff88009f9cca80 x1830881263257344/t21474840953(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.253697:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cca80 with x1830881263257344 ext(3145728->3543039) 00010000:00010000:1.0:1746065193.253705:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.253735:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.253740:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cca80 00000100:00100000:0.0:1746065193.256564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.256613:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263257472 00000100:00100000:2.0:1746065193.256622:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263257472 00000100:00100000:2.0:1746065193.256671:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14968 00000100:00100000:2.0:1746065193.256678:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:32032:x1830881263257472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.256691:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.256705:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61597 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.256738:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 34 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.256745:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065193.256747:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065193.256750:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.256774:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 34 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.256783:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 34 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.256794:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260421632:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.256892:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.258812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.258904:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263257600 00000100:00100000:0.0:1746065193.258911:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263257600 00010000:00010000:0.0:1746065193.258938:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.258963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.259079:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260421632:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.259099:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 22 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.259111:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc800, rc 0) 00000100:00100000:3.0:1746065193.259142:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:32032:x1830881263257472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2465us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.259148:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14968 00000100:00100000:1.0:1746065193.259276:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7707 00000100:00100000:1.0:1746065193.259284:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263257600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.259294:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065193.259310:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065193 -> 1746065194 00002000:00010000:1.0:1746065193.259312:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065193 -> 1746065194 00010000:00010000:1.0:1746065193.259317:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.259326:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.259344:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe0b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6154a expref: 25 pid: 21235 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.259363:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.259364:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.259370:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.259377:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.260233:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263257728 00000100:00100000:0.0:1746065193.260238:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263257728 00002000:00100000:0.0:1746065193.260263:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3420160->3792895) req@ffff88009fb10700 x1830881263257728/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.260271:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881263257728 ext(3420160->3792895) 00010000:00010000:0.0:1746065193.260277:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 35 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.260285:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 35 pid: 4544 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746065193.260291:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb10700 00000100:00100000:0.0:1746065193.260308:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2570 00000100:00100000:0.0:1746065193.260313:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263257728:12345-192.168.202.46@tcp:4:cat.0 00010000:00010000:1.0:1746065193.260438:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.260449:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260421760:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065193.260504:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065193.265359:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260421760:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065193.265379:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.265419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.265571:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881263257600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6287us (6762us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.265581:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7707 00000100:00100000:3.0:1746065193.265771:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263257984 00000100:00100000:3.0:1746065193.265781:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263257984 00002000:00100000:3.0:1746065193.265837:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009fb11180 x1830881263257984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.265846:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11180 with x1830881263257984 ext(2097152->3145727) 00002000:00010000:3.0:1746065193.265849:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb11180 00000100:00100000:3.0:1746065193.265870:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8458 00000100:00100000:3.0:1746065193.265877:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263257984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065193.268218:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263257728:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7895us (9246us total) trans 17179873671 rc 0/0 00000100:00100000:3.0:1746065193.268230:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2570 00002000:00100000:3.0:1746065193.268240:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3420160->3792895) req@ffff88009fb10700 x1830881263257728/t17179873671(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.268248:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10700 with x1830881263257728 ext(3420160->3792895) 00010000:00010000:3.0:1746065193.268258:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 37 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.268272:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 37 pid: 4544 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746065193.268278:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb10700 00000100:00100000:0.0:1746065193.274647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.274774:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263258112 00000100:00100000:1.0:1746065193.274782:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263258112 00010000:00010000:1.0:1746065193.274809:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 37 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.275320:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263257984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9442us (9900us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.275328:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8458 00002000:00100000:3.0:1746065193.275337:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009fb11180 x1830881263257984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.275346:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11180 with x1830881263257984 ext(2097152->3145727) 00002000:00010000:3.0:1746065193.275350:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb11180 00000100:00100000:1.0:1746065193.275443:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7708 00000100:00100000:1.0:1746065193.275450:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263258112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.275460:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065193.275473:0:15963:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065193 -> 1746065194 00002000:00010000:1.0:1746065193.275475:0:15963:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065193 -> 1746065194 00010000:00010000:1.0:1746065193.275480:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 37 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.275490:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 37 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.275507:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe0f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->3792895) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61589 expref: 37 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.275530:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.275532:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.275538:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.275545:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.275568:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 21 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.275577:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260421888:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065193.275617:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065193.281743:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260421888:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065193.281763:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.281805:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263258112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6354us (7166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.282033:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7708 00000100:00100000:0.0:1746065193.282117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.282183:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263258368 00000100:00100000:3.0:1746065193.282188:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263258368 00002000:00100000:3.0:1746065193.282221:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd07b80 x1830881263258368/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.282229:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07b80 with x1830881263258368 ext(2097152->3145727) 00002000:00010000:3.0:1746065193.282233:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd07b80 00000100:00100000:3.0:1746065193.282260:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8459 00000100:00100000:3.0:1746065193.282266:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263258368:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.282962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.283012:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263258496 00000100:00100000:2.0:1746065193.283017:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263258496 00000100:00100000:2.0:1746065193.283044:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14969 00000100:00100000:2.0:1746065193.283049:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:32029:x1830881263258496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.283057:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.283071:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6159e expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.283093:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.283094:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.283101:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 37 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.283113:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 37 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.283125:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756000, rc 0) 00000100:00100000:2.0:1746065193.283162:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:32029:x1830881263258496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 113us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.283168:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14969 00000100:00100000:3.0:1746065193.289613:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263258368:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7338us (7487us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.289623:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8459 00002000:00100000:3.0:1746065193.289634:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd07b80 x1830881263258368/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.289643:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07b80 with x1830881263258368 ext(2097152->3145727) 00002000:00010000:3.0:1746065193.289647:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd07b80 00000100:00100000:0.0:1746065193.290453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.290468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.290493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.290645:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263258880 00000100:00100000:1.0:1746065193.290652:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263258880 00002000:00100000:1.0:1746065193.290676:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd06680 x1830881263258880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.290689:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06680 with x1830881263258880 ext(2097152->3145727) 00002000:00010000:1.0:1746065193.290692:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd06680 00000100:00100000:1.0:1746065193.290703:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259008 00000100:00100000:1.0:1746065193.290705:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259008 00002000:00100000:1.0:1746065193.290719:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fd06d80 x1830881263259008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.290725:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06d80 with x1830881263259008 ext(3145728->4194303) 00002000:00010000:1.0:1746065193.290727:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd06d80 00000100:00100000:1.0:1746065193.290739:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259264 00000100:00100000:1.0:1746065193.290740:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259264 00002000:00100000:1.0:1746065193.290751:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd06a00 x1830881263259264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.290756:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06a00 with x1830881263259264 ext(3145728->4194303) 00002000:00010000:1.0:1746065193.290758:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd06a00 00000100:00100000:1.0:1746065193.290766:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8460 00000100:00100000:1.0:1746065193.290771:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263258880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065193.290924:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8461 00000100:00100000:2.0:1746065193.290931:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263259008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065193.291227:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8462 00000100:00100000:3.0:1746065193.291234:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263259264:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.295544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.295611:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259392 00000100:00100000:2.0:1746065193.295620:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259392 00000100:00100000:2.0:1746065193.295667:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14970 00000100:00100000:2.0:1746065193.295674:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:32032:x1830881263259392:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.295691:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.295704:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615a5 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.295737:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.295739:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.295744:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.295762:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.295771:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756200, rc 0) 00000100:00100000:2.0:1746065193.295810:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:32032:x1830881263259392:12345-192.168.202.46@tcp:101:cat.0 Request processed in 136us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.295844:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14970 00000100:00100000:2.0:1746065193.303939:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881263258880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13157us (13477us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.303950:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8460 00002000:00100000:2.0:1746065193.303960:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88008fd06680 x1830881263258880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.303969:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06680 with x1830881263258880 ext(2097152->3145727) 00002000:00010000:2.0:1746065193.303974:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd06680 00000100:00100000:0.0:1746065193.312940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.312985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.313341:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259648 00000100:00100000:2.0:1746065193.313349:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259648 00000100:00100000:1.0:1746065193.313360:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263259904 00000100:00100000:1.0:1746065193.313364:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263259904 00002000:00100000:2.0:1746065193.313387:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd07800 x1830881263259648/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.313387:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fd05f80 x1830881263259904/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.313395:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07800 with x1830881263259648 ext(3145728->4194303) 00002000:00100000:1.0:1746065193.313395:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05f80 with x1830881263259904 ext(3145728->4194303) 00002000:00010000:2.0:1746065193.313399:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd07800 00002000:00010000:1.0:1746065193.313399:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05f80 00000100:00100000:2.0:1746065193.313430:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8463 00000100:00100000:1.0:1746065193.313436:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8464 00000100:00100000:2.0:1746065193.313437:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263259648:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065193.313441:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263259904:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.316761:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881263259008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25823us (26284us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065193.316771:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8461 00002000:00100000:0.0:1746065193.316779:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fd06d80 x1830881263259008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.316787:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06d80 with x1830881263259008 ext(3145728->4194303) 00002000:00010000:0.0:1746065193.316792:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd06d80 00000100:00100000:0.0:1746065193.317048:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1959:x1830881263259264:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25814us (26553us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065193.317054:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8462 00002000:00100000:0.0:1746065193.317059:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd06a00 x1830881263259264/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.317065:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06a00 with x1830881263259264 ext(3145728->4194303) 00002000:00010000:0.0:1746065193.317068:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd06a00 00000100:00100000:2.0:1746065193.330841:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263259648:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17367us (17871us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.330858:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8463 00002000:00100000:2.0:1746065193.330881:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd07800 x1830881263259648/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.330890:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07800 with x1830881263259648 ext(3145728->4194303) 00002000:00010000:2.0:1746065193.330896:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd07800 00000100:00100000:1.0:1746065193.332644:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263259904:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19197us (19653us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065193.332653:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8464 00002000:00100000:1.0:1746065193.332661:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88008fd05f80 x1830881263259904/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.332669:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05f80 with x1830881263259904 ext(3145728->4194303) 00002000:00010000:1.0:1746065193.332673:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd05f80 00000100:00100000:0.0:1746065193.336366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.336437:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263260160 00000100:00100000:1.0:1746065193.336444:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263260160 00002000:00100000:1.0:1746065193.336477:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd05880 x1830881263260160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.336486:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05880 with x1830881263260160 ext(4194304->5013503) 00002000:00010000:1.0:1746065193.336490:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05880 00000100:00100000:1.0:1746065193.336517:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8465 00000100:00100000:1.0:1746065193.336524:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263260160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.341521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.341901:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263260416 00000100:00100000:2.0:1746065193.341908:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263260416 00002000:00100000:2.0:1746065193.341942:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd05180 x1830881263260416/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.341950:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05180 with x1830881263260416 ext(4194304->5013503) 00002000:00010000:2.0:1746065193.341954:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05180 00000100:00100000:2.0:1746065193.341975:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8466 00000100:00100000:2.0:1746065193.341982:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263260416:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.344028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.344051:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263260672 00000100:00100000:0.0:1746065193.344056:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263260672 00000100:00100000:0.0:1746065193.344095:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10068 00000100:00100000:0.0:1746065193.344101:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+284:32037:x1830881263260672:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065193.344119:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.344133:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615ac expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.344222:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344233:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344242:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344251:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344257:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344262:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344345:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344353:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344358:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065193.344365:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065193.344433:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344440:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344449:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344454:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b10c00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.344457:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344462:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344472:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065193.344474:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.344477:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344481:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344495:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344499:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344504:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344508:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131b11200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065193.344510:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344514:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344523:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a54e6c00) 00010000:00010000:0.0:1746065193.344524:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.344526:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344530:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe127 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065193.344560:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 287 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.344570:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 286 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.344575:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065193.344577:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065193.344579:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10e00, rc 0) 00000100:00100000:0.0:1746065193.347886:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+286:32037:x1830881263260672:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3775us (3854us total) trans 8589944347 rc 0/0 00000100:00100000:0.0:1746065193.347895:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10068 00000100:00100000:1.0:1746065193.348536:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263260160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12009us (12174us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065193.348545:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8465 00002000:00100000:1.0:1746065193.348555:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd05880 x1830881263260160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.348564:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05880 with x1830881263260160 ext(4194304->5013503) 00002000:00010000:1.0:1746065193.348569:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05880 00000100:00100000:2.0:1746065193.361653:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263260416:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19663us (20255us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065193.361664:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8466 00002000:00100000:2.0:1746065193.361675:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008fd05180 x1830881263260416/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.361682:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05180 with x1830881263260416 ext(4194304->5013503) 00002000:00010000:2.0:1746065193.361687:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05180 00000100:00100000:0.0:1746065193.362709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.364381:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263260928 00000100:00100000:1.0:1746065193.364391:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263260928 00000100:00100000:1.0:1746065193.364446:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4338 00000100:00100000:1.0:1746065193.364453:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b559050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+286:32029:x1830881263260928:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065193.364635:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b559050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+287:32029:x1830881263260928:12345-192.168.202.46@tcp:35:cat.0 Request processed in 183us (1930us total) trans 8589944348 rc 0/0 00000100:00100000:1.0:1746065193.364641:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4338 00000100:00100000:0.0:1746065193.367262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.369005:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261184 00000100:00100000:3.0:1746065193.369017:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261184 00000100:00100000:3.0:1746065193.369065:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4339 00000100:00100000:3.0:1746065193.369072:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+37:32032:x1830881263261184:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065193.369273:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+38:32032:x1830881263261184:12345-192.168.202.46@tcp:35:cat.0 Request processed in 202us (2018us total) trans 8589944349 rc 0/0 00000100:00100000:3.0:1746065193.369279:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4339 00000100:00100000:0.0:1746065193.405375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.405535:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261440 00000100:00100000:2.0:1746065193.405543:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261440 00000100:00100000:2.0:1746065193.405580:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10069 00000100:00100000:2.0:1746065193.405588:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+38:32041:x1830881263261440:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065193.405609:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.405625:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757800/0x14b4f8542d4fe13c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615b3 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.405729:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.405742:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.405751:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.405763:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.405768:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.405774:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.405895:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.405904:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.405910:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065193.405918:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065193.406003:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406013:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406017:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406022:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c757e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065193.406025:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406030:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406039:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065193.406042:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065193.406046:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406050:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406081:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406086:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406090:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406094:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c757000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065193.406096:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406104:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406110:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49fe00) 00010000:00010000:2.0:1746065193.406112:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065193.406114:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406118:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757000/0x14b4f8542d4fe14a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.406156:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c757800/0x14b4f8542d4fe13c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 41 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.406167:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 40 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.406173:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.406175:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065193.406177:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756a00, rc 0) 00000100:00100000:2.0:1746065193.406221:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+40:32041:x1830881263261440:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 633us (852us total) trans 8589944350 rc 0/0 00000100:00100000:2.0:1746065193.406228:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10069 00000100:00100000:0.0:1746065193.418078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.418125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.418190:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261568 00000100:00100000:1.0:1746065193.418198:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261568 00000100:00100000:2.0:1746065193.418206:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261696 00000100:00100000:2.0:1746065193.418210:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261696 00000100:00100000:2.0:1746065193.418246:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14971 00000100:00100000:2.0:1746065193.418252:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:32041:x1830881263261696:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065193.418267:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.418287:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615c1 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.418298:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14972 00000100:00100000:1.0:1746065193.418305:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:32037:x1830881263261568:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065193.418312:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.418313:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.418319:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615ba expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.418320:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.418326:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.418327:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.418330:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2113536->2314239] (req 2113536->2314239) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.418334:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 30 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065193.418341:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065193.418346:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.418348:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.418350:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.418357:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.418364:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 26 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.418367:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.418376:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 26 pid: 8427 timeout: 892 lvb_type: 1 00000100:00100000:2.0:1746065193.418378:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260422016:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065193.418384:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260422144:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065193.418458:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 30 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065193.418469:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 30 pid: 4545 timeout: 892 lvb_type: 1 00000100:00100000:1.0:1746065193.418476:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260422272:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065193.418591:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008f11d240 going to sleep for 11 seconds 00010000:00010000:2.0:1746065193.418628:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 30 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.418635:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 30 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.418643:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260422400:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.418659:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.424988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.425004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.425025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.425051:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261824 00000100:00100000:0.0:1746065193.425057:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261824 00010000:00010000:0.0:1746065193.425086:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 27 pid: 8427 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.425104:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263261952 00000100:00100000:0.0:1746065193.425105:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263261952 00010000:00010000:0.0:1746065193.425113:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 31 pid: 4545 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.425123:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262080 00000100:00100000:0.0:1746065193.425124:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262080 00010000:00010000:0.0:1746065193.425130:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 28 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.425141:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7709 00000100:00100000:0.0:1746065193.425146:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263261824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.425157:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.425177:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 28 pid: 8427 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.425186:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 28 pid: 8427 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.425207:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.425238:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263261824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.425244:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7709 00000100:00100000:0.0:1746065193.425283:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7710 00000100:00100000:0.0:1746065193.425287:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263261952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.425293:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.425299:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 31 pid: 4545 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.425306:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 31 pid: 4545 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065193.425315:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.425317:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.425322:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.425329:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.425351:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.425360:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260422528:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065193.425403:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.425420:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7711 00000100:00100000:0.0:1746065193.425425:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881263262080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065193.425430:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065193.425438:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 27 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.425446:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 27 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065193.425454:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.425465:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1959:x1830881263262080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 41us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.425469:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7711 00010000:00010000:3.0:1746065193.425689:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe112 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615a5 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.425705:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260422016:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.425725:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260422400:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.425747:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2113536->2314239] (req 2113536->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.425756:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756400, rc 0) 00000100:00100000:3.0:1746065193.425779:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:32041:x1830881263261696:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7527us (7653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.425789:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14971 00010000:00010000:0.0:1746065193.426096:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b11a00/0x14b4f8542d4fe0d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61566 expref: 24 pid: 8427 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.427335:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260422144:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.427359:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff55400/0x14b4f8542d4fe0a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61535 expref: 31 pid: 4545 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065193.427369:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260422272:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065193.427387:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 30 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.427395:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f428e00, rc 0) 00000100:00100000:1.0:1746065193.427403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.427419:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:32037:x1830881263261568:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9115us (9349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.427425:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14972 00000100:00100000:3.0:1746065193.427459:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262208 00000100:00100000:3.0:1746065193.427465:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262208 00010000:00010000:3.0:1746065193.427483:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 30 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.427515:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7712 00000100:00100000:3.0:1746065193.427521:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263262208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.427528:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.427543:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 30 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.427551:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 30 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.427567:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0044c00/0x14b4f8542d4fe0fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61590 expref: 30 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.427575:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.427577:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.427582:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.427588:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.427607:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.427616:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260422656:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065193.428352:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5938c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.428912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.428947:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262464 00000100:00100000:3.0:1746065193.428952:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262464 00000100:00100000:3.0:1746065193.428968:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260422656:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065193.428978:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.428996:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263262208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1475us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.429002:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7712 00000100:00100000:2.0:1746065193.429316:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260422528:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065193.429326:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.429341:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263261952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4054us (4336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.429347:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7710 00002000:00100000:3.0:1746065193.429508:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (2019328->2023423) req@ffff88012e8b4e00 x1830881263262464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.429521:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4e00 with x1830881263262464 ext(2019328->2023423) 00002000:00010000:3.0:1746065193.429525:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4e00 00000100:00100000:3.0:1746065193.429549:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8467 00000100:00100000:3.0:1746065193.429555:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263262464:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065193.429669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.429683:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262720 00000100:00100000:0.0:1746065193.429686:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262720 00002000:00100000:0.0:1746065193.429702:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2113536->2117631) req@ffff88012e8b4000 x1830881263262720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.429708:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881263262720 ext(2113536->2117631) 00002000:00010000:0.0:1746065193.429720:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4000 00000100:00100000:0.0:1746065193.429764:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8468 00000100:00100000:0.0:1746065193.429770:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263262720:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065193.430042:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263262720:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 271us (372us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065193.430047:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8468 00002000:00100000:0.0:1746065193.430052:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2113536->2117631) req@ffff88012e8b4000 x1830881263262720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.430058:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4000 with x1830881263262720 ext(2113536->2117631) 00002000:00010000:0.0:1746065193.430060:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4000 00000100:00100000:3.0:1746065193.430235:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263262464:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 679us (1323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065193.430241:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8467 00002000:00100000:3.0:1746065193.430246:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (2019328->2023423) req@ffff88012e8b4e00 x1830881263262464/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.430252:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4e00 with x1830881263262464 ext(2019328->2023423) 00002000:00010000:3.0:1746065193.430255:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4e00 00000100:00100000:2.0:1746065193.433622:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.433765:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263262976 00000100:00100000:0.0:1746065193.433771:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263262976 00000100:00100000:0.0:1746065193.433831:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14973 00000100:00100000:0.0:1746065193.433838:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:32037:x1830881263262976:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065193.433850:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.433863:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615c8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.433892:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.433958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065193.434002:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065193.434003:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065193.434007:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->2617343] (req 2097152->2617343) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.434033:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.434043:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 23 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065193.434059:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260422784:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.434070:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263104 00000100:00100000:2.0:1746065193.434074:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263104 00002000:00100000:2.0:1746065193.434094:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2310144->2314239) req@ffff88009f9cf100 x1830881263263104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.434101:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf100 with x1830881263263104 ext(2310144->2314239) 00010000:00010000:2.0:1746065193.434106:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 24 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.434116:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 24 pid: 4544 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746065193.434121:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cf100 00000100:00100000:0.0:1746065193.434127:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.434132:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2571 00000100:00100000:2.0:1746065193.434137:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263263104:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065193.434322:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263263104:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 183us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065193.434329:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2571 00002000:00100000:2.0:1746065193.434334:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2310144->2314239) req@ffff88009f9cf100 x1830881263263104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.434341:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cf100 with x1830881263263104 ext(2310144->2314239) 00010000:00010000:2.0:1746065193.434345:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 24 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.434354:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 24 pid: 4544 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746065193.434359:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9cf100 00000100:00100000:1.0:1746065193.436697:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.436783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.436843:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263488 00000100:00100000:2.0:1746065193.436849:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263488 00000100:00100000:0.0:1746065193.436865:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260422784:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.436878:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4340 00000100:00100000:2.0:1746065193.436884:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+40:32041:x1830881263263488:12345-192.168.202.46@tcp:35:multiop.0 00010000:00010000:0.0:1746065193.436886:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->2617343] (req 2097152->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.436898:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfca00, rc 0) 00000100:00100000:0.0:1746065193.436932:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:32037:x1830881263262976:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3094us (3317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.436938:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14973 00000100:00100000:2.0:1746065193.437027:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+41:32041:x1830881263263488:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 143us (337us total) trans 8589944351 rc 0/0 00000100:00100000:2.0:1746065193.437032:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4340 00000100:00100000:3.0:1746065193.437094:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263232 00000100:00100000:3.0:1746065193.437098:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263232 00002000:00100000:3.0:1746065193.437122:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2113536->2314239) req@ffff88009f9ce300 x1830881263263232/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.437130:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce300 with x1830881263263232 ext(2113536->2314239) 00010000:00010000:3.0:1746065193.437135:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 24 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.437146:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 24 pid: 4544 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746065193.437152:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9ce300 00000100:00100000:3.0:1746065193.437165:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2572 00000100:00100000:3.0:1746065193.437171:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881263263232:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065193.440616:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263263232:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 3436us (3824us total) trans 21474840954 rc 0/0 00000100:00100000:3.0:1746065193.440626:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2572 00002000:00100000:3.0:1746065193.440636:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2113536->2314239) req@ffff88009f9ce300 x1830881263263232/t21474840954(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.440645:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9ce300 with x1830881263263232 ext(2113536->2314239) 00010000:00010000:3.0:1746065193.440653:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.440667:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00002000:00010000:3.0:1746065193.440677:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f9ce300 00000100:00100000:0.0:1746065193.442630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.442995:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263616 00000100:00100000:2.0:1746065193.443002:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263616 00010000:00010000:2.0:1746065193.443030:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.443208:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7713 00000100:00100000:2.0:1746065193.443216:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263263616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.443227:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.443246:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.443261:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.443280:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe15f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2113536->2314239) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c1 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.443303:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.443305:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.443311:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.443319:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.443346:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065193.443356:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260422912:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065193.443610:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.444856:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260422912:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065193.444870:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.444906:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263263616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1690us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.444913:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7713 00000100:00100000:0.0:1746065193.447999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.449142:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263263872 00000100:00100000:3.0:1746065193.449150:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263263872 00002000:00100000:3.0:1746065193.449441:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2613248->2617343) req@ffff88012e8b6680 x1830881263263872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.449449:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6680 with x1830881263263872 ext(2613248->2617343) 00002000:00010000:3.0:1746065193.449453:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b6680 00000100:00100000:3.0:1746065193.449508:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8469 00000100:00100000:3.0:1746065193.449517:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263263872:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065193.449673:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263263872:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 158us (1681us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065193.449679:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8469 00002000:00100000:3.0:1746065193.449684:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2613248->2617343) req@ffff88012e8b6680 x1830881263263872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.449691:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6680 with x1830881263263872 ext(2613248->2617343) 00002000:00010000:3.0:1746065193.449694:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b6680 00000100:00100000:0.0:1746065193.452339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.452491:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264128 00000100:00100000:3.0:1746065193.452499:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264128 00000100:00100000:3.0:1746065193.452546:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4341 00000100:00100000:3.0:1746065193.452554:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+287:32037:x1830881263264128:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065193.452745:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:32037:x1830881263264128:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 191us (411us total) trans 8589944352 rc 0/0 00000100:00100000:3.0:1746065193.452751:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4341 00000100:00100000:0.0:1746065193.491343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.491415:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264384 00000100:00100000:2.0:1746065193.491425:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264384 00000100:00100000:2.0:1746065193.491478:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10070 00000100:00100000:2.0:1746065193.491486:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+41:32046:x1830881263264384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.491504:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.491518:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11e00/0x14b4f8542d4fe174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615cf expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.491595:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065193.491608:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065193.491617:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065193.491625:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065193.491732:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11e00/0x14b4f8542d4fe174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 44 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.492727:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 43 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.492736:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.492739:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065193.492741:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b11c00, rc 0) 00000100:00100000:2.0:1746065193.492782:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+43:32046:x1830881263264384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1298us (1446us total) trans 8589944353 rc 0/0 00000100:00100000:2.0:1746065193.492788:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10070 00000100:00100000:0.0:1746065193.494641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.494689:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.494777:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264512 00000100:00100000:3.0:1746065193.494783:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264512 00000100:00100000:3.0:1746065193.494834:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264640 00000100:00100000:3.0:1746065193.494836:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264640 00000100:00100000:3.0:1746065193.494851:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14974 00000100:00100000:3.0:1746065193.494857:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263264512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.494871:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.494883:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe189 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615d6 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.494928:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260423040:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065193.495114:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14975 00000100:00100000:2.0:1746065193.495125:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263264640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.495131:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.495138:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe190 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615dd expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065193.495160:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260423168:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065193.495644:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5938c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.495717:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746065193.496925:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065193 -> 1746065194 00002000:00010000:3.0:1746065193.496930:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065192 -> 1746065194 00002000:00010000:3.0:1746065193.496932:0:8428:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065193 -> 1746065194 00000100:00100000:3.0:1746065193.496949:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260423040:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065193.496973:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe189 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615d6 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.496984:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe189 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615d6 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.497007:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073e00, rc 0) 00000100:00100000:3.0:1746065193.497036:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263264512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2179us (2400us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065193.497043:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14974 00002000:00010000:2.0:1746065193.497400:0:4544:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065193 -> 1746065194 00000100:00100000:2.0:1746065193.497410:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260423168:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065193.497425:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe190 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615dd expref: 26 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.497434:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe190 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615dd expref: 26 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.497442:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10a00, rc 0) 00000100:00100000:2.0:1746065193.497535:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263264640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2414us (2845us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065193.497541:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14975 00000100:00100000:0.0:1746065193.506350:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.507193:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264768 00000100:00100000:2.0:1746065193.507201:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264768 00000100:00100000:2.0:1746065193.507256:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14976 00000100:00100000:2.0:1746065193.507263:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+25:32046:x1830881263264768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.507278:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.507294:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615e4 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.507322:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.507328:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065193.507329:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065193.507333:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.507358:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.507368:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 28 pid: 8428 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.507378:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260423296:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.508087:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.509982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.510143:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260423296:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.510166:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.510182:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b11400, rc 0) 00000100:00100000:2.0:1746065193.510218:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:32046:x1830881263264768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2955us (3875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.510225:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14976 00000100:00100000:1.0:1746065193.510301:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263264896 00000100:00100000:1.0:1746065193.510306:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263264896 00002000:00100000:1.0:1746065193.510338:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (2019328->2097151) req@ffff88012e8b5500 x1830881263264896/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.510346:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5500 with x1830881263264896 ext(2019328->2097151) 00010000:00010000:1.0:1746065193.510352:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 29 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.510366:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 29 pid: 8428 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.510371:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b5500 00000100:00100000:1.0:1746065193.510903:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2573 00000100:00100000:1.0:1746065193.510911:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263264896:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065193.513884:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1960:x1830881263264896:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 2968us (3902us total) trans 21474840955 rc 0/0 00000100:00100000:1.0:1746065193.513894:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2573 00002000:00100000:1.0:1746065193.513903:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (2019328->2097151) req@ffff88012e8b5500 x1830881263264896/t21474840955(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.513912:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5500 with x1830881263264896 ext(2019328->2097151) 00010000:00010000:1.0:1746065193.513920:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.513930:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.513937:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e8b5500 00000100:00100000:0.0:1746065193.516052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.516138:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265024 00000100:00100000:2.0:1746065193.516145:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265024 00010000:00010000:2.0:1746065193.516172:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.516207:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7714 00000100:00100000:2.0:1746065193.516213:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263265024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.516224:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.516242:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.516252:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.516274:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe166 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ba expref: 31 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.516302:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.516304:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.516310:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.516318:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.516344:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 25 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065193.516355:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260423424:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065193.516427:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.520163:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260423424:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065193.520183:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.520229:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263265024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4014us (4182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.520238:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7714 00000100:00100000:0.0:1746065193.521735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.522007:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265280 00000100:00100000:1.0:1746065193.522014:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265280 00002000:00100000:1.0:1746065193.522048:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012e8b6d80 x1830881263265280/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.522057:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6d80 with x1830881263265280 ext(1048576->2097151) 00002000:00010000:1.0:1746065193.522062:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b6d80 00000100:00100000:1.0:1746065193.522089:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8470 00000100:00100000:1.0:1746065193.522095:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263265280:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065193.531010:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+26:1961:x1830881263265280:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8906us (9271us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065193.531020:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8470 00002000:00100000:1.0:1746065193.531030:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012e8b6d80 x1830881263265280/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.531039:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b6d80 with x1830881263265280 ext(1048576->2097151) 00002000:00010000:1.0:1746065193.531044:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b6d80 00000100:00100000:0.0:1746065193.536882:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.537770:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265408 00000100:00100000:2.0:1746065193.537777:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265408 00000100:00100000:2.0:1746065193.538361:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14977 00000100:00100000:2.0:1746065193.538368:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+26:32046:x1830881263265408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.538384:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.538399:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615eb expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.538423:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.538429:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065193.538431:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065193.538434:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.538460:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.538471:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 29 pid: 8428 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.538481:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260423552:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.538574:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.540437:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260423552:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.540460:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.540474:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10800, rc 0) 00000100:00100000:2.0:1746065193.540952:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+27:32046:x1830881263265408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2583us (4076us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.540960:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14977 00000100:00100000:0.0:1746065193.541528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.541864:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265536 00000100:00100000:1.0:1746065193.541870:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265536 00002000:00100000:1.0:1746065193.541902:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2617343) req@ffff880094090380 x1830881263265536/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.541910:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090380 with x1830881263265536 ext(2097152->2617343) 00010000:00010000:1.0:1746065193.541916:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 30 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.541928:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 30 pid: 8428 timeout: 892 lvb_type: 0 00002000:00010000:1.0:1746065193.541933:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094090380 00000100:00100000:1.0:1746065193.541960:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2574 00000100:00100000:1.0:1746065193.541967:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1960:x1830881263265536:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065193.555092:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881263265536:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 13117us (13556us total) trans 21474840956 rc 0/0 00000100:00100000:2.0:1746065193.555103:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2574 00002000:00100000:2.0:1746065193.555112:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->2617343) req@ffff880094090380 x1830881263265536/t21474840956(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.555120:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090380 with x1830881263265536 ext(2097152->2617343) 00010000:00010000:2.0:1746065193.555129:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 32 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.555142:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 32 pid: 8428 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746065193.555148:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094090380 00000100:00100000:0.0:1746065193.558562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.559303:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265664 00000100:00100000:3.0:1746065193.559312:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265664 00010000:00010000:3.0:1746065193.559344:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 32 pid: 8428 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.559378:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7715 00000100:00100000:3.0:1746065193.559385:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263265664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.559397:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.559417:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 32 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.559428:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 32 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.559450:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfca00/0x14b4f8542d4fe16d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615c8 expref: 32 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.560027:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.560030:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.560038:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.560046:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.560077:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.560087:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260423680:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065193.560174:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5938c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.561204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.561343:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263265920 00000100:00100000:2.0:1746065193.561349:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263265920 00000100:00100000:2.0:1746065193.561390:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10071 00000100:00100000:2.0:1746065193.561397:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+43:32048:x1830881263265920:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065193.561413:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.561425:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe1a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615f2 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.561503:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065193.561516:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 287 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.561522:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 44 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.561527:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065193.561547:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 44 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.561556:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 44 pid: 16767 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.561565:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260423808:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.561634:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 287 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.561641:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 287 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.561647:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260423936:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.561665:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.562484:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260423680:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065193.562500:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.562531:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263265664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3146us (3975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.562539:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7715 00000100:00100000:0.0:1746065193.564181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.564216:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.564274:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266048 00000100:00100000:1.0:1746065193.564279:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266048 00010000:00010000:1.0:1746065193.564303:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 45 pid: 16767 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.564533:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260423808:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.564542:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260423936:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065193.564560:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065193.564978:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266176 00000100:00100000:1.0:1746065193.564982:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266176 00010000:00010000:1.0:1746065193.564995:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 288 pid: 14644 timeout: 892 lvb_type: 0 00000100:00100000:1.0:1746065193.565697:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7716 00000100:00100000:1.0:1746065193.565706:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+45:1961:x1830881263266048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.565726:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065193.565732:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 45 pid: 16767 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.565742:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 45 pid: 16767 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.565760:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756a00/0x14b4f8542d4fe151 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615b3 expref: 45 pid: 16767 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.565776:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.565780:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.565787:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.565795:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.565847:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+44:1961:x1830881263266048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 142us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.565853:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7716 00000100:00100000:1.0:1746065193.565889:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7717 00000100:00100000:1.0:1746065193.565894:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:1961:x1830881263266176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.565900:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065193.565904:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 288 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.565911:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 288 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.565922:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10e00/0x14b4f8542d4fe12e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615ac expref: 288 pid: 14644 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.565929:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.565932:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.565938:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.565943:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.565958:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.565970:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+287:1961:x1830881263266176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.565976:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7717 00010000:00010000:1.0:1746065193.565992:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.565997:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065193.566012:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065193.566121:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11200/0x14b4f8542d4fe1a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 45 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.566132:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 44 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.566137:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.566139:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065193.566141:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10c00, rc 0) 00000100:00100000:1.0:1746065193.566161:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+44:32048:x1830881263265920:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4765us (4960us total) trans 8589944354 rc 0/0 00000100:00100000:1.0:1746065193.566166:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10071 00000100:00100000:0.0:1746065193.570107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.571020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.571128:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266560 00000100:00100000:3.0:1746065193.571136:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266560 00002000:00100000:3.0:1746065193.571173:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094090000 x1830881263266560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.571182:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090000 with x1830881263266560 ext(3145728->4194303) 00002000:00010000:3.0:1746065193.571186:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094090000 00000100:00100000:3.0:1746065193.571206:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266432 00000100:00100000:3.0:1746065193.571208:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266432 00002000:00100000:3.0:1746065193.571218:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094092d80 x1830881263266432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.571224:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094092d80 with x1830881263266432 ext(2097152->3145727) 00002000:00010000:3.0:1746065193.571227:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094092d80 00000100:00100000:3.0:1746065193.571237:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8471 00000100:00100000:2.0:1746065193.571246:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8472 00000100:00100000:3.0:1746065193.571247:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263266560:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065193.571252:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263266432:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.579214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.580587:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266816 00000100:00100000:2.0:1746065193.580597:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266816 00000100:00100000:2.0:1746065193.580655:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14978 00000100:00100000:2.0:1746065193.580662:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:32048:x1830881263266816:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065193.580677:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.580692:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e615f9 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.580725:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.580731:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.580733:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.580736:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1495040->1720319] (req 1495040->1720319) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.580760:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 32 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.580770:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 32 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.580781:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260424064:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.582742:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.585946:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881263266560:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14694us (15839us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.585957:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8471 00002000:00100000:3.0:1746065193.585968:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094090000 x1830881263266560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.585976:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090000 with x1830881263266560 ext(3145728->4194303) 00002000:00010000:3.0:1746065193.585981:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094090000 00000100:00100000:2.0:1746065193.586457:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263266432:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15203us (15436us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.586464:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8472 00002000:00100000:2.0:1746065193.586469:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094092d80 x1830881263266432/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.586475:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094092d80 with x1830881263266432 ext(2097152->3145727) 00002000:00010000:2.0:1746065193.586478:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094092d80 00000100:00100000:3.0:1746065193.586635:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260424064:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.586657:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1495040->1720319] (req 1495040->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 28 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.586670:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10a00, rc 0) 00000100:00100000:3.0:1746065193.586689:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:32048:x1830881263266816:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6029us (7483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.586695:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14978 00000100:00100000:0.0:1746065193.587572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.587632:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263266944 00000100:00100000:2.0:1746065193.587638:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263266944 00010000:00010000:2.0:1746065193.587662:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 28 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.587680:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7718 00000100:00100000:2.0:1746065193.587685:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263266944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.587694:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.587717:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 28 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.587727:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 28 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.587744:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b11400/0x14b4f8542d4fe197 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615e4 expref: 28 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.587766:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.587768:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.587773:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.587780:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.587801:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 27 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065193.587811:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260424192:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065193.587875:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.591092:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260424192:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065193.591113:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.591160:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263266944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3473us (3589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.591169:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7718 00000100:00100000:0.0:1746065193.593181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.594400:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267200 00000100:00100000:2.0:1746065193.594408:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267200 00002000:00100000:2.0:1746065193.594448:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1495040->1499135) req@ffff88008ec2f800 x1830881263267200/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.594457:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f800 with x1830881263267200 ext(1495040->1499135) 00002000:00010000:2.0:1746065193.594461:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2f800 00000100:00100000:2.0:1746065193.594540:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8473 00000100:00100000:2.0:1746065193.594547:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263267200:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065193.594690:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263267200:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 143us (1517us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065193.594696:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8473 00002000:00100000:2.0:1746065193.595760:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1495040->1499135) req@ffff88008ec2f800 x1830881263267200/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.595770:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f800 with x1830881263267200 ext(1495040->1499135) 00002000:00010000:2.0:1746065193.595773:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2f800 00000100:00100000:0.0:1746065193.597372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.597438:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267456 00000100:00100000:1.0:1746065193.597446:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267456 00000100:00100000:1.0:1746065193.597473:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10072 00000100:00100000:1.0:1746065193.597479:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+287:32051:x1830881263267456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065193.597496:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065193.597509:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428200/0x14b4f8542d4fe1c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61600 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.597657:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.597668:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.597676:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.597692:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.597698:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.597703:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.597982:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428a00/0x14b4f8542d4fe1d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.597990:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428a00/0x14b4f8542d4fe1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.597995:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428a00/0x14b4f8542d4fe1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065193.598002:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065193.598065:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.598071:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.598079:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.598084:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f428000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065193.598087:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.598093:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.598101:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065193.598104:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065193.598106:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.598111:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe1c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.599354:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.599362:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.599367:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.599371:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f428800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065193.599373:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.599378:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.599389:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801331acd00) 00010000:00010000:1.0:1746065193.599392:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065193.599394:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.599398:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe1cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.599440:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428200/0x14b4f8542d4fe1c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61600 expref: 290 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.599450:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428a00/0x14b4f8542d4fe1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61600 expref: 289 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.599456:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.599458:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065193.599460:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f428a00, rc 0) 00000100:00100000:1.0:1746065193.599512:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:32051:x1830881263267456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2031us (2142us total) trans 8589944355 rc 0/0 00000100:00100000:1.0:1746065193.599519:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10072 00000100:00100000:0.0:1746065193.600334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.600571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.601218:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267712 00000100:00100000:3.0:1746065193.601226:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267712 00002000:00100000:3.0:1746065193.601260:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008ec2fb80 x1830881263267712/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.601269:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2fb80 with x1830881263267712 ext(4194304->5013503) 00002000:00010000:3.0:1746065193.601273:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2fb80 00000100:00100000:0.0:1746065193.601546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.601639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.601808:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8474 00000100:00100000:3.0:1746065193.601833:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268096 00000100:00100000:3.0:1746065193.601836:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268096 00000100:00100000:3.0:1746065193.601854:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268224 00000100:00100000:3.0:1746065193.601856:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268224 00000100:00100000:3.0:1746065193.601868:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14979 00000100:00100000:3.0:1746065193.601878:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263268096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.601888:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.601900:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f005800/0x14b4f8542d4fe1e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61607 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.601948:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260424320:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065193.602004:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5938c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.602017:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14980 00000100:00100000:0.0:1746065193.602023:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263268224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.602030:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.602037:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6160e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.602051:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.602053:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.602059:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.602071:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.602079:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff54000, rc 0) 00000100:00100000:0.0:1746065193.602099:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263268224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 76us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.602264:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263267968 00000100:00100000:2.0:1746065193.602268:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263267968 00002000:00100000:2.0:1746065193.602283:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1716224->1720319) req@ffff88008ec2ca80 x1830881263267968/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.602289:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ca80 with x1830881263267968 ext(1716224->1720319) 00002000:00010000:2.0:1746065193.602293:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2ca80 00000100:00100000:2.0:1746065193.602306:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8475 00000100:00100000:2.0:1746065193.602310:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263267968:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065193.602407:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263267968:12345-192.168.202.46@tcp:3:cat.0 Request processed in 96us (1837us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065193.602413:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8475 00002000:00100000:2.0:1746065193.602417:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1716224->1720319) req@ffff88008ec2ca80 x1830881263267968/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.602423:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ca80 with x1830881263267968 ext(1716224->1720319) 00002000:00010000:2.0:1746065193.602425:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2ca80 00000100:00100000:2.0:1746065193.602457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.602471:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268352 00000100:00100000:2.0:1746065193.602473:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268352 00000100:00100000:2.0:1746065193.602491:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 791 00000100:00100000:2.0:1746065193.602495:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:1961:x1830881263268352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.602502:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.602515:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428a00/0x14b4f8542d4fe1d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61600 expref: 289 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.602528:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.602531:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.602542:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:1961:x1830881263268352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.602546:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 791 00000100:00100000:0.0:1746065193.602656:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14980 00000100:00100000:3.0:1746065193.602955:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263267712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065193.608523:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260424320:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065193.608551:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f005800/0x14b4f8542d4fe1e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61607 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.608562:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f005800/0x14b4f8542d4fe1e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61607 expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.609464:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f005800, rc 0) 00000100:00100000:3.0:1746065193.609678:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263268096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7803us (8131us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065193.609685:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14979 00000100:00100000:3.0:1746065193.612600:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1960:x1830881263267712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10775us (12259us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065193.612610:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8474 00002000:00100000:3.0:1746065193.612621:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88008ec2fb80 x1830881263267712/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.612629:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2fb80 with x1830881263267712 ext(4194304->5013503) 00002000:00010000:3.0:1746065193.612635:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec2fb80 00000100:00100000:0.0:1746065193.616092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.616196:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268480 00000100:00100000:3.0:1746065193.616203:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268480 00000100:00100000:3.0:1746065193.616248:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14981 00000100:00100000:3.0:1746065193.616256:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:32051:x1830881263268480:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.616269:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.616283:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61615 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.616306:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.616313:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065193.616315:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065193.616318:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.616341:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 26 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.616352:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 26 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.616363:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260424448:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.616447:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.620070:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.620143:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260424448:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.620167:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.620181:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f005c00, rc 0) 00000100:00100000:3.0:1746065193.620233:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:32051:x1830881263268480:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3977us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.620240:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14981 00000100:00100000:2.0:1746065193.621340:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268608 00000100:00100000:2.0:1746065193.621348:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268608 00002000:00100000:2.0:1746065193.621381:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1495040->1720319) req@ffff88009fb10380 x1830881263268608/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.621389:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881263268608 ext(1495040->1720319) 00010000:00010000:2.0:1746065193.621396:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 27 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.621408:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 27 pid: 4544 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746065193.621414:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb10380 00000100:00100000:2.0:1746065193.621444:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2575 00000100:00100000:2.0:1746065193.621452:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+27:1961:x1830881263268608:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065193.626546:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263268608:12345-192.168.202.46@tcp:4:cat.0 Request processed in 5086us (6475us total) trans 21474840957 rc 0/0 00000100:00100000:2.0:1746065193.626556:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2575 00002000:00100000:2.0:1746065193.626566:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1495040->1720319) req@ffff88009fb10380 x1830881263268608/t21474840957(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.626575:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb10380 with x1830881263268608 ext(1495040->1720319) 00010000:00010000:2.0:1746065193.626583:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 29 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.626594:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 29 pid: 4544 timeout: 892 lvb_type: 0 00002000:00010000:2.0:1746065193.626600:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb10380 00000100:00100000:0.0:1746065193.628572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.628651:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268736 00000100:00100000:2.0:1746065193.628657:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268736 00010000:00010000:2.0:1746065193.628683:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 29 pid: 4544 timeout: 892 lvb_type: 0 00000100:00100000:2.0:1746065193.628726:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7719 00000100:00100000:2.0:1746065193.628733:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263268736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.628744:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.628773:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 29 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.628788:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 29 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.628808:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe1ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1720319) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f9 expref: 29 pid: 4544 timeout: 892 lvb_type: 0 00010000:00010000:2.0:1746065193.628847:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.628849:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.628856:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.628863:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.629047:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.629060:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260424576:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065193.629136:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.630268:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260424576:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065193.630282:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.630302:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263268736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1570us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.630309:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7719 00000100:00100000:0.0:1746065193.632242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.632297:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263268992 00000100:00100000:2.0:1746065193.632303:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263268992 00002000:00100000:2.0:1746065193.632421:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88008fd05c00 x1830881263268992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.632428:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05c00 with x1830881263268992 ext(1048576->2097151) 00002000:00010000:2.0:1746065193.632432:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05c00 00000100:00100000:2.0:1746065193.632452:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8476 00000100:00100000:2.0:1746065193.632460:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263268992:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065193.637941:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263268992:12345-192.168.202.46@tcp:3:cat.0 Request processed in 5475us (5695us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.637950:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8476 00002000:00100000:2.0:1746065193.637961:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88008fd05c00 x1830881263268992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.637969:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05c00 with x1830881263268992 ext(1048576->2097151) 00002000:00010000:2.0:1746065193.637973:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05c00 00000100:00100000:0.0:1746065193.648145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.648189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.648370:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263269376 00000100:00100000:3.0:1746065193.648377:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263269376 00002000:00100000:3.0:1746065193.648410:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd04000 x1830881263269376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.648419:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04000 with x1830881263269376 ext(3145728->4194303) 00002000:00010000:3.0:1746065193.648424:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04000 00000100:00100000:2.0:1746065193.648528:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263269248 00000100:00100000:2.0:1746065193.648533:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263269248 00000100:00100000:3.0:1746065193.648534:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8477 00000100:00100000:3.0:1746065193.648541:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263269376:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:2.0:1746065193.648551:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88008fd07480 x1830881263269248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.648558:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07480 with x1830881263269248 ext(2097152->3145727) 00002000:00010000:2.0:1746065193.648561:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd07480 00000100:00100000:2.0:1746065193.648579:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8478 00000100:00100000:2.0:1746065193.648584:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263269248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065193.668146:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263269376:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19532us (19935us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.668157:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8477 00002000:00100000:3.0:1746065193.668168:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88008fd04000 x1830881263269376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.668176:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04000 with x1830881263269376 ext(3145728->4194303) 00002000:00010000:3.0:1746065193.668181:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd04000 00000100:00100000:2.0:1746065193.668433:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263269248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19846us (20241us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.668440:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8478 00002000:00100000:2.0:1746065193.668445:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88008fd07480 x1830881263269248/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.668452:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd07480 with x1830881263269248 ext(2097152->3145727) 00002000:00010000:2.0:1746065193.668454:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd07480 00000100:00100000:0.0:1746065193.673335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.673490:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263269760 00000100:00100000:1.0:1746065193.673498:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263269760 00000100:00100000:1.0:1746065193.673531:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10073 00000100:00100000:1.0:1746065193.673538:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+288:32056:x1830881263269760:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065193.673556:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065193.673569:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe1f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6161c expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.673654:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673664:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673672:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673682:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673687:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673692:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673787:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429a00/0x14b4f8542d4fe20e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673794:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429a00/0x14b4f8542d4fe20e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673799:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429a00/0x14b4f8542d4fe20e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065193.673806:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065193.673887:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673893:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673901:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673905:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f429400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065193.673908:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673913:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673921:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065193.673923:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065193.673926:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673930:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe200 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673957:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673962:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673966:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673970:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f429800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065193.673972:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673980:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673989:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801331acd00) 00010000:00010000:1.0:1746065193.673991:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065193.673994:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.673998:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe207 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.674025:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe1f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6161c expref: 291 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.674034:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429a00/0x14b4f8542d4fe20e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6161c expref: 290 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.674040:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.674042:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065193.674044:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f429a00, rc 0) 00000100:00100000:1.0:1746065193.674093:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+290:32056:x1830881263269760:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 555us (766us total) trans 8589944356 rc 0/0 00000100:00100000:1.0:1746065193.674099:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10073 00000100:00100000:0.0:1746065193.678324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.678484:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263269888 00000100:00100000:3.0:1746065193.678492:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263269888 00000100:00100000:3.0:1746065193.678554:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 792 00000100:00100000:3.0:1746065193.678562:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+290:1960:x1830881263269888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.678575:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.678596:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429a00/0x14b4f8542d4fe20e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6161c expref: 290 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.678629:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:3.0:1746065193.678633:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065193.678671:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:1960:x1830881263269888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.678677:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 792 00000100:00100000:0.0:1746065193.678763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.678795:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270144 00000100:00100000:0.0:1746065193.678798:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270144 00002000:00100000:0.0:1746065193.678843:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d94a80 x1830881263270144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.678852:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94a80 with x1830881263270144 ext(4194304->5013503) 00002000:00010000:0.0:1746065193.678856:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94a80 00000100:00100000:0.0:1746065193.678867:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8479 00000100:00100000:0.0:1746065193.678873:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263270144:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.684337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.685331:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270272 00000100:00100000:3.0:1746065193.685340:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270272 00000100:00100000:3.0:1746065193.685395:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14982 00000100:00100000:3.0:1746065193.685404:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:32056:x1830881263270272:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065193.685422:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.685438:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61623 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.685463:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 36 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.685470:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.685472:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.685474:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1527808->1724415] (req 1527808->1724415) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 36 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.685499:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 36 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.685510:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 36 pid: 8428 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.685521:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260424704:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.685621:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7af00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065193.688637:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263270144:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9755us (9864us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065193.688650:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8479 00002000:00100000:1.0:1746065193.688666:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d94a80 x1830881263270144/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.688675:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94a80 with x1830881263270144 ext(4194304->5013503) 00002000:00010000:1.0:1746065193.688680:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d94a80 00000100:00100000:3.0:1746065193.689022:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260424704:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.689047:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1527808->1724415] (req 1527808->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.689062:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0072200, rc 0) 00000100:00100000:3.0:1746065193.689099:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32056:x1830881263270272:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3696us (4771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.689107:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14982 00000100:00100000:2.0:1746065193.694038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.694139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.694189:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270400 00000100:00100000:1.0:1746065193.694198:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270400 00000100:00100000:3.0:1746065193.694204:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270528 00000100:00100000:3.0:1746065193.694207:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270528 00010000:00010000:1.0:1746065193.694227:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 35 pid: 8428 timeout: 892 lvb_type: 0 00000100:00100000:3.0:1746065193.694231:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14983 00000100:00100000:3.0:1746065193.694242:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263270528:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065193.694254:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7720 00010000:00010000:3.0:1746065193.694255:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065193.694259:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263270400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065193.694266:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fe223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6162a expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.694268:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065193.694280:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.694286:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 36 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.694289:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fe223 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6162a expref: 36 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065193.694295:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 36 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:3.0:1746065193.694569:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072600/0x14b4f8542d4fe223 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6162a expref: 36 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065193.694584:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f005c00/0x14b4f8542d4fe1f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61615 expref: 35 pid: 8428 timeout: 892 lvb_type: 0 00010000:00010000:1.0:1746065193.694604:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.694606:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.694612:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.694619:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.694647:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.694663:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260424832:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065193.695092:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0072600, rc 0) 00000100:00100000:1.0:1746065193.695165:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.695237:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263270528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 997us (1096us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065193.695243:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14983 00000100:00100000:1.0:1746065193.697886:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260424832:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065193.697906:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.698669:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263270400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4405us (4634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.698775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.698948:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263270784 00000100:00100000:2.0:1746065193.698954:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263270784 00002000:00100000:2.0:1746065193.698988:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1527808->1531903) req@ffff880094d96a00 x1830881263270784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.699002:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96a00 with x1830881263270784 ext(1527808->1531903) 00002000:00010000:2.0:1746065193.699006:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d96a00 00000100:00100000:2.0:1746065193.699024:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8480 00000100:00100000:2.0:1746065193.699031:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263270784:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065193.699109:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7720 00000100:00100000:2.0:1746065193.699157:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263270784:12345-192.168.202.46@tcp:3:cat.0 Request processed in 126us (382us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065193.699162:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8480 00002000:00100000:2.0:1746065193.699167:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1527808->1531903) req@ffff880094d96a00 x1830881263270784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.699173:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96a00 with x1830881263270784 ext(1527808->1531903) 00002000:00010000:2.0:1746065193.699176:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d96a00 00000100:00100000:2.0:1746065193.700238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.700299:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271040 00000100:00100000:3.0:1746065193.700305:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271040 00000100:00100000:3.0:1746065193.700342:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4342 00000100:00100000:3.0:1746065193.700349:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+289:32051:x1830881263271040:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065193.700512:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+290:32051:x1830881263271040:12345-192.168.202.46@tcp:35:cat.0 Request processed in 163us (276us total) trans 8589944357 rc 0/0 00000100:00100000:3.0:1746065193.700520:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4342 00000100:00100000:0.0:1746065193.701614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.701901:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271296 00000100:00100000:2.0:1746065193.701906:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271296 00002000:00100000:2.0:1746065193.701932:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1720320->1724415) req@ffff880094d97800 x1830881263271296/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.701941:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97800 with x1830881263271296 ext(1720320->1724415) 00002000:00010000:2.0:1746065193.701946:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97800 00000100:00100000:2.0:1746065193.701960:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8481 00000100:00100000:2.0:1746065193.701966:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263271296:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065193.702102:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263271296:12345-192.168.202.46@tcp:3:cat.0 Request processed in 135us (489us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065193.702108:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8481 00002000:00100000:2.0:1746065193.702114:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1720320->1724415) req@ffff880094d97800 x1830881263271296/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.702121:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97800 with x1830881263271296 ext(1720320->1724415) 00002000:00010000:2.0:1746065193.702123:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97800 00000100:00100000:0.0:1746065193.704496:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.705069:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271552 00000100:00100000:2.0:1746065193.705077:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271552 00000100:00100000:2.0:1746065193.705122:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4343 00000100:00100000:2.0:1746065193.705129:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+290:32056:x1830881263271552:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065193.705395:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+291:32056:x1830881263271552:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 266us (904us total) trans 8589944358 rc 0/0 00000100:00100000:2.0:1746065193.705402:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4343 00000100:00100000:0.0:1746065193.724417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.725263:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271680 00000100:00100000:3.0:1746065193.725273:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271680 00000100:00100000:3.0:1746065193.725314:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14984 00000100:00100000:3.0:1746065193.725320:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:32060:x1830881263271680:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065193.725334:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.725346:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61631 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.725370:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.725377:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 36 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.725383:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.725384:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.725387:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.725408:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 36 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.725415:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 36 pid: 4544 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065193.725423:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260424960:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.726364:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 23 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.726376:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 23 pid: 4544 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065193.726386:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260425088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.727459:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.727496:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260424960:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065193.729609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.729665:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271808 00000100:00100000:1.0:1746065193.729672:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271808 00010000:00010000:1.0:1746065193.729704:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 37 pid: 4544 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065193.729756:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7721 00000100:00100000:1.0:1746065193.729763:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5be4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263271808:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.729776:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065193.729794:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 37 pid: 4544 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.729804:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 37 pid: 4544 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065193.729837:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260425088:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065193.729845:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe10b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6159e expref: 37 pid: 4544 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065193.729861:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 23 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.729864:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065193.729869:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073a00, rc 0) 00000100:00100000:1.0:1746065193.729899:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5be4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263271808:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 137us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.729905:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7721 00000100:00100000:3.0:1746065193.730041:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:32060:x1830881263271680:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4719us (5632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.730047:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14984 00000100:00100000:0.0:1746065193.731045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.731117:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263271936 00000100:00100000:1.0:1746065193.731121:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263271936 00010000:00010000:1.0:1746065193.731139:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 23 pid: 4544 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065193.731640:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7722 00000100:00100000:1.0:1746065193.731644:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263271936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.731652:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065193.731666:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 23 pid: 4544 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.731673:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 23 pid: 4544 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.731688:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc800/0x14b4f8542d4fe104 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61597 expref: 23 pid: 4544 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.731698:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.731699:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.731705:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.731728:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.731757:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.731767:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260425216:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065193.732504:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065193.736581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.736663:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260425216:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065193.736681:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.736970:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272192 00000100:00100000:0.0:1746065193.736977:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272192 00002000:00100000:0.0:1746065193.737012:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3117056->3121151) req@ffff880094090e00 x1830881263272192/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.737019:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090e00 with x1830881263272192 ext(3117056->3121151) 00002000:00010000:0.0:1746065193.737024:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094090e00 00000100:00100000:2.0:1746065193.737089:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263271936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5442us (6044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.737099:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7722 00000100:00100000:3.0:1746065193.737355:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8482 00000100:00100000:3.0:1746065193.737365:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263272192:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065193.737518:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263272192:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 154us (944us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065193.737524:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8482 00002000:00100000:3.0:1746065193.737529:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3117056->3121151) req@ffff880094090e00 x1830881263272192/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.737541:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094090e00 with x1830881263272192 ext(3117056->3121151) 00002000:00010000:3.0:1746065193.737544:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094090e00 00000100:00100000:0.0:1746065193.739088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.739129:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272320 00000100:00100000:3.0:1746065193.739135:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272320 00000100:00100000:3.0:1746065193.739171:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14985 00000100:00100000:3.0:1746065193.739177:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:32060:x1830881263272320:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065193.739190:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.739204:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61638 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.739226:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.739234:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 32 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.739240:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.739242:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.739245:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->3239935] (req 3145728->3239935) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.739268:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 32 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.739277:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 32 pid: 25185 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746065193.739291:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260425344:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.739367:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 29 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.739373:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 29 pid: 4544 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065193.739380:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260425472:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.739397:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.741174:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260425344:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.741537:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260425472:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.741568:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->3239935] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.741584:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0072400, rc 0) 00000100:00100000:3.0:1746065193.741631:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:32060:x1830881263272320:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2453us (2547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.741638:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14985 00000100:00100000:0.0:1746065193.745025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.745147:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272448 00000100:00100000:2.0:1746065193.745154:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272448 00010000:00010000:2.0:1746065193.745182:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 29 pid: 4544 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065193.745205:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7723 00000100:00100000:2.0:1746065193.745211:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881263272448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.745223:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.745242:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 29 pid: 4544 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065193.745251:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 29 pid: 4544 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065193.745270:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b10800/0x14b4f8542d4fe19e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615eb expref: 29 pid: 4544 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065193.745300:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.745336:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263272448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 124us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.745341:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7723 00000100:00100000:0.0:1746065193.747461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.747514:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272576 00000100:00100000:2.0:1746065193.747522:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272576 00010000:00010000:2.0:1746065193.747549:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 33 pid: 25185 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746065193.747580:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7724 00000100:00100000:2.0:1746065193.747588:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263272576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.747599:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.747617:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 33 pid: 25185 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746065193.747627:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 33 pid: 25185 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746065193.747644:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54000/0x14b4f8542d4fe1eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6160e expref: 33 pid: 25185 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746065193.747656:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.747658:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065193.747663:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.747671:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.747700:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 27 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065193.747724:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260425600:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065193.747809:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.749959:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260425600:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065193.749976:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065193.750006:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1960:x1830881263272576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2419us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.750014:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7724 00000100:00100000:0.0:1746065193.751881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.752130:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263272832 00000100:00100000:3.0:1746065193.752137:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263272832 00002000:00100000:3.0:1746065193.752175:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3235840->3239935) req@ffff880094d95880 x1830881263272832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.752184:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95880 with x1830881263272832 ext(3235840->3239935) 00002000:00010000:3.0:1746065193.752189:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95880 00000100:00100000:3.0:1746065193.752215:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8483 00000100:00100000:3.0:1746065193.752222:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263272832:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065193.752404:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1960:x1830881263272832:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 182us (530us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065193.752411:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8483 00002000:00100000:3.0:1746065193.752420:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3235840->3239935) req@ffff880094d95880 x1830881263272832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.752426:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95880 with x1830881263272832 ext(3235840->3239935) 00002000:00010000:3.0:1746065193.752429:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95880 00000100:00100000:0.0:1746065193.834585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.834683:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273088 00000100:00100000:2.0:1746065193.834690:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273088 00000100:00100000:2.0:1746065193.834789:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10074 00000100:00100000:2.0:1746065193.834797:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+291:32063:x1830881263273088:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065193.834919:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.834935:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6163f expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.835042:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835053:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835064:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835076:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835081:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835086:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835169:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe24d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835177:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe24d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835182:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe24d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065193.835189:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065193.835254:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835260:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835270:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835275:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129cf7200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065193.835279:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835284:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835292:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065193.835294:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065193.835297:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835302:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe23f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835314:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835319:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835323:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835327:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065193.835329:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835334:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835342:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49ff00) 00010000:00010000:2.0:1746065193.835344:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065193.835345:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835349:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe246 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.835380:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6163f expref: 294 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.835390:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe24d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6163f expref: 293 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.835395:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.835397:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065193.835399:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9200, rc 0) 00000100:00100000:2.0:1746065193.835438:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+293:32063:x1830881263273088:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 642us (861us total) trans 8589944359 rc 0/0 00000100:00100000:2.0:1746065193.835443:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10074 00000100:00100000:0.0:1746065193.837958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.838084:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273216 00000100:00100000:2.0:1746065193.838091:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273216 00000100:00100000:2.0:1746065193.838129:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 793 00000100:00100000:2.0:1746065193.838135:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+293:1959:x1830881263273216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.838145:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.838161:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe24d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6163f expref: 293 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.838465:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.838468:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.838918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.839564:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+292:1959:x1830881263273216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1426us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.839574:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 793 00000100:00100000:3.0:1746065193.840649:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273344 00000100:00100000:3.0:1746065193.840656:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273344 00000100:00100000:3.0:1746065193.840687:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14986 00000100:00100000:3.0:1746065193.840693:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:32063:x1830881263273344:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065193.840717:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.840731:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61646 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.840751:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 37 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.840759:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.840766:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.840768:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065193.840771:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1142784->1200127] (req 1142784->1200127) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 37 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.840795:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 21 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.840805:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 21 pid: 8429 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746065193.840852:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260425728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.840936:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 37 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.840944:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 37 pid: 8428 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746065193.840951:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260425856:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.840968:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.844460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.844568:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260425728:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.844578:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260425856:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.844603:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1142784->1200127] (req 1142784->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 37 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.844619:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073e00, rc 0) 00000100:00100000:2.0:1746065193.844654:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273472 00000100:00100000:3.0:1746065193.844658:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:32063:x1830881263273344:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3965us (5741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065193.844659:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273472 00000100:00100000:3.0:1746065193.844666:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14986 00000100:00100000:3.0:1746065193.844683:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14987 00000100:00100000:3.0:1746065193.844688:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263273472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.844700:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.844728:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fe262 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6164d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.844762:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260425984:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065193.844803:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.847766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.847809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.847879:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273728 00000100:00100000:1.0:1746065193.847887:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273728 00000100:00100000:2.0:1746065193.847896:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273600 00000100:00100000:2.0:1746065193.847899:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273600 00010000:00010000:2.0:1746065193.847917:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 22 pid: 8429 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746065193.847917:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 37 pid: 8428 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746065193.847940:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7725 00000100:00100000:2.0:1746065193.847946:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:1959:x1830881263273600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065193.847957:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.847979:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 22 pid: 8429 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746065193.847983:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7726 00010000:00010000:2.0:1746065193.847989:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 22 pid: 8429 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746065193.847989:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263273728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.847997:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065193.848007:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe0cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6155f expref: 22 pid: 8429 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746065193.848011:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 37 pid: 8428 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746065193.848021:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 37 pid: 8428 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746065193.848030:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065193.848036:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b10200/0x14b4f8542d4fe04e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6152e expref: 37 pid: 8428 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746065193.848059:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:1959:x1830881263273600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 113us (250us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065193.848063:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065193.848065:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7725 00010000:00010000:1.0:1746065193.848065:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.848070:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.848077:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.848102:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.848111:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260426112:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065193.848184:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.851296:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260425984:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065193.851323:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fe262 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6164d expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.851337:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072000/0x14b4f8542d4fe262 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6164d expref: 29 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.851350:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0072000, rc 0) 00000100:00100000:3.0:1746065193.851399:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:1961:x1830881263273472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6709us (6945us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065193.851406:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14987 00000100:00100000:1.0:1746065193.852329:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260426112:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065193.852342:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.852365:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263273728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4375us (4606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.852372:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7726 00000100:00100000:0.0:1746065193.853257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.853329:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263273984 00000100:00100000:3.0:1746065193.853334:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263273984 00002000:00100000:3.0:1746065193.853366:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1142784->1146879) req@ffff88012e8b7b80 x1830881263273984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.853378:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7b80 with x1830881263273984 ext(1142784->1146879) 00002000:00010000:3.0:1746065193.853381:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b7b80 00000100:00100000:3.0:1746065193.853476:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8484 00000100:00100000:3.0:1746065193.853483:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881263273984:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065193.853797:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881263273984:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 313us (540us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065193.853803:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8484 00002000:00100000:3.0:1746065193.853808:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1142784->1146879) req@ffff88012e8b7b80 x1830881263273984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.853841:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7b80 with x1830881263273984 ext(1142784->1146879) 00002000:00010000:3.0:1746065193.853844:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b7b80 00000100:00100000:0.0:1746065193.857996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.858050:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274112 00000100:00100000:3.0:1746065193.858057:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274112 00000100:00100000:0.0:1746065193.858066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.858102:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274368 00000100:00100000:2.0:1746065193.858107:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274368 00002000:00100000:2.0:1746065193.858137:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1196032->1200127) req@ffff88012e8b7480 x1830881263274368/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.858146:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7480 with x1830881263274368 ext(1196032->1200127) 00002000:00010000:2.0:1746065193.858150:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e8b7480 00000100:00100000:2.0:1746065193.858203:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8485 00000100:00100000:2.0:1746065193.858210:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263274368:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065193.858356:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14988 00000100:00100000:3.0:1746065193.858360:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+21:32066:x1830881263274112:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.858369:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.858384:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61654 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.858407:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.858413:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065193.858414:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065193.858418:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.858441:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.858451:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065193.858461:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260426240:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065193.858956:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1958:x1830881263274368:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 744us (887us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065193.858962:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8485 00002000:00100000:2.0:1746065193.858967:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1196032->1200127) req@ffff88012e8b7480 x1830881263274368/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.858974:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b7480 with x1830881263274368 ext(1196032->1200127) 00010000:00010000:2.0:1746065193.858978:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065193.858988:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746065193.858992:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e8b7480 00000100:00100000:3.0:1746065193.859163:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.861874:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260426240:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.861902:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.861916:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073800, rc 0) 00000100:00100000:3.0:1746065193.861957:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+22:32066:x1830881263274112:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3595us (3967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.861964:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14988 00000100:00100000:0.0:1746065193.862153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.862279:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274624 00000100:00100000:3.0:1746065193.862284:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274624 00002000:00100000:3.0:1746065193.862310:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1142784->1200127) req@ffff88012e8b5f80 x1830881263274624/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.862318:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5f80 with x1830881263274624 ext(1142784->1200127) 00010000:00010000:3.0:1746065193.862324:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065193.862344:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 36 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746065193.862350:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e8b5f80 00000100:00100000:3.0:1746065193.862376:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2576 00000100:00100000:3.0:1746065193.862382:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263274624:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065193.863672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.863806:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263274880 00000100:00100000:2.0:1746065193.863812:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263274880 00000100:00100000:2.0:1746065193.863865:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4344 00000100:00100000:2.0:1746065193.863871:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b879050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+292:32063:x1830881263274880:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065193.864026:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b879050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+293:32063:x1830881263274880:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 156us (358us total) trans 8589944360 rc 0/0 00000100:00100000:2.0:1746065193.864032:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4344 00000100:00100000:3.0:1746065193.865363:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1959:x1830881263274624:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 2979us (3209us total) trans 17179873672 rc 0/0 00000100:00100000:3.0:1746065193.865370:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2576 00002000:00100000:3.0:1746065193.865378:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1142784->1200127) req@ffff88012e8b5f80 x1830881263274624/t17179873672(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.865385:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b5f80 with x1830881263274624 ext(1142784->1200127) 00010000:00010000:3.0:1746065193.865392:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 38 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065193.865403:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 38 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746065193.865408:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e8b5f80 00000100:00100000:0.0:1746065193.868211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.868295:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275008 00000100:00100000:1.0:1746065193.868304:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275008 00010000:00010000:1.0:1746065193.868331:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 38 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065193.868355:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7727 00000100:00100000:1.0:1746065193.868361:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263275008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.868374:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065193.868389:0:7079:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065191 -> 1746065194 00002000:00010000:1.0:1746065193.868392:0:7079:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065191 -> 1746065194 00010000:00010000:1.0:1746065193.868534:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 38 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.868545:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 38 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.868563:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073e00/0x14b4f8542d4fe25b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1200127) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61646 expref: 38 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.868638:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.868640:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.868647:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.868655:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.868683:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.868693:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260426368:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065193.869577:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065193.872304:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260426368:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065193.872323:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.872358:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263275008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3996us (4156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.872367:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7727 00000100:00100000:0.0:1746065193.875171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.875471:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275392 00000100:00100000:3.0:1746065193.875478:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275392 00002000:00100000:3.0:1746065193.875512:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3125248->3129343) req@ffff88012e8b4700 x1830881263275392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.875520:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4700 with x1830881263275392 ext(3125248->3129343) 00002000:00010000:3.0:1746065193.875524:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4700 00000100:00100000:3.0:1746065193.875553:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8486 00000100:00100000:3.0:1746065193.875560:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263275392:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065193.875688:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263275392:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 128us (522us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065193.875694:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8486 00002000:00100000:3.0:1746065193.875699:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3125248->3129343) req@ffff88012e8b4700 x1830881263275392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.875705:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e8b4700 with x1830881263275392 ext(3125248->3129343) 00002000:00010000:3.0:1746065193.875717:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e8b4700 00000100:00100000:0.0:1746065193.878429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.878648:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275520 00000100:00100000:1.0:1746065193.878656:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275520 00002000:00100000:1.0:1746065193.878695:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880130445880 x1830881263275520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.878703:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445880 with x1830881263275520 ext(1048576->2097151) 00002000:00010000:1.0:1746065193.878715:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130445880 00000100:00100000:1.0:1746065193.878741:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8487 00000100:00100000:1.0:1746065193.878747:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263275520:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065193.882680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.882865:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275776 00000100:00100000:3.0:1746065193.882872:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275776 00002000:00100000:3.0:1746065193.882969:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3137536->3141631) req@ffff880130445c00 x1830881263275776/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.882977:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445c00 with x1830881263275776 ext(3137536->3141631) 00002000:00010000:3.0:1746065193.882982:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130445c00 00000100:00100000:3.0:1746065193.883387:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8488 00000100:00100000:3.0:1746065193.883407:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263275776:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065193.884287:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+28:1959:x1830881263275776:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 890us (1612us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065193.884295:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8488 00002000:00100000:3.0:1746065193.884301:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3137536->3141631) req@ffff880130445c00 x1830881263275776/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/4536 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.884313:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445c00 with x1830881263275776 ext(3137536->3141631) 00002000:00010000:3.0:1746065193.884317:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130445c00 00000100:00100000:1.0:1746065193.887790:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263275520:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 9033us (9358us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065193.888223:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8487 00002000:00100000:1.0:1746065193.888239:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880130445880 x1830881263275520/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.888249:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445880 with x1830881263275520 ext(1048576->2097151) 00002000:00010000:1.0:1746065193.888255:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130445880 00000100:00100000:0.0:1746065193.895469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.896690:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263275904 00000100:00100000:3.0:1746065193.896699:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263275904 00000100:00100000:3.0:1746065193.896808:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14989 00000100:00100000:3.0:1746065193.896830:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+28:32066:x1830881263275904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.896845:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.896861:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6165b expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.896886:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.896892:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065193.896894:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065193.896897:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.896922:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 31 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.896932:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 31 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065193.896942:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260426496:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065193.897698:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7a780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065193.900699:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260426496:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065193.900733:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 29 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065193.900748:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0073400, rc 0) 00000100:00100000:3.0:1746065193.900784:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:32066:x1830881263275904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3969us (5322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065193.900792:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14989 00000100:00100000:0.0:1746065193.901101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.901559:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276032 00000100:00100000:2.0:1746065193.901565:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276032 00002000:00100000:2.0:1746065193.901596:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1527808->1724415) req@ffff880130447800 x1830881263276032/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.901604:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447800 with x1830881263276032 ext(1527808->1724415) 00010000:00010000:2.0:1746065193.901611:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 32 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065193.901623:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 32 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746065193.901630:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130447800 00000100:00100000:2.0:1746065193.901656:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2577 00000100:00100000:2.0:1746065193.901662:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263276032:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065193.905758:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263276032:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 4087us (4648us total) trans 21474840958 rc 0/0 00000100:00100000:2.0:1746065193.905769:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2577 00002000:00100000:2.0:1746065193.905779:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1527808->1724415) req@ffff880130447800 x1830881263276032/t21474840958(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.905788:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130447800 with x1830881263276032 ext(1527808->1724415) 00010000:00010000:2.0:1746065193.905797:0:8433:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065193.905812:0:8433:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746065193.905842:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130447800 00000100:00100000:0.0:1746065193.908043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.908110:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276160 00000100:00100000:1.0:1746065193.908118:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276160 00010000:00010000:1.0:1746065193.908147:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065193.908183:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7728 00000100:00100000:1.0:1746065193.908191:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263276160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.908202:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065193.908222:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.908232:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.908251:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072200/0x14b4f8542d4fe21c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1724415) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61623 expref: 34 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065193.908279:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.908281:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065193.908287:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.908294:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.908322:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.908332:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260426624:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065193.908408:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065193.910798:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260426624:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065193.910841:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.910876:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263276160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2684us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.910886:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7728 00000100:00100000:0.0:1746065193.915873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.915959:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276416 00000100:00100000:2.0:1746065193.915967:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276416 00002000:00100000:2.0:1746065193.916002:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880130445180 x1830881263276416/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.916011:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445180 with x1830881263276416 ext(1048576->2097151) 00002000:00010000:2.0:1746065193.916016:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130445180 00000100:00100000:2.0:1746065193.916044:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8489 00000100:00100000:2.0:1746065193.916050:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881263276416:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065193.921911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.922237:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276672 00000100:00100000:2.0:1746065193.922248:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276672 00000100:00100000:2.0:1746065193.922291:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10075 00000100:00100000:2.0:1746065193.922298:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+293:32074:x1830881263276672:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.922319:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065193.922334:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61662 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.922430:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922441:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922452:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922464:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922468:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922472:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922562:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fe28c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922569:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fe28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922575:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fe28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065193.922582:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065193.922645:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922651:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922655:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922661:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129cf6000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065193.922664:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922669:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922678:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065193.922681:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065193.922684:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922688:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe27e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922703:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922718:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922722:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922726:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129cf7200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065193.922728:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922731:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922737:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f49f500) 00010000:00010000:2.0:1746065193.922738:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065193.922740:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922744:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe285 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065193.922779:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61662 expref: 296 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.922789:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fe28c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61662 expref: 295 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.922795:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065193.922797:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065193.922799:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf6a00, rc 0) 00000100:00100000:2.0:1746065193.922862:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:32074:x1830881263276672:12345-192.168.202.46@tcp:101:cat.0 Request processed in 564us (957us total) trans 8589944361 rc 0/0 00000100:00100000:2.0:1746065193.922867:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10075 00000100:00100000:2.0:1746065193.924146:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+29:1960:x1830881263276416:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8091us (8276us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.924153:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8489 00002000:00100000:2.0:1746065193.924160:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880130445180 x1830881263276416/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.924169:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130445180 with x1830881263276416 ext(1048576->2097151) 00002000:00010000:2.0:1746065193.924173:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130445180 00000100:00100000:0.0:1746065193.925283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.925583:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276800 00000100:00100000:0.0:1746065193.925587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.925590:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276800 00000100:00100000:0.0:1746065193.925616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.925633:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263276928 00000100:00100000:0.0:1746065193.925635:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263276928 00000100:00100000:0.0:1746065193.925674:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277184 00000100:00100000:0.0:1746065193.925676:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277184 00000100:00100000:0.0:1746065193.925690:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14990 00000100:00100000:0.0:1746065193.925697:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263276928:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065193.925698:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14991 00000100:00100000:2.0:1746065193.925703:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263277184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.925723:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.925723:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.925736:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61669 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065193.925738:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe2a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61677 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.925755:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.925757:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.925764:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 38 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.925777:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 38 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.925787:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b11000, rc 0) 00000100:00100000:1.0:1746065193.925801:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 794 00000100:00100000:1.0:1746065193.925806:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:1961:x1830881263276800:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.925846:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065193.925846:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263276928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 150us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.925851:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14990 00010000:00010000:1.0:1746065193.925864:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fe28c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61662 expref: 295 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.925882:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.925886:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.925888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.925899:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277056 00000100:00100000:1.0:1746065193.925901:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+294:1961:x1830881263276800:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.925902:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277056 00000100:00100000:1.0:1746065193.925906:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 794 00000100:00100000:0.0:1746065193.925914:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14992 00000100:00100000:0.0:1746065193.925918:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263277056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.925923:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065193.925929:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61670 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.925940:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.925941:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065193.925945:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 36 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.925954:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 36 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065193.925961:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131b10a00, rc 0) 00000100:00100000:0.0:1746065193.925976:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263277056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.925981:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14992 00000100:00100000:2.0:1746065193.925985:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260426752:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065193.926036:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.926115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.926719:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277312 00000100:00100000:3.0:1746065193.926723:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277312 00000100:00100000:3.0:1746065193.926750:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14993 00000100:00100000:3.0:1746065193.926755:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263277312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065193.926762:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065193.926771:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0072200/0x14b4f8542d4fe2af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6167e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065193.926797:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260426880:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065193.926865:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.931658:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260426752:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065193.931689:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe2a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61677 expref: 35 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.931702:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe2a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61677 expref: 35 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.931738:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8a00, rc 0) 00000100:00100000:2.0:1746065193.931778:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263277184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6074us (6159us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065193.931785:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14991 00002000:00010000:3.0:1746065193.932234:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065193 -> 1746065194 00000100:00100000:3.0:1746065193.932249:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260426880:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065193.932267:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0072200/0x14b4f8542d4fe2af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6167e expref: 39 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.932276:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0072200/0x14b4f8542d4fe2af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6167e expref: 39 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065193.932291:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0072200, rc 0) 00000100:00100000:3.0:1746065193.932313:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263277312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5557us (6198us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065193.932318:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14993 00000100:00100000:1.0:1746065193.946905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.946957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.947015:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277696 00000100:00100000:3.0:1746065193.947024:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277696 00000100:00100000:2.0:1746065193.947033:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263277824 00000100:00100000:2.0:1746065193.947037:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263277824 00002000:00100000:3.0:1746065193.947062:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2dc00 x1830881263277696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.947062:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88008fd05500 x1830881263277824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.947070:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2dc00 with x1830881263277696 ext(1048576->2097151) 00002000:00100000:2.0:1746065193.947070:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05500 with x1830881263277824 ext(1048576->2097151) 00002000:00010000:3.0:1746065193.947074:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2dc00 00002000:00010000:2.0:1746065193.947074:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05500 00000100:00100000:1.0:1746065193.947161:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8490 00000100:00100000:1.0:1746065193.947173:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263277824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065193.947228:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8491 00000100:00100000:3.0:1746065193.947235:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263277696:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.953180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.953221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065193.954837:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278080 00000100:00100000:2.0:1746065193.954848:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278080 00002000:00100000:2.0:1746065193.954888:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3256319) req@ffff880129b0d180 x1830881263278080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 520/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.954897:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0d180 with x1830881263278080 ext(2097152->3256319) 00002000:00010000:2.0:1746065193.954902:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0d180 00000100:00100000:2.0:1746065193.954923:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278336 00000100:00100000:2.0:1746065193.954926:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278336 00002000:00100000:2.0:1746065193.954937:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3256320->4194303) req@ffff880129b0e680 x1830881263278336/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.954943:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0e680 with x1830881263278336 ext(3256320->4194303) 00002000:00010000:2.0:1746065193.954945:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0e680 00000100:00100000:2.0:1746065193.954966:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8492 00000100:00100000:2.0:1746065193.954972:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1959:x1830881263278080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065193.954996:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8493 00000100:00100000:1.0:1746065193.955004:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+30:1959:x1830881263278336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065193.955145:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.955169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.956256:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278592 00000100:00100000:3.0:1746065193.956264:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278592 00000100:00100000:3.0:1746065193.956274:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278848 00000100:00100000:3.0:1746065193.956275:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278848 00002000:00100000:3.0:1746065193.956303:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3174400->4194303) req@ffff880129b0ca80 x1830881263278848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.956312:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ca80 with x1830881263278848 ext(3174400->4194303) 00002000:00010000:3.0:1746065193.956317:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0ca80 00000100:00100000:3.0:1746065193.956329:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8494 00000100:00100000:3.0:1746065193.956334:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263278848:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:3.0:1746065193.957737:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3174399) req@ffff880129b0f100 x1830881263278592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 504/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.957747:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f100 with x1830881263278592 ext(2097152->3174399) 00002000:00010000:3.0:1746065193.957751:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f100 00000100:00100000:3.0:1746065193.957779:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8495 00000100:00100000:3.0:1746065193.957785:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263278592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065193.961144:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263277696:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13901us (14238us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.961154:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8491 00002000:00100000:3.0:1746065193.961163:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2dc00 x1830881263277696/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.961172:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2dc00 with x1830881263277696 ext(1048576->2097151) 00002000:00010000:3.0:1746065193.961176:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2dc00 00000100:00100000:1.0:1746065193.965247:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263277824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18069us (18279us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065193.965257:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8490 00002000:00100000:1.0:1746065193.965269:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88008fd05500 x1830881263277824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065193.965278:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd05500 with x1830881263277824 ext(1048576->2097151) 00002000:00010000:1.0:1746065193.965283:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fd05500 00000100:00100000:2.0:1746065193.968610:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263278336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13598us (15380us total) trans 0 rc 937984/937984 00000100:00100000:2.0:1746065193.968621:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8493 00002000:00100000:2.0:1746065193.968632:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (3256320->4194303) req@ffff880129b0e680 x1830881263278336/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 937984/937984 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.968640:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0e680 with x1830881263278336 ext(3256320->4194303) 00002000:00010000:2.0:1746065193.968644:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0e680 00000100:00100000:3.0:1746065193.972307:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263278848:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15960us (17124us total) trans 0 rc 1019904/1019904 00000100:00100000:3.0:1746065193.972320:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8494 00002000:00100000:3.0:1746065193.972332:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3174400->4194303) req@ffff880129b0ca80 x1830881263278848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 488/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.972340:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ca80 with x1830881263278848 ext(3174400->4194303) 00002000:00010000:3.0:1746065193.972346:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0ca80 00000100:00100000:0.0:1746065193.977595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.978538:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1959:x1830881263278592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20750us (23390us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065193.978548:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8495 00002000:00100000:3.0:1746065193.978557:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3174399) req@ffff880129b0f100 x1830881263278592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 504/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.978566:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0f100 with x1830881263278592 ext(2097152->3174399) 00002000:00010000:3.0:1746065193.978571:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0f100 00000100:00100000:2.0:1746065193.978693:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263278976 00000100:00100000:2.0:1746065193.978701:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263278976 00000100:00100000:2.0:1746065193.978742:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14994 00000100:00100000:2.0:1746065193.978748:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263278976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065193.978760:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065193.978767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065193.978774:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe2b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61685 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.978781:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279104 00000100:00100000:0.0:1746065193.978784:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279104 00000100:00100000:0.0:1746065193.978800:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14995 00000100:00100000:0.0:1746065193.978804:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263279104:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065193.978810:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065193.978830:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260427008:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065193.978833:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa7200/0x14b4f8542d4fe2bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6168c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.978853:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260427136:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065193.978900:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.978900:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065193.980450:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:1959:x1830881263278080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25472us (27275us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065193.980459:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8492 00002000:00100000:2.0:1746065193.980777:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3256319) req@ffff880129b0d180 x1830881263278080/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 520/440 e 0 to 0 dl 1746065204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065193.980786:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0d180 with x1830881263278080 ext(2097152->3256319) 00002000:00010000:2.0:1746065193.980790:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0d180 00000100:00100000:2.0:1746065193.981361:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260427008:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065193.981365:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260427136:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065193.981385:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe2b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61685 expref: 35 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065193.981385:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faa7200/0x14b4f8542d4fe2bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6168c expref: 39 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.981396:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe2b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61685 expref: 35 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065193.981396:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7200/0x14b4f8542d4fe2bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6168c expref: 39 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065193.981448:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b4600, rc 0) 00000100:00100000:2.0:1746065193.981501:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263278976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2753us (3913us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065193.981507:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14994 00010000:00010000:1.0:1746065193.982057:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa7200, rc 0) 00000100:00100000:1.0:1746065193.982089:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263279104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3284us (3321us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065193.982095:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14995 00000100:00100000:0.0:1746065193.986401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.986539:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279232 00000100:00100000:1.0:1746065193.986547:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279232 00000100:00100000:1.0:1746065193.986597:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14996 00000100:00100000:1.0:1746065193.986604:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32074:x1830881263279232:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065193.986619:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065193.986633:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61693 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.986662:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.986672:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065193.986674:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065193.986677:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.986701:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 28 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.986726:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 28 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065193.986736:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260427264:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065193.986856:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.988064:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065193.988108:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279488 00000100:00100000:1.0:1746065193.988112:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279488 00000100:00100000:1.0:1746065193.988473:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10076 00000100:00100000:1.0:1746065193.988485:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+294:32076:x1830881263279488:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065193.988500:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065193.988512:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092770e00/0x14b4f8542d4fe2cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6169a expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.988593:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988603:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988615:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988627:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988632:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988636:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988735:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4bc00/0x14b4f8542d4fe2e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988743:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4bc00/0x14b4f8542d4fe2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988749:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4bc00/0x14b4f8542d4fe2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065193.988755:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065193.988854:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988861:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988866:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988871:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092771a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065193.988874:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988880:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988888:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065193.988891:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065193.988894:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988898:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092771a00/0x14b4f8542d4fe2d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988908:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988912:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988916:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988919:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff4be00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065193.988921:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988926:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988931:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801331ac300) 00010000:00010000:1.0:1746065193.988933:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065193.988935:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988939:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4be00/0x14b4f8542d4fe2d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065193.988968:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092770e00/0x14b4f8542d4fe2cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6169a expref: 297 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.988977:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4bc00/0x14b4f8542d4fe2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6169a expref: 296 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.988982:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.988984:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065193.988985:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff4bc00, rc 0) 00000100:00100000:1.0:1746065193.989025:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+296:32076:x1830881263279488:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 545us (963us total) trans 8589944362 rc 0/0 00000100:00100000:1.0:1746065193.989031:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10076 00000100:00100000:1.0:1746065193.991631:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260427264:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065193.991659:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.991675:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092771600, rc 0) 00000100:00100000:1.0:1746065193.991727:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:32074:x1830881263279232:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5122us (5333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.991734:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14996 00000100:00100000:0.0:1746065193.991932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065193.991995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.992053:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279616 00000100:00100000:3.0:1746065193.992059:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279616 00002000:00100000:3.0:1746065193.992087:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3125248->3239935) req@ffff88009f2c4000 x1830881263279616/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 504/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.992095:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4000 with x1830881263279616 ext(3125248->3239935) 00010000:00010000:3.0:1746065193.992100:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 29 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065193.992111:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 29 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746065193.992117:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c4000 00000100:00100000:3.0:1746065193.992130:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2578 00000100:00100000:3.0:1746065193.992134:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+29:1958:x1830881263279616:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065193.992365:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279744 00000100:00100000:1.0:1746065193.992368:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279744 00000100:00100000:1.0:1746065193.992401:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 795 00000100:00100000:1.0:1746065193.992405:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+296:1960:x1830881263279744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065193.992414:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065193.992432:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff4bc00/0x14b4f8542d4fe2e0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6169a expref: 296 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065193.992443:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065193.992446:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065193.992462:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:1960:x1830881263279744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065193.992466:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 795 00000100:00100000:0.0:1746065193.995956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065193.997005:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263279616:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4866us (5069us total) trans 21474840959 rc 0/0 00000100:00100000:3.0:1746065193.997016:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2578 00002000:00100000:3.0:1746065193.997026:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (3125248->3239935) req@ffff88009f2c4000 x1830881263279616/t21474840959(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:109/0 lens 504/448 e 0 to 0 dl 1746065204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065193.997034:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f2c4000 with x1830881263279616 ext(3125248->3239935) 00010000:00010000:3.0:1746065193.997043:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 31 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065193.997057:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 31 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746065193.997063:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f2c4000 00000100:00100000:1.0:1746065193.997145:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263279872 00000100:00100000:1.0:1746065193.997151:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263279872 00000100:00100000:1.0:1746065193.997178:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14997 00000100:00100000:1.0:1746065193.997184:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263279872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065193.997194:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065193.997205:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fe2ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616a1 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065193.997245:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260427392:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065193.997287:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.001907:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260427392:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065194.001938:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fe2ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a1 expref: 32 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.001951:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092771200/0x14b4f8542d4fe2ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a1 expref: 32 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.001963:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092771200, rc 0) 00000100:00100000:1.0:1746065194.002001:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263279872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4816us (6052us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065194.002009:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14997 00000100:00100000:0.0:1746065194.002517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.002629:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280000 00000100:00100000:3.0:1746065194.002634:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280000 00010000:00010000:3.0:1746065194.002657:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 31 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.002687:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7729 00000100:00100000:3.0:1746065194.002694:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263280000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.002713:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.002724:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 31 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.002737:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 31 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.002754:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0072400/0x14b4f8542d4fe231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61638 expref: 31 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.002774:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.002776:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.002782:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.002793:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.002838:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.002849:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260427520:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065194.002900:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7a780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.015155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.015224:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280128 00000100:00100000:2.0:1746065194.015232:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280128 00000100:00100000:2.0:1746065194.015308:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14998 00000100:00100000:2.0:1746065194.015316:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:32066:x1830881263280128:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:3.0:1746065194.015369:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260427520:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065194.015380:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.015388:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065194.015395:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616a8 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.015417:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.015419:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.015425:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 32 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.015435:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263280000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 12742us (12919us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065194.015438:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 32 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.015443:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7729 00010000:00010000:2.0:1746065194.015445:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4600, rc 0) 00000100:00100000:2.0:1746065194.015461:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:32066:x1830881263280128:12345-192.168.202.46@tcp:101:cat.0 Request processed in 147us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.015467:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14998 00010000:00010000:3.0:1746065194.022079:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065194.025348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.025478:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280384 00000100:00100000:3.0:1746065194.025486:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280384 00002000:00100000:3.0:1746065194.025846:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009c3fad80 x1830881263280384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.025856:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881263280384 ext(2097152->3145727) 00002000:00010000:3.0:1746065194.025861:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:3.0:1746065194.025889:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8496 00000100:00100000:3.0:1746065194.025897:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263280384:12345-192.168.202.46@tcp:3:cat.0 00000100:00080000:1.0:1746065194.028436:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065194.039492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.039720:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280640 00000100:00100000:2.0:1746065194.039728:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280640 00002000:00100000:2.0:1746065194.039760:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8800a90adf80 x1830881263280640/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.039769:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90adf80 with x1830881263280640 ext(4194304->5013503) 00002000:00010000:2.0:1746065194.039773:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90adf80 00000100:00100000:2.0:1746065194.039801:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8497 00000100:00100000:2.0:1746065194.039807:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263280640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065194.044943:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263280384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19039us (19595us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065194.044954:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8496 00002000:00100000:3.0:1746065194.044964:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009c3fad80 x1830881263280384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.044973:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881263280384 ext(2097152->3145727) 00002000:00010000:3.0:1746065194.044978:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:2.0:1746065194.050077:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1959:x1830881263280640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10260us (10585us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065194.050088:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8497 00002000:00100000:2.0:1746065194.050099:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8800a90adf80 x1830881263280640/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.050108:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90adf80 with x1830881263280640 ext(4194304->5013503) 00002000:00010000:2.0:1746065194.050113:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90adf80 00000100:00100000:0.0:1746065194.050510:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.050577:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280768 00000100:00100000:2.0:1746065194.050584:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280768 00000100:00080000:1.0:1746065194.051175:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065194.051323:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 14999 00000100:00100000:2.0:1746065194.051332:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:32074:x1830881263280768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065194.051346:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.051362:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616af expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.051388:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.051395:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065194.051396:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065194.051400:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 39 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.051427:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 21 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.051437:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 21 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.051449:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260427648:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.052157:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.059435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.059573:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263280896 00000100:00100000:3.0:1746065194.059584:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263280896 00002000:00100000:3.0:1746065194.059631:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3117056->3145727) req@ffff8800a90ace00 x1830881263280896/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.059641:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ace00 with x1830881263280896 ext(3117056->3145727) 00010000:00010000:3.0:1746065194.059652:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 22 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.059666:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 22 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746065194.059673:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a90ace00 00000100:00100000:3.0:1746065194.059700:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2579 00000100:00100000:3.0:1746065194.059716:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1959:x1830881263280896:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065194.059978:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260427648:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.060001:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 39 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.060012:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4400, rc 0) 00000100:00100000:2.0:1746065194.060225:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:32074:x1830881263280768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8894us (9714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.060231:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 14999 00000100:00100000:3.0:1746065194.062753:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263280896:12345-192.168.202.46@tcp:4:cat.0 Request processed in 3040us (3320us total) trans 17179873673 rc 0/0 00000100:00100000:3.0:1746065194.062763:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2579 00002000:00100000:3.0:1746065194.062771:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3117056->3145727) req@ffff8800a90ace00 x1830881263280896/t17179873673(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.062784:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ace00 with x1830881263280896 ext(3117056->3145727) 00010000:00010000:3.0:1746065194.062793:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 24 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.062805:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 24 pid: 8428 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746065194.062811:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a90ace00 00000100:00100000:0.0:1746065194.067614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.068252:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281024 00000100:00100000:3.0:1746065194.068260:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281024 00010000:00010000:3.0:1746065194.068293:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 24 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.068334:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7730 00000100:00100000:3.0:1746065194.068342:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263281024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.068353:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.068374:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 24 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.068384:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 24 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.068405:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073a00/0x14b4f8542d4fe22a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61631 expref: 24 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.068552:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.068554:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.068562:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 38 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.068570:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 38 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.068597:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 38 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.068607:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260427776:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065194.068996:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7a780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.074230:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260427776:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065194.074252:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.074395:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263281024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6052us (6786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.074405:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7730 00000100:00100000:0.0:1746065194.081154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.081194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.081236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.081294:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281280 00000100:00100000:1.0:1746065194.081301:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281280 00002000:00100000:1.0:1746065194.081336:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff8800a90ac000 x1830881263281280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.081346:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ac000 with x1830881263281280 ext(2097152->3145727) 00002000:00010000:1.0:1746065194.081350:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ac000 00000100:00100000:2.0:1746065194.081357:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281536 00000100:00100000:2.0:1746065194.081361:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281536 00000100:00100000:1.0:1746065194.081367:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281664 00000100:00100000:1.0:1746065194.081370:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281664 00002000:00100000:1.0:1746065194.081380:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800a90ad500 x1830881263281664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.081386:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad500 with x1830881263281664 ext(3145728->4194303) 00002000:00010000:1.0:1746065194.081389:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ad500 00000100:00100000:1.0:1746065194.081401:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8498 00000100:00100000:1.0:1746065194.081407:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1958:x1830881263281280:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065194.081443:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8499 00000100:00100000:3.0:1746065194.081451:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1959:x1830881263281664:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:2.0:1746065194.081466:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800a90afb80 x1830881263281536/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.081475:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90afb80 with x1830881263281536 ext(3145728->4194303) 00002000:00010000:2.0:1746065194.081479:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90afb80 00000100:00100000:2.0:1746065194.081499:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8500 00000100:00100000:2.0:1746065194.081505:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263281536:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065194.095053:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263281536:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13539us (13849us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.095064:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8500 00002000:00100000:2.0:1746065194.095075:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800a90afb80 x1830881263281536/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.095083:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90afb80 with x1830881263281536 ext(3145728->4194303) 00002000:00010000:2.0:1746065194.095088:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90afb80 00000100:00100000:3.0:1746065194.096040:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1959:x1830881263281664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14588us (14800us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065194.096048:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8499 00002000:00100000:3.0:1746065194.096054:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800a90ad500 x1830881263281664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.096062:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ad500 with x1830881263281664 ext(3145728->4194303) 00002000:00010000:3.0:1746065194.096066:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ad500 00000100:00100000:1.0:1746065194.107370:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1958:x1830881263281280:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25953us (26214us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065194.107381:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8498 00002000:00100000:1.0:1746065194.107391:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff8800a90ac000 x1830881263281280/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.107403:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90ac000 with x1830881263281280 ext(2097152->3145727) 00002000:00010000:1.0:1746065194.107409:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a90ac000 00000100:00100000:0.0:1746065194.124546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.124797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.124910:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282176 00000100:00100000:1.0:1746065194.124918:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282176 00002000:00100000:1.0:1746065194.124956:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fa75f80 x1830881263282176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.124965:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75f80 with x1830881263282176 ext(4194304->5013503) 00002000:00010000:1.0:1746065194.124970:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75f80 00000100:00100000:1.0:1746065194.125002:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8501 00000100:00100000:1.0:1746065194.125009:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263282176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065194.125726:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263281920 00000100:00100000:2.0:1746065194.125730:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263281920 00000100:00100000:2.0:1746065194.125764:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15000 00000100:00100000:2.0:1746065194.125770:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+31:32079:x1830881263281920:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065194.125779:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.125792:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616b6 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.125838:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.125847:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 36 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.125853:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.125855:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.125858:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1359872->1458175] (req 1359872->1458175) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 32 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.125881:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 36 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.125891:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 36 pid: 25185 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746065194.125901:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260427904:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.125980:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.125992:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 32 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.126000:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428032:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.126020:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136ab49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.128112:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260427904:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.128123:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428032:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.128146:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1359872->1458175] (req 1359872->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 32 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.128159:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b5a00, rc 0) 00000100:00100000:2.0:1746065194.128633:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+32:32079:x1830881263281920:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2861us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.128641:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15000 00000100:00100000:0.0:1746065194.129324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.129391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.129414:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282304 00000100:00100000:0.0:1746065194.129419:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282304 00010000:00010000:0.0:1746065194.129440:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 37 pid: 25185 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.129458:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282432 00000100:00100000:0.0:1746065194.129459:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282432 00010000:00010000:0.0:1746065194.129467:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 32 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.129487:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7731 00000100:00100000:0.0:1746065194.129492:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263282304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.129501:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.129520:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 37 pid: 25185 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.129529:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 37 pid: 25185 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.129551:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b10a00/0x14b4f8542d4fe2a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61670 expref: 37 pid: 25185 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.129564:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.129585:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881263282304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.129590:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7731 00000100:00100000:0.0:1746065194.129605:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7732 00000100:00100000:0.0:1746065194.129609:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+32:1961:x1830881263282432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.129615:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.129621:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 32 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.129629:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 32 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.129639:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0073400/0x14b4f8542d4fe270 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6165b expref: 32 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.129646:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.129648:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.129652:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.129659:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.129681:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.129691:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260428160:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065194.129744:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.134695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.134797:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260428160:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065194.134838:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.134890:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881263282432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5279us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.134898:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7732 00000100:00100000:1.0:1746065194.135867:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263282176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10858us (11069us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065194.135876:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8501 00002000:00100000:1.0:1746065194.135886:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fa75f80 x1830881263282176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.135894:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75f80 with x1830881263282176 ext(4194304->5013503) 00002000:00010000:1.0:1746065194.135899:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75f80 00000100:00100000:1.0:1746065194.135914:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282688 00000100:00100000:1.0:1746065194.135919:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282688 00002000:00100000:1.0:1746065194.135941:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1359872->1363967) req@ffff88009fa74a80 x1830881263282688/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.135947:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74a80 with x1830881263282688 ext(1359872->1363967) 00002000:00010000:1.0:1746065194.135949:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa74a80 00000100:00100000:1.0:1746065194.135974:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8502 00000100:00100000:1.0:1746065194.135981:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263282688:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065194.136090:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263282688:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 109us (1402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065194.136096:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8502 00002000:00100000:1.0:1746065194.136100:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1359872->1363967) req@ffff88009fa74a80 x1830881263282688/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.136107:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74a80 with x1830881263282688 ext(1359872->1363967) 00002000:00010000:1.0:1746065194.136110:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa74a80 00000100:00100000:0.0:1746065194.138687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.138801:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263282816 00000100:00100000:2.0:1746065194.138808:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263282816 00000100:00100000:2.0:1746065194.138876:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15001 00000100:00100000:2.0:1746065194.138883:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263282816:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065194.138898:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.138912:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe30a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616bd expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.138957:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428288:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065194.139477:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.140801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.141157:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283072 00000100:00100000:3.0:1746065194.141164:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283072 00002000:00100000:3.0:1746065194.141202:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1454080->1458175) req@ffff88009fa77100 x1830881263283072/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.141211:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa77100 with x1830881263283072 ext(1454080->1458175) 00002000:00010000:3.0:1746065194.141215:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa77100 00000100:00100000:3.0:1746065194.141246:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8503 00000100:00100000:3.0:1746065194.141253:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263283072:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065194.141396:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1958:x1830881263283072:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 143us (598us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065194.141402:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8503 00002000:00100000:3.0:1746065194.141408:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1454080->1458175) req@ffff88009fa77100 x1830881263283072/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.141414:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa77100 with x1830881263283072 ext(1454080->1458175) 00002000:00010000:3.0:1746065194.141417:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa77100 00002000:00010000:2.0:1746065194.143796:0:8427:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065194 -> 1746065195 00002000:00010000:2.0:1746065194.143801:0:8427:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065194 -> 1746065195 00002000:00010000:2.0:1746065194.143803:0:8427:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065194 -> 1746065195 00000100:00100000:2.0:1746065194.143845:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428288:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065194.143873:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe30a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616bd expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.143885:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe30a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616bd expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.143899:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c508e00, rc 0) 00000100:00100000:2.0:1746065194.143932:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263282816:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5048us (5249us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065194.143938:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15001 00000100:00100000:0.0:1746065194.149441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.149859:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283200 00000100:00100000:2.0:1746065194.149868:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283200 00000100:00100000:2.0:1746065194.149921:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15002 00000100:00100000:2.0:1746065194.149930:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263283200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065194.149945:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.149959:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe311 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616c4 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.150004:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428416:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065194.151726:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.154691:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428416:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065194.154738:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe311 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616c4 expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.154752:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe311 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616c4 expref: 35 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.154766:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b5600, rc 0) 00000100:00100000:2.0:1746065194.154841:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263283200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4911us (5411us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065194.154848:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15002 00000100:00100000:0.0:1746065194.162321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.162363:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.162445:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283584 00000100:00100000:2.0:1746065194.162452:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283584 00000100:00100000:2.0:1746065194.162487:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15003 00000100:00100000:2.0:1746065194.162493:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32076:x1830881263283584:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065194.162507:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.162523:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616cb expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.162547:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.162557:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.162562:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.162564:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.162567:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2871296->3145727] (req 2871296->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 35 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.162590:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 30 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.162600:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 30 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.162615:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428544:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.162715:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283456 00000100:00100000:3.0:1746065194.162719:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283456 00000100:00100000:3.0:1746065194.162750:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4345 00000100:00100000:3.0:1746065194.162759:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:32074:x1830881263283456:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065194.162958:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+296:32074:x1830881263283456:12345-192.168.202.46@tcp:35:cat.0 Request processed in 202us (642us total) trans 8589944363 rc 0/0 00000100:00100000:3.0:1746065194.162964:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4345 00010000:00010000:2.0:1746065194.163565:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.163574:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.163583:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428672:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.163965:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.165809:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428544:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.166857:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1830881260428672:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.166885:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2871296->3145727] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 35 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.166901:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c509e00, rc 0) 00000100:00100000:2.0:1746065194.166982:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:32076:x1830881263283584:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4487us (4616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.166990:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15003 00000100:00100000:0.0:1746065194.169067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.169172:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283712 00000100:00100000:2.0:1746065194.169179:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283712 00010000:00010000:2.0:1746065194.169287:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.169407:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7733 00000100:00100000:2.0:1746065194.169413:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+31:1960:x1830881263283712:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.169424:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.169442:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.169451:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.169468:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ed4600/0x14b4f8542d4fe2f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616a8 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.169497:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.169734:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+30:1960:x1830881263283712:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 319us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.169740:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7733 00000100:00100000:0.0:1746065194.171340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.171906:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263283840 00000100:00100000:2.0:1746065194.171914:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263283840 00010000:00010000:2.0:1746065194.171942:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.171964:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7734 00000100:00100000:2.0:1746065194.171970:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263283840:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.171982:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.171997:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.172007:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.172024:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092771600/0x14b4f8542d4fe2c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61693 expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.172033:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.172034:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.172039:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.172044:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.172072:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 34 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.172082:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260428800:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065194.172165:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.173766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.173857:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284096 00000100:00100000:3.0:1746065194.173863:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284096 00000100:00100000:2.0:1746065194.173869:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260428800:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065194.173885:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065194.173899:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2871296->2875391) req@ffff88009fa75180 x1830881263284096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.173907:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75180 with x1830881263284096 ext(2871296->2875391) 00002000:00010000:3.0:1746065194.173911:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75180 00000100:00100000:2.0:1746065194.173914:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263283840:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1942us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.173927:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8504 00000100:00100000:2.0:1746065194.173927:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7734 00000100:00100000:3.0:1746065194.173933:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263284096:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065194.174059:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1960:x1830881263284096:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 125us (296us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065194.174066:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8504 00002000:00100000:3.0:1746065194.174071:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2871296->2875391) req@ffff88009fa75180 x1830881263284096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.174077:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75180 with x1830881263284096 ext(2871296->2875391) 00002000:00010000:3.0:1746065194.174079:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa75180 00000100:00100000:0.0:1746065194.177128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.177199:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284224 00000100:00100000:2.0:1746065194.177206:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284224 00000100:00100000:2.0:1746065194.177237:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15004 00000100:00100000:2.0:1746065194.177242:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:32076:x1830881263284224:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065194.177255:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.177267:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616d2 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.177289:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 40 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.177295:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.177297:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.177300:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->2732031] (req 2097152->2732031) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 40 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.177326:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 40 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.177335:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 40 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.177345:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260428928:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.177413:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.180590:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260428928:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.180618:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->2732031] (req 2097152->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 40 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.180633:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b5600, rc 0) 00000100:00100000:2.0:1746065194.180664:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:32076:x1830881263284224:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3421us (3541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.180671:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15004 00000100:00100000:0.0:1746065194.183898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.183953:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284352 00000100:00100000:2.0:1746065194.183961:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284352 00010000:00010000:2.0:1746065194.183989:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 40 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.184018:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7735 00000100:00100000:2.0:1746065194.184025:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881263284352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.184036:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.184056:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 40 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.184067:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 40 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.184086:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fe2fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616af expref: 40 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.184543:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.184545:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.184628:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.184637:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.184665:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.184676:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260429056:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065194.184762:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.186868:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260429056:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065194.186887:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.186928:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263284352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2903us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.186936:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7735 00000100:00100000:0.0:1746065194.191034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.191295:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284608 00000100:00100000:3.0:1746065194.191302:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284608 00002000:00100000:3.0:1746065194.191343:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2727936->2732031) req@ffff88009fa77480 x1830881263284608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.191351:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa77480 with x1830881263284608 ext(2727936->2732031) 00002000:00010000:3.0:1746065194.191357:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa77480 00000100:00100000:3.0:1746065194.191375:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8505 00000100:00100000:3.0:1746065194.191382:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263284608:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065194.191530:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263284608:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 148us (504us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065194.191540:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8505 00002000:00100000:3.0:1746065194.191545:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2727936->2732031) req@ffff88009fa77480 x1830881263284608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.191551:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa77480 with x1830881263284608 ext(2727936->2732031) 00002000:00010000:3.0:1746065194.191554:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa77480 00000100:00100000:0.0:1746065194.195398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.196562:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284864 00000100:00100000:3.0:1746065194.196572:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284864 00000100:00100000:3.0:1746065194.196621:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4346 00000100:00100000:3.0:1746065194.196628:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+296:32076:x1830881263284864:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065194.196961:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+297:32076:x1830881263284864:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 332us (1569us total) trans 8589944364 rc 0/0 00000100:00100000:3.0:1746065194.196967:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4346 00000100:00100000:2.0:1746065194.210035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.210648:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263284992 00000100:00100000:1.0:1746065194.210656:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263284992 00000100:00100000:1.0:1746065194.211128:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10077 00000100:00100000:1.0:1746065194.211136:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+16:32083:x1830881263284992:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.211156:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.211171:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428c00/0x14b4f8542d4fe326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616d9 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.211223:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.211233:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.211242:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.211253:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.211258:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.211267:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.211358:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.211368:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 43 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.211375:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.211399:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 43 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.211410:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 43 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.211420:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260429184:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065194.211498:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.213253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.213338:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285248 00000100:00100000:2.0:1746065194.213344:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285248 00000100:00100000:2.0:1746065194.213387:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4347 00000100:00100000:2.0:1746065194.213395:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+44:27247:x1830881263285248:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065194.213597:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260429184:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065194.213615:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065194.214215:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+45:27247:x1830881263285248:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 820us (966us total) trans 8589944365 rc 0/0 00000100:00100000:2.0:1746065194.214221:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4347 00000100:00100000:0.0:1746065194.215893:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.216008:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285376 00000100:00100000:2.0:1746065194.216014:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285376 00010000:00010000:2.0:1746065194.216043:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 45 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.216063:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7736 00000100:00100000:2.0:1746065194.216069:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+45:1960:x1830881263285376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.216079:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.216085:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 45 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.216095:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 45 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.216112:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b10c00/0x14b4f8542d4fe1ac lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615f2 expref: 45 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.216124:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.216128:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.216135:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.216141:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.216547:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065194.216557:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.216564:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065194.216589:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+44:1960:x1830881263285376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 518us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.216594:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7736 00000004:00200000:1.0:1746065194.216976:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:1.0:1746065194.216981:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065194.216995:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217004:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217011:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217016:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217020:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217025:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f429200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065194.217028:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217033:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217041:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065194.217043:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065194.217045:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217049:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429200/0x14b4f8542d4fe32d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217077:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217083:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217087:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217090:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f429600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065194.217092:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217096:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217102:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801331ac200) 00010000:00010000:1.0:1746065194.217104:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065194.217106:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217110:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe334 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.217136:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428c00/0x14b4f8542d4fe326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 18 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.217145:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 17 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.217151:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.217153:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065194.217155:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f429400, rc 0) 00000100:00100000:1.0:1746065194.217189:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:32083:x1830881263284992:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6054us (7162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.217196:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10077 00000100:00100000:0.0:1746065194.221285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.221348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.221610:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285504 00000100:00100000:2.0:1746065194.221617:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285504 00000100:00100000:2.0:1746065194.221662:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285632 00000100:00100000:2.0:1746065194.221665:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285632 00000100:00100000:2.0:1746065194.221692:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15005 00000100:00100000:2.0:1746065194.221698:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881263285504:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065194.221721:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.221736:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616e0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.221753:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.221755:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.221762:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.221774:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.221782:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c508e00, rc 0) 00000100:00100000:2.0:1746065194.221838:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263285504:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 140us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.221842:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15005 00000100:00100000:2.0:1746065194.221856:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15006 00000100:00100000:2.0:1746065194.221860:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881263285632:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065194.221866:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.221874:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616e7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.221883:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.221884:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.221887:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.221895:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.221900:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b4600, rc 0) 00000100:00100000:2.0:1746065194.221916:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263285632:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 52us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.221921:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15006 00000100:00100000:0.0:1746065194.221987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.222025:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285760 00000100:00100000:1.0:1746065194.222028:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285760 00000100:00100000:1.0:1746065194.222044:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15007 00000100:00100000:1.0:1746065194.222048:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263285760:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.222052:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.222058:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616ee expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.222066:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.222067:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.222071:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.222078:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.222084:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f429e00, rc 0) 00000100:00100000:1.0:1746065194.222097:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263285760:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.222101:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15007 00000100:00100000:0.0:1746065194.222514:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.222539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.223035:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263285888 00000100:00100000:2.0:1746065194.223040:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263285888 00000100:00100000:2.0:1746065194.223059:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286016 00000100:00100000:2.0:1746065194.223061:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286016 00000100:00100000:0.0:1746065194.223062:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.223072:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286144 00000100:00100000:2.0:1746065194.223073:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286144 00000100:00100000:2.0:1746065194.223084:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15008 00000100:00100000:2.0:1746065194.223089:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263285888:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065194.223096:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.223192:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fe357 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616f5 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.223228:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260429312:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065194.223275:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.223326:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15009 00000100:00100000:1.0:1746065194.223332:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263286016:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.223338:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.223345:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe35e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e616fc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.223369:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260429440:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065194.223388:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.223399:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15010 00000100:00100000:1.0:1746065194.223403:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263286144:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.223408:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.223414:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f429c00/0x14b4f8542d4fe365 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61703 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.223430:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260429568:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065194.223443:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.225296:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260429312:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065194.225326:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fe357 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616f5 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.225345:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012edd8400/0x14b4f8542d4fe357 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616f5 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.225354:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012edd8400, rc 0) 00002000:00010000:1.0:1746065194.225356:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime: 1746065194 -> 1746065195 00002000:00010000:1.0:1746065194.225359:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065194 -> 1746065195 00002000:00010000:1.0:1746065194.225361:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime: 1746065194 -> 1746065195 00000100:00100000:1.0:1746065194.225373:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260429568:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065194.225387:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f429c00/0x14b4f8542d4fe365 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61703 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065194.225390:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263285888:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2301us (2877us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065194.225395:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f429c00/0x14b4f8542d4fe365 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61703 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065194.225396:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15008 00010000:00010000:1.0:1746065194.225401:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f429c00, rc 0) 00000100:00100000:1.0:1746065194.225417:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263286144:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2013us (2355us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065194.225422:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15010 00002000:00010000:1.0:1746065194.226018:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime: 1746065194 -> 1746065195 00002000:00010000:1.0:1746065194.226021:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065194 -> 1746065195 00002000:00010000:1.0:1746065194.226023:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime: 1746065194 -> 1746065195 00000100:00100000:1.0:1746065194.226032:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260429440:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065194.226044:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe35e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616fc expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.226052:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f428000/0x14b4f8542d4fe35e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616fc expref: 8 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.226059:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f428000, rc 0) 00000100:00100000:1.0:1746065194.226090:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263286016:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2758us (3550us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065194.226095:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15009 00000100:00100000:0.0:1746065194.228287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.228353:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286400 00000100:00100000:1.0:1746065194.228360:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286400 00000100:00100000:1.0:1746065194.228577:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10078 00000100:00100000:1.0:1746065194.228586:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+17:32083:x1830881263286400:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.228608:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.228623:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe36c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6170a expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.228697:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.228722:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 18 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.228734:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.228759:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 18 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.228769:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 18 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.228779:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260429696:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065194.228881:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.230842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.230899:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286528 00000100:00100000:2.0:1746065194.230906:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286528 00010000:00010000:2.0:1746065194.230934:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 19 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.230956:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7737 00000100:00100000:2.0:1746065194.230966:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+19:1961:x1830881263286528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.230976:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.230981:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 19 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.230990:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 19 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.231007:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260429696:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.231008:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429400/0x14b4f8542d4fe33b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d9 expref: 19 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.231021:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.231025:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.231033:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.231038:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.231140:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.231256:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065194.231270:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.231276:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065194.231288:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:1961:x1830881263286528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 322us (474us total) trans 0 rc 0/0 00000004:00200000:1.0:1746065194.231289:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000100:00100000:2.0:1746065194.231293:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7737 00010000:00010000:1.0:1746065194.231594:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429800/0x14b4f8542d4fe36c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 19 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.231607:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 18 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.231612:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.231615:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065194.231617:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f428e00, rc 0) 00000100:00100000:1.0:1746065194.231639:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:32083:x1830881263286400:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3055us (3358us total) trans 8589944366 rc 0/0 00000100:00100000:1.0:1746065194.231645:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10078 00000100:00100000:0.0:1746065194.233472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.233583:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286656 00000100:00100000:1.0:1746065194.233590:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286656 00000100:00100000:1.0:1746065194.233930:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10079 00000100:00100000:1.0:1746065194.233939:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:32083:x1830881263286656:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.233959:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.233973:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429a00/0x14b4f8542d4fe381 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61711 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.234035:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.234046:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 19 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.234051:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.234076:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 19 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.234087:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 19 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.234098:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260429824:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065194.234660:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.235487:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.235771:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260429824:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065194.235788:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065194.236344:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286784 00000100:00100000:2.0:1746065194.236349:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286784 00010000:00010000:2.0:1746065194.236375:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 20 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.236394:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7738 00000100:00100000:2.0:1746065194.236400:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:1960:x1830881263286784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.236410:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.236415:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 20 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.236424:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 20 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.236441:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428e00/0x14b4f8542d4fe373 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6170a expref: 20 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.236452:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.236456:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.236464:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.236469:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.236670:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065194.236898:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.236904:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065194.236939:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:1.0:1746065194.236943:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065194.236955:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.236981:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429a00/0x14b4f8542d4fe381 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61711 expref: 20 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.236992:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61711 expref: 19 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.236997:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.236999:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065194.237001:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f428800, rc 0) 00000100:00100000:2.0:1746065194.237103:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+19:1960:x1830881263286784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 702us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.237109:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7738 00000100:00100000:1.0:1746065194.237271:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:32083:x1830881263286656:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3333us (3805us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.237278:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10079 00000100:00100000:0.0:1746065194.243812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.243878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.243913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.244002:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263286912 00000100:00100000:2.0:1746065194.244010:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263286912 00000100:00100000:2.0:1746065194.244039:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287168 00000100:00100000:2.0:1746065194.244041:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287168 00000100:00100000:2.0:1746065194.244051:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287040 00000100:00100000:2.0:1746065194.244052:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287040 00000100:00100000:2.0:1746065194.244064:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15011 00000100:00100000:2.0:1746065194.244069:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263286912:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065194.244084:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.244100:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe38f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61718 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.244141:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260429952:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065194.244229:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15012 00000100:00100000:1.0:1746065194.244235:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263287168:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.244247:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.244256:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f429400/0x14b4f8542d4fe396 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61726 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.244276:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260430080:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065194.244348:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15013 00000100:00100000:3.0:1746065194.244356:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263287040:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065194.244361:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.244367:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f25c600/0x14b4f8542d4fe39d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6171f expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.244388:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260430208:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065194.244601:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.244679:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012cf5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.244739:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.247965:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260429952:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065194.247997:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe38f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61718 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.248009:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfde00/0x14b4f8542d4fe38f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61718 expref: 10 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.248022:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfde00, rc 0) 00000100:00100000:2.0:1746065194.248060:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263286912:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3989us (4256us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065194.248067:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15011 00000100:00100000:3.0:1746065194.248310:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260430208:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065194.248327:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f25c600/0x14b4f8542d4fe39d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6171f expref: 8 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.248340:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f25c600/0x14b4f8542d4fe39d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6171f expref: 8 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.248350:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25c600, rc 0) 00000100:00100000:3.0:1746065194.248368:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263287040:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4015us (4455us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065194.248373:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15013 00000100:00100000:2.0:1746065194.249125:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260430080:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065194.249143:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f429400/0x14b4f8542d4fe396 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61726 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.249152:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f429400/0x14b4f8542d4fe396 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61726 expref: 9 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.249163:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f429400, rc 0) 00000100:00100000:2.0:1746065194.249184:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263287168:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4949us (5306us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065194.249188:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15012 00000100:00100000:0.0:1746065194.251579:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.251972:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287424 00000100:00100000:1.0:1746065194.251979:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287424 00000100:00100000:1.0:1746065194.252030:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10080 00000100:00100000:1.0:1746065194.252037:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+18:32083:x1830881263287424:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.252055:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.252069:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428200/0x14b4f8542d4fe3a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6172d expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.252149:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe3ab lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.252163:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe3ab lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065194.252173:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe3ab lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:1.0:1746065194.252183:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065194.252277:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428200/0x14b4f8542d4fe3a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6172d expref: 21 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.252302:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe3ab lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6172d expref: 20 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.252314:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.252316:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065194.252319:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f429000, rc 0) 00000100:00100000:1.0:1746065194.252359:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:32083:x1830881263287424:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 322us (787us total) trans 8589944367 rc 0/0 00000100:00100000:1.0:1746065194.252365:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10080 00000100:00100000:0.0:1746065194.254265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.254302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.254560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.254653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.254666:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287552 00000100:00100000:2.0:1746065194.254673:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287552 00000100:00100000:2.0:1746065194.254715:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287808 00000100:00100000:2.0:1746065194.254717:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287808 00000100:00100000:2.0:1746065194.254728:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288064 00000100:00100000:2.0:1746065194.254730:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288064 00000100:00100000:2.0:1746065194.254742:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15014 00000100:00100000:2.0:1746065194.254748:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263287552:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:2.0:1746065194.254781:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.254797:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 33 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.254804:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.254811:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 29 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.254843:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.254844:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.254848:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.254871:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 29 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.254881:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 29 pid: 25185 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.254893:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260430336:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.255155:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15015 00000100:00100000:3.0:1746065194.255162:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263287808:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065194.255181:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.255191:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.255198:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.255205:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 38 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.255210:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.255211:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.255213:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.255231:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 38 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.255239:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 38 pid: 8427 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746065194.255247:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260430464:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.255699:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.255715:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 8 pid: 8427 timeout: 893 lvb_type: 1 00000100:00100000:2.0:1746065194.255722:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260430592:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.256170:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287680 00000100:00100000:3.0:1746065194.256174:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287680 00000100:00100000:3.0:1746065194.256198:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15016 00000100:00100000:3.0:1746065194.256203:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263288064:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065194.256222:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256237:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 33 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256242:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065194.256243:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065194.256245:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256264:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 33 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256272:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 33 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.256281:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260430720:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.256307:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.256329:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15017 00000100:00100000:3.0:1746065194.256335:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263287680:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065194.256350:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256358:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 38 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.256364:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.256371:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 22 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.256376:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.256377:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065194.256378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065194.256379:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256392:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 22 pid: 8429 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065194.256394:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263287936 00000100:00100000:0.0:1746065194.256397:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263287936 00010000:00010000:3.0:1746065194.256399:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 22 pid: 8429 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746065194.256407:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260430848:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.256411:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15018 00000100:00100000:0.0:1746065194.256416:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263287936:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065194.256428:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256431:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.256437:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256438:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 9 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.256442:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065194.256443:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746065194.256445:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260430976:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.256445:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256461:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 38 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.256461:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 29 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256468:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 38 pid: 4545 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.256468:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 29 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.256474:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260431232:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.256487:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7a240 going to sleep for 11 seconds 00010000:00010000:3.0:1746065194.256505:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.256512:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 9 pid: 8428 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746065194.256519:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260431360:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.256544:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.256551:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.256558:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260431488:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.256572:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129b7ad80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065194.256639:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 33 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.256646:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 33 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.256653:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260431616:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.256667:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92be000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.256730:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260431104:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.256746:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.256754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.256776:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288192 00000100:00100000:0.0:1746065194.256779:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288192 00000100:00100000:0.0:1746065194.256804:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15019 00000100:00100000:0.0:1746065194.256808:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263288192:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065194.256835:0:2463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.256845:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 38 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.256850:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065194.256851:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065194.256853:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.256868:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 38 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.256879:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 38 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.256887:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260431744:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.256917:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.264066:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260430336:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.265274:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260430720:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.265296:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.265456:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260430464:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.265483:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260431360:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.265487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.265531:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260430848:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.265539:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260430976:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.265545:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260431232:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.265559:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.265575:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260431744:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.265576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065194.265584:0:2463:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.265593:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288960 00000100:00100000:2.0:1746065194.265597:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288960 00000100:00100000:0.0:1746065194.265598:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260431104:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.265606:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.265619:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130446a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260430592:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.265622:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 23 pid: 8429 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.265627:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260431616:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.265639:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.265642:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7739 00000100:00100000:2.0:1746065194.265648:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881263288960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.265659:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.265677:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 23 pid: 8429 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746065194.265685:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 23 pid: 8429 timeout: 893 lvb_type: 1 00000100:00100000:1.0:1746065194.265700:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288320 00000100:00100000:1.0:1746065194.265712:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288320 00010000:00010000:2.0:1746065194.265714:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe0c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61558 expref: 23 pid: 8429 timeout: 893 lvb_type: 1 00010000:00010000:2.0:1746065194.265726:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065194.265738:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2871296->3145727) req@ffff88009c3f9880 x1830881263288320/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.265746:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830881263288320 ext(2871296->3145727) 00010000:00010000:1.0:1746065194.265751:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 34 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.265759:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+22:1958:x1830881263288960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (182us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065194.265759:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 34 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.265765:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7739 00002000:00010000:1.0:1746065194.265765:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3f9880 00000100:00100000:1.0:1746065194.265775:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2580 00000100:00100000:1.0:1746065194.265779:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263288320:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065194.266902:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260431488:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.266919:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.271085:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263288320:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5297us (5590us total) trans 21474840960 rc 0/0 00000100:00100000:1.0:1746065194.271095:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2580 00002000:00100000:1.0:1746065194.271106:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2871296->3145727) req@ffff88009c3f9880 x1830881263288320/t21474840960(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.271115:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830881263288320 ext(2871296->3145727) 00010000:00010000:1.0:1746065194.271123:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 36 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.271134:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 36 pid: 8427 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746065194.271141:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3f9880 00000100:00100000:0.0:1746065194.271395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.272036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.272051:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288448 00000100:00100000:0.0:1746065194.272057:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288448 00010000:00010000:0.0:1746065194.272079:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 39 pid: 8427 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.272095:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288704 00000100:00100000:0.0:1746065194.272097:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288704 00010000:00010000:0.0:1746065194.272105:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 40 pid: 4545 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.272117:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7740 00000100:00100000:0.0:1746065194.272122:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881263288448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.272132:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.272146:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 40 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272155:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 40 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272173:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b11000/0x14b4f8542d4fe29a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61669 expref: 40 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272192:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.272210:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263288448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 88us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.272215:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7740 00000100:00100000:0.0:1746065194.272228:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7741 00000100:00100000:0.0:1746065194.272232:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263288704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.272237:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.272244:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 38 pid: 4545 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272251:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 38 pid: 4545 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272260:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff55200/0x14b4f8542d4fe0a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61527 expref: 38 pid: 4545 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272267:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.272277:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263288704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 45us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.272281:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7741 00000100:00100000:0.0:1746065194.272307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.272317:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289088 00000100:00100000:0.0:1746065194.272319:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289088 00010000:00010000:0.0:1746065194.272328:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 30 pid: 25185 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.272344:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7742 00000100:00100000:0.0:1746065194.272347:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881263289088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.272353:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.272364:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 30 pid: 25185 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.272372:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 30 pid: 25185 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.272383:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe0ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61582 expref: 30 pid: 25185 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.272392:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.272406:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263289088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.272410:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7742 00000100:00100000:0.0:1746065194.272446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.272457:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289344 00000100:00100000:0.0:1746065194.272460:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289344 00010000:00010000:0.0:1746065194.272470:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 36 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.272483:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7743 00000100:00100000:0.0:1746065194.272487:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263289344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.272492:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.272500:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 36 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.272508:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 36 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.272517:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe0e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6157b expref: 36 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.272524:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.272536:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263289344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 49us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.272541:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7743 00000100:00100000:0.0:1746065194.272573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.272590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.272597:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288576 00000100:00100000:0.0:1746065194.272600:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288576 00010000:00010000:0.0:1746065194.272609:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 11 pid: 8427 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.272622:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7744 00000100:00100000:0.0:1746065194.272626:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263288576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.272630:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.272637:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 11 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272644:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 11 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272655:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe349 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e7 expref: 11 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272664:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.272665:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.272669:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272676:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272692:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.272718:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263288576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.272723:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7744 00010000:00010000:0.0:1746065194.272739:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272745:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272760:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272766:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272776:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272782:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25d800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065194.272785:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272791:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272799:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.272804:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f25d800/0x14b4f8542d4fe3ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.272855:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263287680:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 16520us (18201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.272861:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15017 00000100:00100000:0.0:1746065194.272894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.272903:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263288832 00000100:00100000:0.0:1746065194.272907:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263288832 00010000:00010000:0.0:1746065194.272915:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 9 pid: 8428 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.272926:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7745 00000100:00100000:0.0:1746065194.272931:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263288832:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.272936:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.272942:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 9 pid: 8428 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272947:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 9 pid: 8428 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272955:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f429e00/0x14b4f8542d4fe350 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616ee expref: 9 pid: 8428 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.272962:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.272974:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263288832:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 43us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.272978:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7745 00000100:00100000:0.0:1746065194.273010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.273019:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289216 00000100:00100000:0.0:1746065194.273022:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289216 00010000:00010000:0.0:1746065194.273030:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 10 pid: 8427 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.273042:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7746 00000100:00100000:0.0:1746065194.273046:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263289216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.273052:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.273058:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 10 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.273069:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 10 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.273080:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe342 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616e0 expref: 10 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.273087:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.273088:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.273091:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273096:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273108:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.273121:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263289216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.273125:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7746 00010000:00010000:0.0:1746065194.273155:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273161:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273173:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273182:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273187:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273191:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfd800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065194.273194:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273200:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273208:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.273213:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fdfd800/0x14b4f8542d4fe3b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.273244:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263287552:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 18496us (18984us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.273249:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15014 00000100:00100000:0.0:1746065194.273283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.275070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.275122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.275138:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289856 00000100:00100000:0.0:1746065194.275138:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289728 00000100:00100000:2.0:1746065194.275143:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289856 00000100:00100000:0.0:1746065194.275143:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289728 00010000:00010000:2.0:1746065194.275164:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.275164:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.275181:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7747 00000100:00100000:0.0:1746065194.275187:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263289728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065194.275191:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7748 00000100:00100000:2.0:1746065194.275195:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1958:x1830881263289856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.275195:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.275201:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.275208:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.275210:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.275219:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.275219:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.275232:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe318 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616cb expref: 35 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.275232:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0073800/0x14b4f8542d4fe269 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61654 expref: 22 pid: 8428 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.275242:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.275243:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.275245:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.275245:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.275247:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.275248:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.275254:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.275254:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.275276:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065194.275276:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.275297:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+21:1961:x1830881263289728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 110us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.275299:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263289856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.275302:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7747 00000100:00100000:2.0:1746065194.275305:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7748 00000100:00100000:1.0:1746065194.275433:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289600 00000100:00100000:3.0:1746065194.275437:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289472 00000100:00100000:1.0:1746065194.275437:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289600 00000100:00100000:3.0:1746065194.275440:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289472 00010000:00010000:3.0:1746065194.275450:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275457:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065194.275461:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2732031) req@ffff880093ba1880 x1830881263289600/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.275469:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1880 with x1830881263289600 ext(2097152->2732031) 00010000:00010000:1.0:1746065194.275474:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 37 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.275478:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275484:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275491:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275496:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25d000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065194.275499:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275506:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275515:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275520:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe3c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.275578:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263288064:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 19374us (21018us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.275584:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15016 00010000:00010000:3.0:1746065194.275601:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275608:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275619:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275625:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275631:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275635:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25c800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065194.275637:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275644:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275652:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.275657:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f25c800/0x14b4f8542d4fe3c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.275682:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263287808:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 20521us (21380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.275687:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15015 00002000:00100000:3.0:1746065194.275722:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1359872->1458175) req@ffff880093ba2a00 x1830881263289472/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.275729:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2a00 with x1830881263289472 ext(1359872->1458175) 00010000:00010000:3.0:1746065194.275734:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 29 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.276018:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 37 pid: 8427 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746065194.276025:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba1880 00000100:00100000:1.0:1746065194.276040:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2581 00000100:00100000:1.0:1746065194.276046:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263289600:12345-192.168.202.46@tcp:4:multiop.0 00010000:00010000:3.0:1746065194.276078:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 29 pid: 8427 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746065194.276084:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba2a00 00000100:00100000:3.0:1746065194.276094:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2582 00000100:00100000:3.0:1746065194.276099:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+29:1961:x1830881263289472:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065194.284021:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881263289472:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 7914us (10729us total) trans 21474840961 rc 0/0 00000100:00100000:3.0:1746065194.284031:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2582 00002000:00100000:3.0:1746065194.284040:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1359872->1458175) req@ffff880093ba2a00 x1830881263289472/t21474840961(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.284048:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2a00 with x1830881263289472 ext(1359872->1458175) 00010000:00010000:3.0:1746065194.284056:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.284067:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00002000:00010000:3.0:1746065194.284077:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ba2a00 00000100:00100000:0.0:1746065194.289478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.290422:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263289984 00000100:00100000:2.0:1746065194.290430:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263289984 00010000:00010000:2.0:1746065194.290455:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.290493:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7749 00000100:00100000:2.0:1746065194.290499:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+31:1961:x1830881263289984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.290509:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.290524:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.290532:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.290549:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5a00/0x14b4f8542d4fe303 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->1458175) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616b6 expref: 31 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.290564:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.290566:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.290569:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.290576:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.290604:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.290637:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+30:1961:x1830881263289984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 138us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.290643:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7749 00010000:00010000:0.0:1746065194.290751:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.290759:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.290774:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.290781:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.290787:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.290792:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa6200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065194.290795:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.290801:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.290811:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.290832:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa6200/0x14b4f8542d4fe3d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.290875:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263287936:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 34459us (34496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.290881:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15018 00000100:00100000:1.0:1746065194.291262:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263289600:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 15215us (18686us total) trans 17179873674 rc 0/0 00000100:00100000:1.0:1746065194.291272:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2581 00002000:00100000:1.0:1746065194.291281:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2732031) req@ffff880093ba1880 x1830881263289600/t17179873674(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.291288:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1880 with x1830881263289600 ext(2097152->2732031) 00010000:00010000:1.0:1746065194.291295:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.291305:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 893 lvb_type: 0 00002000:00010000:1.0:1746065194.291311:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba1880 00000100:00100000:0.0:1746065194.293787:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.293948:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290112 00000100:00100000:3.0:1746065194.293956:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290112 00010000:00010000:3.0:1746065194.293983:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.294213:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7750 00000100:00100000:3.0:1746065194.294221:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263290112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.294235:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.294253:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.294267:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.294285:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe31f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2732031) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e616d2 expref: 39 pid: 8427 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.294329:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.294331:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.294335:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.294343:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.294369:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.294411:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263290112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 191us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.294417:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7750 00010000:00010000:0.0:1746065194.294482:0:2463:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.294489:0:2463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.294505:0:2463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.294512:0:2463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.294518:0:2463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.294524:0:2463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa6600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065194.294528:0:2463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.294535:0:2463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.294549:0:2463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.294555:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa6600/0x14b4f8542d4fe3dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.294611:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263288192:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 37801us (37856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.294617:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15019 00000100:00100000:0.0:1746065194.296212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.296259:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290368 00000100:00100000:2.0:1746065194.296265:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290368 00000100:00100000:2.0:1746065194.296303:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10081 00000100:00100000:2.0:1746065194.296309:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+20:32083:x1830881263290368:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1746065194.296347:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.296367:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428800/0x14b4f8542d4fe388 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61711 expref: 20 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296379:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.296383:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065194.296406:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.296417:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 296 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296423:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 43 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296429:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 296 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296435:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 43 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296441:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 296 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296446:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 43 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296456:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.296478:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 43 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296487:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 43 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.296498:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260431872:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.296587:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 296 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296595:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 296 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.296602:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432000:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.296626:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 43 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296633:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 43 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.296640:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432128:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.296661:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 296 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296672:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 296 pid: 14643 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.296679:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432256:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.296699:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 43 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296721:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 43 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.296728:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa74000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432384:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.296749:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 296 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.296756:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 296 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.296762:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa76300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432512:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.296778:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92beb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.299697:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432256:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.299723:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa74000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432384:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.299732:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa76300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432512:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.299732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.299738:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432128:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.299761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.299780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.299793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.299848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.299866:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290624 00000100:00100000:0.0:1746065194.299871:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290624 00000100:00100000:2.0:1746065194.299886:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260431872:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.299894:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260432000:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.299894:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 44 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.299915:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290496 00000100:00100000:0.0:1746065194.299917:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290496 00010000:00010000:2.0:1746065194.299918:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065194.299926:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 297 pid: 14643 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.299934:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263290752 00000100:00100000:2.0:1746065194.299936:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263290752 00000100:00100000:0.0:1746065194.299936:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291264 00000100:00100000:0.0:1746065194.299938:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291264 00010000:00010000:0.0:1746065194.299945:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 299 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.299950:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 299 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.299955:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7751 00000100:00100000:0.0:1746065194.299961:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+44:1960:x1830881263290624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065194.299964:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7752 00000100:00100000:2.0:1746065194.299969:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+299:1960:x1830881263290496:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.299971:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.299975:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.299976:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 44 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.299979:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 299 pid: 14643 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.299985:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 44 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.300058:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7753 00000100:00100000:1.0:1746065194.300065:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+299:1959:x1830881263291264:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.300072:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.300076:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 299 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.300131:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291008 00000100:00100000:3.0:1746065194.300134:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291008 00000100:00100000:3.0:1746065194.300154:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4348 00000100:00100000:3.0:1746065194.300159:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+45:27031:x1830881263291008:12345-192.168.202.46@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746065194.300278:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 299 pid: 14643 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.300288:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 299 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.300307:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f73c000/0x14b4f8542d4fd916 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6118b expref: 299 pid: 14643 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.300334:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fdbee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61321 expref: 298 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.300348:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.300352:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.300360:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.300391:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+297:1959:x1830881263291264:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 327us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.300397:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7753 00000100:00100000:1.0:1746065194.300415:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7754 00000100:00100000:1.0:1746065194.300420:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+296:1960:x1830881263290752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.300426:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.300429:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 296 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.300436:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 296 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.300446:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccd600/0x14b4f8542d4fd8d7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6116f expref: 296 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.300454:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.300457:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.300461:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.300474:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+295:1960:x1830881263290752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.300478:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7754 00000100:00100000:1.0:1746065194.300517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.300531:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291136 00000100:00100000:1.0:1746065194.300533:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291136 00010000:00010000:1.0:1746065194.300543:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 47 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.300553:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7755 00000100:00100000:1.0:1746065194.300558:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+47:1959:x1830881263291136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.300564:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.300567:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 47 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.300574:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 47 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.300797:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+47:27031:x1830881263291008:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 638us (1067us total) trans 8589944368 rc 0/0 00000100:00100000:3.0:1746065194.300803:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4348 00010000:00010000:1.0:1746065194.300921:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fdc1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61336 expref: 46 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.300949:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065194.300951:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd4ce00/0x14b4f8542d4fd901 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6117d expref: 45 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.300954:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.300959:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065194.300960:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:0.0:1746065194.300963:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:0.0:1746065194.300968:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.300977:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+294:1960:x1830881263290496:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1008us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.300983:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7752 00000100:00100000:0.0:1746065194.300983:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+44:1960:x1830881263290624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1023us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.300988:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7751 00010000:00010000:1.0:1746065194.301048:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.301052:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.301057:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.301070:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+43:1959:x1830881263291136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 512us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.301075:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7755 00000100:00100000:0.0:1746065194.303213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.303292:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291392 00000100:00100000:1.0:1746065194.303298:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291392 00010000:00010000:1.0:1746065194.303319:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 43 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.303337:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7756 00000100:00100000:1.0:1746065194.303343:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+43:1961:x1830881263291392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.303351:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.303354:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 43 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.303363:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 43 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.303377:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131b11c00/0x14b4f8542d4fe17b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e615cf expref: 43 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.303389:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.303392:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.303399:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.303404:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.303526:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.303691:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+42:1961:x1830881263291392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 347us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.303697:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7756 00010000:00010000:2.0:1746065194.303757:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.303764:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000040:00080000:2.0:1746065194.304377:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3111, 88 off263200 00000004:00080000:2.0:1746065194.304387:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595571125ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304441:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3134, 88 off265400 00000004:00080000:2.0:1746065194.304447:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793595631496ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.304457:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3135, 88 off265488 00000004:00080000:2.0:1746065194.304460:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793595644635ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.304466:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3112, 88 off263288 00000004:00080000:2.0:1746065194.304469:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595653302ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304474:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3113, 88 off263376 00000004:00080000:2.0:1746065194.304476:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595660895ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304482:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3136, 88 off265576 00000004:00080000:2.0:1746065194.304484:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793595668881ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.304490:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3137, 88 off265664 00000004:00080000:2.0:1746065194.304492:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793595676814ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.304498:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3138, 88 off265752 00000004:00080000:2.0:1746065194.304500:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793595684606ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.304505:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3114, 88 off263464 00000004:00080000:2.0:1746065194.304509:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595693801ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304514:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3139, 88 off265840 00000004:00080000:2.0:1746065194.304516:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793595701255ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.304522:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3115, 88 off263552 00000004:00080000:2.0:1746065194.304525:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595709834ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304530:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3140, 88 off265928 00000004:00080000:2.0:1746065194.304533:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793595717305ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.304538:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3116, 88 off263640 00000004:00080000:2.0:1746065194.304541:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595725669ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304546:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3117, 88 off263728 00000004:00080000:2.0:1746065194.304548:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595733040ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304554:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3118, 88 off263816 00000004:00080000:2.0:1746065194.304556:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595741015ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304561:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3119, 88 off263904 00000004:00080000:2.0:1746065194.304563:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793595747995ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.304569:0:16767:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3141, 88 off266016 00000004:00080000:2.0:1746065194.304571:0:16767:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793595755591ns, next at 737095943431ns, rc = 0 00000001:00080000:0.0:1746065194.325849:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944347 is committed 00000001:00080000:0.0:1746065194.325864:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944341 is committed 00000001:00080000:0.0:1746065194.325871:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944338 is committed 00000001:00080000:0.0:1746065194.325885:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944367 is committed 00000001:00080000:0.0:1746065194.325889:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944362 is committed 00000001:00080000:0.0:1746065194.325895:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944354 is committed 00000004:00010000:2.0:1746065194.325899:0:16767:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093ba2300 reply state ffff8800936cec00 transno 8589944369 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065194.325908:0:16767:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746065194.325923:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944369 is committed 00000004:00080000:0.0:1746065194.325926:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2422 committed 00000004:00080000:0.0:1746065194.325932:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2399 committed 00000004:00080000:0.0:1746065194.325937:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2398 committed 00000004:00080000:0.0:1746065194.325938:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2397 committed 00000004:00080000:0.0:1746065194.325940:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2396 committed 00000004:00080000:0.0:1746065194.325941:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2421 committed 00000004:00080000:0.0:1746065194.325943:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2395 committed 00000004:00080000:0.0:1746065194.325944:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2420 committed 00000004:00080000:0.0:1746065194.325945:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2394 committed 00000004:00080000:0.0:1746065194.325946:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2419 committed 00000004:00080000:0.0:1746065194.325948:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2418 committed 00000004:00080000:0.0:1746065194.325949:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2417 committed 00000004:00080000:0.0:1746065194.325950:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2393 committed 00000004:00080000:0.0:1746065194.325951:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2392 committed 00000004:00080000:0.0:1746065194.325952:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2416 committed 00000004:00080000:0.0:1746065194.325953:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2415 committed 00000004:00080000:0.0:1746065194.325954:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2391 committed 00000001:00080000:0.0:1746065194.325957:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944365 is committed 00010000:00080000:2.0:1746065194.325989:0:16767:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065194.326002:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:32083:x1830881263290368:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 29689us (29790us total) trans 8589944369 rc 0/0 00000100:00100000:2.0:1746065194.326009:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10081 00000001:00080000:0.0:1746065194.326020:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944368 is committed 00000001:00080000:0.0:1746065194.326023:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944364 is committed 00010000:00010000:2.0:1746065194.326034:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.326040:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.326046:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.326051:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fdfd400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.326055:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.326061:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.326074:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.326076:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065194.326079:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.326094:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe3e3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:3.0:1746065194.326215:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260432768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.326252:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.326268:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260432768 00000100:00100000:1.0:1746065194.326273:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260432768 00000100:00100000:3.0:1746065194.326282:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260433280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.326296:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.326305:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260433792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.326305:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260433280 00000100:00100000:1.0:1746065194.326307:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260433280 00000100:00100000:3.0:1746065194.326318:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.326318:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15020 00000100:00100000:1.0:1746065194.326324:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3298:x1830881260432768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.326328:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260434304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.326339:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.326350:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1746065194.326354:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260432640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.326364:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.326372:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260433152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.326384:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.326392:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260433664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.326403:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.326411:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260434176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.326420:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.326445:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260433792 00000100:00100000:3.0:1746065194.326448:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260433792 00000100:00100000:3.0:1746065194.326465:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260434304 00000100:00100000:3.0:1746065194.326466:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260434304 00000100:00100000:3.0:1746065194.326474:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260432640 00000100:00100000:3.0:1746065194.326475:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260432640 00000100:00100000:3.0:1746065194.326481:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260433152 00000100:00100000:3.0:1746065194.326482:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260433152 00000100:00100000:1.0:1746065194.326482:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3298:x1830881260432768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (230us total) trans 17179873675 rc 0/0 00000100:00100000:3.0:1746065194.326487:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260433664 00000100:00100000:1.0:1746065194.326487:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15020 00000100:00100000:3.0:1746065194.326488:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260433664 00000100:00100000:3.0:1746065194.326493:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260434176 00000100:00100000:3.0:1746065194.326494:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260434176 00000100:00100000:1.0:1746065194.326496:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15021 00000100:00100000:3.0:1746065194.326500:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15022 00000100:00100000:1.0:1746065194.326500:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3298:x1830881260433280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.326504:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3298:x1830881260433792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.326567:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3298:x1830881260433280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (270us total) trans 17179873676 rc 0/0 00000100:00100000:1.0:1746065194.326572:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15021 00000100:00100000:1.0:1746065194.326580:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15023 00000100:00100000:1.0:1746065194.326583:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881260434304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.326592:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881260433792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (273us total) trans 21474840962 rc 0/0 00000100:00100000:3.0:1746065194.326597:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15022 00000100:00100000:3.0:1746065194.326605:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15024 00000100:00100000:3.0:1746065194.326608:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3298:x1830881260432640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.326677:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3298:x1830881260432640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (311us total) trans 17179873677 rc 0/0 00000100:00100000:3.0:1746065194.326682:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15024 00000100:00100000:3.0:1746065194.326692:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15025 00000100:00100000:3.0:1746065194.326696:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3298:x1830881260433152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065194.326766:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065194.326768:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.326770:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.326771:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.326773:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065194.326791:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3298:x1830881260433152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (405us total) trans 17179873678 rc 0/0 00000100:00100000:3.0:1746065194.326795:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15025 00000100:00100000:3.0:1746065194.326803:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15026 00000100:00100000:3.0:1746065194.326807:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881260433664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.326902:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881260433664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (497us total) trans 21474840964 rc 0/0 00000100:00100000:3.0:1746065194.326907:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15026 00000100:00100000:3.0:1746065194.326915:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15027 00000100:00100000:3.0:1746065194.326919:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3298:x1830881260434176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.326927:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260432896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065194.326948:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.326960:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260433408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065194.326974:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.326981:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3298:x1830881260434176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (559us total) trans 21474840965 rc 0/0 00000100:00100000:0.0:1746065194.326982:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260433920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.326986:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15027 00000100:00100000:0.0:1746065194.326992:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.326993:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260432896 00000100:00100000:3.0:1746065194.326995:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260432896 00000100:00100000:0.0:1746065194.326998:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260434432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.327003:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260433408 00000100:00100000:3.0:1746065194.327004:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260433408 00000100:00100000:3.0:1746065194.327009:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260433920 00000100:00100000:0.0:1746065194.327009:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.327010:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260433920 00000100:00100000:3.0:1746065194.327015:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260434432 00000100:00100000:3.0:1746065194.327016:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260434432 00000100:00100000:0.0:1746065194.327017:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746065194.327021:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260433024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.327023:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15028 00000100:00100000:3.0:1746065194.327026:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3295:x1830881260432896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065194.327032:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.327039:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260433536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065194.327050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.327055:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260434048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.327066:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.327071:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260434560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.327081:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.327097:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260433024 00000100:00100000:0.0:1746065194.327099:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260433024 00000100:00100000:3.0:1746065194.327100:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3295:x1830881260432896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (152us total) trans 17179873679 rc 0/0 00000100:00100000:3.0:1746065194.327105:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15028 00000100:00100000:0.0:1746065194.327109:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260433536 00000100:00100000:3.0:1746065194.327110:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260434048 00000100:00100000:0.0:1746065194.327111:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260433536 00000100:00100000:3.0:1746065194.327112:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260434048 00000100:00100000:0.0:1746065194.327116:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260434560 00000100:00100000:0.0:1746065194.327117:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260434560 00000100:00100000:3.0:1746065194.327118:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15029 00000100:00100000:3.0:1746065194.327121:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260433408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065194.327124:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15030 00000100:00100000:0.0:1746065194.327127:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881260433920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.327190:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881260433408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (214us total) trans 17179873680 rc 0/0 00000100:00100000:0.0:1746065194.327191:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260433920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (198us total) trans 21474840966 rc 0/0 00000100:00100000:3.0:1746065194.327194:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15029 00000100:00100000:0.0:1746065194.327196:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15030 00000100:00100000:3.0:1746065194.327202:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15031 00000100:00100000:3.0:1746065194.327205:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881260434432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.327592:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3298:x1830881260434304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1006us (1249us total) trans 21474840963 rc 0/0 00000100:00100000:0.0:1746065194.327689:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15032 00000100:00100000:1.0:1746065194.327694:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15023 00000100:00100000:0.0:1746065194.327695:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260433024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.327697:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15033 00000100:00100000:2.0:1746065194.327712:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260433536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.327718:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15034 00000100:00100000:1.0:1746065194.327724:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3295:x1830881260434048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.327765:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15035 00000100:00100000:2.0:1746065194.327769:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1830881260434560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065194.327772:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065194.327774:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065194.327776:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065194.327778:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065194.327780:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746065194.327791:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065194.327794:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.327796:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.327798:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.327799:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065194.327799:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3295:x1830881260433024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (765us total) trans 17179873681 rc 0/0 00000100:00100000:0.0:1746065194.327804:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15032 00000100:00100000:1.0:1746065194.327834:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260434048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (766us total) trans 21474840967 rc 0/0 00000100:00100000:1.0:1746065194.327839:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15034 00000100:00080000:1.0:1746065194.327854:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746065194.327857:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff5880/2, rc 0, transno 17179873681 00000100:00080000:1.0:1746065194.327858:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065194.327859:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881260434560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (776us total) trans 21474840968 rc 0/0 00000100:00100000:0.0:1746065194.327861:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260433024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.327864:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15035 00000004:00080000:0.0:1746065194.327869:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff4e00/2, rc 0, transno 21474840967 00000100:00100000:0.0:1746065194.327875:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260434048:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065194.327881:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff7480/2, rc 0, transno 21474840968 00000100:00100000:0.0:1746065194.327883:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260434560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065194.327889:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff5f80/2, rc 0, transno 17179873679 00000100:00100000:0.0:1746065194.327891:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260432896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065194.327897:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff4700/2, rc 0, transno 17179873680 00000100:00100000:0.0:1746065194.327899:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260433408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.327901:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881260433536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 199us (850us total) trans 17179873682 rc 0/0 00000004:00080000:0.0:1746065194.327904:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff7100/2, rc 0, transno 21474840966 00000100:00100000:2.0:1746065194.327905:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15033 00000100:00100000:0.0:1746065194.327907:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260433920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065194.327913:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff6a00/2, rc 0, transno 17179873682 00000100:00100000:0.0:1746065194.327916:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260433536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.327956:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260434688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.327975:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065194.328298:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065194.328301:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.328303:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.328304:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.328306:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065194.328326:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1830881260434432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1120us (1316us total) trans 21474840969 rc 0/0 00000100:00100000:3.0:1746065194.328331:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15031 00000100:00100000:3.0:1746065194.328339:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260434688 00000100:00100000:3.0:1746065194.328342:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260434688 00000004:00080000:1.0:1746065194.328419:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff5180/2, rc 0, transno 21474840969 00000100:00100000:1.0:1746065194.328423:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260434432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.329156:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15036 00000100:00100000:3.0:1746065194.329163:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3297:x1830881260434688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.329632:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881260434688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 469us (1655us total) trans 21474840970 rc 0/0 00000100:00100000:3.0:1746065194.329638:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15036 00000004:00080000:3.0:1746065194.329688:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095350a80/2, rc 0, transno 17179873677 00000100:00100000:3.0:1746065194.329691:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260432640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065194.329698:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff7b80/2, rc 0, transno 17179873678 00000100:00100000:3.0:1746065194.329701:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260433152:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065194.329720:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff6680/2, rc 0, transno 21474840964 00000100:00100000:3.0:1746065194.329723:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260433664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065194.329729:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff7800/2, rc 0, transno 21474840965 00000100:00100000:3.0:1746065194.329731:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260434176:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065194.329739:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095352300/2, rc 0, transno 17179873675 00000100:00100000:3.0:1746065194.329741:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260432768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065194.329748:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff4a80/2, rc 0, transno 17179873676 00000100:00100000:3.0:1746065194.329750:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260433280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065194.329757:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff6300/2, rc 0, transno 21474840962 00000100:00100000:3.0:1746065194.329759:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260433792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065194.329766:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff4000/2, rc 0, transno 21474840963 00000100:00100000:3.0:1746065194.329768:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260434304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065194.329841:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094ff4380/2, rc 0, transno 21474840970 00000100:00100000:2.0:1746065194.329845:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260434688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.331921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.334053:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291520 00000100:00100000:2.0:1746065194.334063:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291520 00000100:00100000:2.0:1746065194.334109:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10082 00000100:00100000:2.0:1746065194.334115:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32083:x1830881263291520:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065194.334132:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.334151:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61734 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.334194:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.334205:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.334220:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.334222:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065194.334225:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbe000, rc 0) 00000100:00100000:2.0:1746065194.334268:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32083:x1830881263291520:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 152us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.334273:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10082 00000100:00100000:0.0:1746065194.336945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.337036:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291648 00000100:00100000:2.0:1746065194.337044:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291648 00000100:00100000:2.0:1746065194.337133:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10083 00000100:00100000:2.0:1746065194.337141:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32083:x1830881263291648:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065194.337156:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.337171:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4fe3f1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6173b expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.337240:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbec00/0x14b4f8542d4fe3f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.337250:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbec00/0x14b4f8542d4fe3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.337259:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbec00/0x14b4f8542d4fe3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065194.337280:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065194.337284:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065194.337295:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbec00/0x14b4f8542d4fe3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.337313:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbfc00/0x14b4f8542d4fe3f1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6173b expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.337326:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbec00/0x14b4f8542d4fe3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6173b expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.337332:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.337334:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065194.337336:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ffbec00, rc 0) 00000100:00100000:2.0:1746065194.337379:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32083:x1830881263291648:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 238us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.337384:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10083 00000100:00100000:0.0:1746065194.338759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.338805:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291776 00000100:00100000:3.0:1746065194.338810:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291776 00000100:00100000:3.0:1746065194.338872:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15037 00000100:00100000:3.0:1746065194.338879:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263291776:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065194.338890:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.338905:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61742 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065194.338924:0:2462:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d729, atime: 0x6812d725, ctime: 0x6812d729, blocks: 0x7b1 00010000:00010000:3.0:1746065194.338936:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.338938:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.338944:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 7 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.338957:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 7 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.338966:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25da00, rc 0) 00000100:00100000:3.0:1746065194.339003:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263291776:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 125us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.339009:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15037 00000100:00100000:2.0:1746065194.339129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.339157:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263291904 00000100:00100000:0.0:1746065194.339160:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263291904 00000100:00100000:0.0:1746065194.339184:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15038 00000100:00100000:0.0:1746065194.339190:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263291904:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065194.339197:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065194.339206:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61749 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065194.339219:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d727, atime: 0x6812d725, ctime: 0x6812d727, blocks: 0x821 00010000:00010000:0.0:1746065194.339226:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.339227:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.339231:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.339239:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.339245:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa6e00, rc 0) 00000100:00100000:0.0:1746065194.339268:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263291904:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 78us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.339273:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15038 00000100:00100000:0.0:1746065194.341263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.341300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.341321:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292160 00000100:00100000:0.0:1746065194.341325:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.341327:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292160 00000100:00100000:2.0:1746065194.341351:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292416 00000100:00100000:2.0:1746065194.341352:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292416 00000100:00100000:2.0:1746065194.341372:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292032 00000100:00100000:2.0:1746065194.341375:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292032 00000100:00100000:2.0:1746065194.341392:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15039 00000100:00100000:2.0:1746065194.341399:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263292160:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:1.0:1746065194.341399:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15040 00000100:00100000:1.0:1746065194.341407:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263292416:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065194.341412:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.341415:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.341428:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61757 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.341428:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61765 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065194.341447:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d72b, atime: 0x6812d72a, ctime: 0x6812d72b, blocks: 0x81d 00002000:00010000:1.0:1746065194.341447:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d72b, atime: 0x6812d72a, ctime: 0x6812d72b, blocks: 0x1029 00010000:00010000:2.0:1746065194.341459:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.341459:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.341461:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.341461:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.341467:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.341467:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.341478:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.341478:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.341485:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003b600, rc 0) 00010000:00010000:1.0:1746065194.341485:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4c9b800, rc 0) 00000100:00100000:0.0:1746065194.341502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.341519:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263292416:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.341524:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263292160:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.341524:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15040 00000100:00100000:3.0:1746065194.341525:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292288 00000100:00100000:3.0:1746065194.341528:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292288 00000100:00100000:2.0:1746065194.341530:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15039 00000100:00100000:1.0:1746065194.341538:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15041 00000100:00100000:2.0:1746065194.341541:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15042 00000100:00100000:1.0:1746065194.341542:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263292032:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:2.0:1746065194.341546:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263292288:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065194.341548:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.341552:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.341559:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61750 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.341560:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6175e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065194.341570:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d72b, atime: 0x6812d72a, ctime: 0x6812d72b, blocks: 0x1687 00002000:00010000:1.0:1746065194.341570:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d72a, atime: 0x6812d725, ctime: 0x6812d72a, blocks: 0x821 00010000:00010000:2.0:1746065194.341577:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.341577:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.341578:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.341578:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.341581:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.341582:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.341589:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 9 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.341589:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.341595:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a003ae00, rc 0) 00010000:00010000:1.0:1746065194.341595:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73c000, rc 0) 00000100:00100000:1.0:1746065194.341934:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263292032:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 390us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.341938:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263292288:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 390us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.341940:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15041 00000100:00100000:2.0:1746065194.341943:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15042 00000100:00100000:2.0:1746065194.352905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.353119:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292672 00000100:00100000:1.0:1746065194.353127:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292672 00000100:00100000:1.0:1746065194.353184:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8506 00000100:00100000:1.0:1746065194.353191:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263292672:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065194.353220:0:21488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.353256:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.353257:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.353262:0:21488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.353273:0:21488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.365867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.365903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.365924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.365938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.365951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.365982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.366004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.366025:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263292928 00000100:00100000:0.0:1746065194.366032:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263292928 00000100:00100000:1.0:1746065194.366132:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293184 00000100:00100000:1.0:1746065194.366136:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293184 00000100:00100000:1.0:1746065194.366174:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293568 00000100:00100000:1.0:1746065194.366175:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293568 00000100:00100000:1.0:1746065194.366187:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293440 00000100:00100000:1.0:1746065194.366189:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293440 00000100:00100000:1.0:1746065194.366199:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263293952 00000100:00100000:1.0:1746065194.366200:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263293952 00000100:00100000:1.0:1746065194.366208:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294208 00000100:00100000:1.0:1746065194.366210:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294208 00000100:00100000:1.0:1746065194.366218:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294464 00000100:00100000:1.0:1746065194.366219:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294464 00000100:00100000:1.0:1746065194.366232:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8507 00000100:00100000:1.0:1746065194.366239:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881263293184:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065194.366267:0:8434:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.366279:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.366280:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.366284:0:8434:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.366295:0:8434:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.366734:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8508 00000100:00100000:2.0:1746065194.366742:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263293568:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065194.366758:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.366764:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.366765:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.366768:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.366775:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.366975:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8509 00000100:00100000:3.0:1746065194.366984:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263293440:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065194.366999:0:21484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.367006:0:21484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.367007:0:21484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.367010:0:21484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.367021:0:21484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.367727:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8510 00000100:00100000:2.0:1746065194.367734:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263293952:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065194.367752:0:8433:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.367758:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.367760:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.367762:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.367769:0:8433:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.368058:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8511 00000100:00100000:0.0:1746065194.368064:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1960:x1830881263294208:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065194.368078:0:4012:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.368084:0:4012:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.368085:0:4012:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.368088:0:4012:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.368096:0:4012:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.368183:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8512 00000100:00100000:3.0:1746065194.368189:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881263294464:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065194.368203:0:21483:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.368209:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.368210:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.368212:0:21483:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.368219:0:21483:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.369022:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8513 00000100:00100000:0.0:1746065194.369028:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1960:x1830881263292928:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065194.369044:0:21487:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.369050:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.369052:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.369054:0:21487:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.370006:0:21487:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.374215:0:21488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.374588:0:21488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.374595:0:21488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.374600:0:21488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c757e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065194.374604:0:21488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.374611:0:21488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.374630:0:21488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.374636:0:21488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c757e00/0x14b4f8542d4fe429 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.374721:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1960:x1830881263292672:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 21525us (21819us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.374729:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8506 00010000:00010000:2.0:1746065194.379005:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.379020:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.379028:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.379034:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff55c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065194.379037:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.379044:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.379062:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.379071:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff55c00/0x14b4f8542d4fe437 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.379142:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263293568:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 12398us (13212us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.379150:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8508 00010000:00010000:3.0:1746065194.383653:0:21484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.383667:0:21484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.383673:0:21484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.383678:0:21484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25d200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065194.383682:0:21484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.383689:0:21484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.383716:0:21484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.383722:0:21484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f25d200/0x14b4f8542d4fe43e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.384967:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263293440:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 17977us (19020us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065194.384977:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8509 00010000:00010000:1.0:1746065194.388085:0:4012:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.388101:0:4012:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.388110:0:4012:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.388115:0:4012:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa7e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065194.388118:0:4012:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.388125:0:4012:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.388141:0:4012:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.388146:0:4012:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa7e00/0x14b4f8542d4fe44c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.390127:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263294208:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 22053us (24134us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065194.390138:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8511 00010000:00010000:3.0:1746065194.397134:0:21483:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.397149:0:21483:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.397156:0:21483:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.397162:0:21483:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25d600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065194.397166:0:21483:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.397172:0:21483:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.397189:0:21483:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.397195:0:21483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f25d600/0x14b4f8542d4fe453 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.397300:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1960:x1830881263294464:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 29106us (31290us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746065194.398284:0:8434:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.398295:0:8434:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.398302:0:8434:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.398312:0:8434:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fccd600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065194.398316:0:8434:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.398322:0:8434:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.398335:0:8434:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.398340:0:8434:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fccd600/0x14b4f8542d4fe430 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.398391:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1960:x1830881263293184:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 32150us (32483us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065194.398399:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8507 00000100:00100000:3.0:1746065194.398482:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8512 00010000:00010000:2.0:1746065194.403057:0:8433:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.403070:0:8433:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.403076:0:8433:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.403082:0:8433:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff55e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065194.403085:0:8433:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.403091:0:8433:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.403106:0:8433:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.403112:0:8433:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe445 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.403205:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263293952:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 35467us (37249us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.403214:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8510 00010000:00010000:2.0:1746065194.407908:0:21487:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.407922:0:21487:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.407928:0:21487:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.407933:0:21487:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa7400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065194.407937:0:21487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.407943:0:21487:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.407957:0:21487:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.407963:0:21487:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7400/0x14b4f8542d4fe45a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.408044:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263292928:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 39012us (42181us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.408054:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8513 00000100:00100000:0.0:1746065194.414660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.414767:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294720 00000100:00100000:2.0:1746065194.414774:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294720 00000100:00100000:2.0:1746065194.414844:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10084 00000100:00100000:2.0:1746065194.414851:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32083:x1830881263294720:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:2.0:1746065194.414892:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.414912:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbec00/0x14b4f8542d4fe3f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6173b expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.414934:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.414938:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065194.414965:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.414974:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.414980:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00010000:2.0:1746065194.415119:0:16767:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f2c7b80 reply state ffff88009ffc9000 transno 8589944370 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:2.0:1746065194.415125:0:16767:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065194.415186:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32083:x1830881263294720:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 335us (533us total) trans 8589944370 rc 0/0 00000100:00100000:2.0:1746065194.415191:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10084 00010000:00010000:2.0:1746065194.416632:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.416649:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.416654:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.416659:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bddce00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.416662:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.416667:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.416856:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.416858:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065194.416861:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.416866:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddce00/0x14b4f8542d4fe461 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065194.417007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.417040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.417094:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294848 00000100:00100000:2.0:1746065194.417099:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295104 00000100:00100000:3.0:1746065194.417100:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294848 00000100:00100000:2.0:1746065194.417103:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295104 00000100:00100000:3.0:1746065194.417130:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15043 00000100:00100000:3.0:1746065194.417136:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263294848:12345-192.168.202.46@tcp:2:lfs.0 00000100:00100000:2.0:1746065194.417145:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15044 00000100:00100000:2.0:1746065194.417151:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263295104:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065194.417264:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065194.417264:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065194.417267:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065193 -> 1746065195 00002000:00010000:2.0:1746065194.417267:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065194 -> 1746065195 00002000:00010000:3.0:1746065194.417268:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065189 -> 1746065195 00002000:00010000:2.0:1746065194.417268:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065189 -> 1746065195 00002000:00010000:3.0:1746065194.417270:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065193 -> 1746065195 00002000:00010000:2.0:1746065194.417270:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065194 -> 1746065195 00002000:00010000:3.0:1746065194.417272:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00002000:00010000:2.0:1746065194.417272:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065194.417318:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263294848:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 181us (312us total) trans 21474840971 rc 0/0 00000100:00100000:3.0:1746065194.417324:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15043 00000100:00100000:0.0:1746065194.417924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.418003:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263295104:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 851us (961us total) trans 17179873683 rc 0/0 00000100:00100000:2.0:1746065194.418010:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15044 00000100:00100000:2.0:1746065194.419187:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295360 00000100:00100000:2.0:1746065194.419194:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295360 00000100:00100000:2.0:1746065194.419401:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15045 00000100:00100000:2.0:1746065194.419408:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263295360:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:2.0:1746065194.419520:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:2.0:1746065194.419523:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.419525:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065194 -> 1746065195 00002000:00010000:2.0:1746065194.419526:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.419528:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5767 -> 5767 00000100:00100000:2.0:1746065194.419550:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263295360:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 143us (1626us total) trans 21474840972 rc 0/0 00000100:00100000:2.0:1746065194.419555:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15045 00000100:00100000:2.0:1746065194.419590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.419603:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263294976 00000100:00100000:2.0:1746065194.419603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.419607:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263294976 00000100:00100000:2.0:1746065194.419619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.419635:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295232 00000100:00100000:3.0:1746065194.419638:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295232 00000100:00100000:2.0:1746065194.419642:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295488 00000100:00100000:2.0:1746065194.419645:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295488 00000100:00100000:3.0:1746065194.419649:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15046 00000100:00100000:3.0:1746065194.419659:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263294976:12345-192.168.202.46@tcp:2:lfs.0 00000100:00100000:1.0:1746065194.419661:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15047 00000100:00100000:1.0:1746065194.419669:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263295232:12345-192.168.202.46@tcp:2:lfs.0 00000100:00100000:2.0:1746065194.419670:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15048 00000100:00100000:2.0:1746065194.419674:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263295488:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:1.0:1746065194.419747:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065194.419750:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.419752:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065194 -> 1746065195 00002000:00010000:1.0:1746065194.419753:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.419755:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00010000:3.0:1746065194.419765:0:9716:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065194.419768:0:9716:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065191 -> 1746065195 00002000:00010000:2.0:1746065194.419768:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065194.419770:0:9716:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065189 -> 1746065195 00002000:00010000:2.0:1746065194.419770:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:3.0:1746065194.419772:0:9716:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065191 -> 1746065195 00002000:00010000:2.0:1746065194.419772:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065194 -> 1746065195 00002000:00010000:3.0:1746065194.419773:0:9716:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065194.419773:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263295232:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 105us (168us total) trans 21474840973 rc 0/0 00002000:00010000:2.0:1746065194.419774:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.419776:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065194.419782:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15047 00000100:00100000:3.0:1746065194.419792:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263294976:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 133us (202us total) trans 17179873684 rc 0/0 00000100:00100000:2.0:1746065194.419794:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263295488:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 119us (173us total) trans 17179873685 rc 0/0 00000100:00100000:3.0:1746065194.419798:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15046 00000100:00100000:2.0:1746065194.419800:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15048 00000100:00100000:2.0:1746065194.422445:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.423428:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295744 00000100:00100000:3.0:1746065194.423436:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295744 00000100:00100000:3.0:1746065194.423482:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4349 00000100:00100000:3.0:1746065194.423488:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32083:x1830881263295744:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:3.0:1746065194.423537:0:1385:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x30c:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe3ab lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6172d expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.423581:0:1385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 1385 initiator: MDT0 00010000:00010000:3.0:1746065194.423590:0:1385:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.423596:0:1385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 1385 initiator: MDT0 00010000:00010000:3.0:1746065194.423618:0:1385:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.423632:0:1385:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 9 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.423643:0:1385:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:1385:1830881260434816:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.423735:0:1385:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5938300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.428998:0:1385:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:1385:1830881260434816:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.429020:0:1385:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00000100:00100000:0.0:1746065194.429071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.429475:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263295872 00000100:00100000:1.0:1746065194.429481:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263295872 00010000:00010000:1.0:1746065194.429513:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 10 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.429548:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7757 00000100:00100000:1.0:1746065194.429559:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263295872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.429569:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.429574:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 10 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.429585:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 10 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.429602:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ffbe000/0x14b4f8542d4fe3ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61734 expref: 10 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.429629:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:1.0:1746065194.429634:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00010000:00010000:1.0:1746065194.429641:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 1385 initiator: MDT0 00010000:00010000:1.0:1746065194.429647:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 1385 initiator: MDT0 00010000:00010000:1.0:1746065194.429676:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.429716:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263295872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 157us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.429723:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7757 00010000:00010000:3.0:1746065194.429951:0:1385:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00010000:00010000:3.0:1746065194.429957:0:1385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00000040:00080000:3.0:1746065194.430478:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3120, 88 off263992 00000004:00080000:3.0:1746065194.430485:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721668819ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430531:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3142, 88 off266104 00000004:00080000:3.0:1746065194.430534:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793721719095ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065194.430559:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3143, 88 off266192 00000004:00080000:3.0:1746065194.430562:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793721747081ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065194.430570:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3121, 88 off264080 00000004:00080000:3.0:1746065194.430573:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721757654ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430579:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3122, 88 off264168 00000004:00080000:3.0:1746065194.430581:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721765784ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430587:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3144, 88 off266280 00000004:00080000:3.0:1746065194.430590:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793721774412ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065194.430597:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3145, 88 off266368 00000004:00080000:3.0:1746065194.430599:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793721783636ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065194.430605:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3146, 88 off266456 00000004:00080000:3.0:1746065194.430607:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793721791391ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065194.430613:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3123, 88 off264256 00000004:00080000:3.0:1746065194.430615:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721799662ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430621:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3147, 88 off266544 00000004:00080000:3.0:1746065194.430623:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793721807424ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065194.430628:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3124, 88 off264344 00000004:00080000:3.0:1746065194.430630:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721815222ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430637:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3148, 88 off266632 00000004:00080000:3.0:1746065194.430639:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793721823464ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065194.430645:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3125, 88 off264432 00000004:00080000:3.0:1746065194.430647:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721831827ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430653:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3126, 88 off264520 00000004:00080000:3.0:1746065194.430655:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721840025ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430660:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3127, 88 off264608 00000004:00080000:3.0:1746065194.430663:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721847714ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430669:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3128, 88 off264696 00000004:00080000:3.0:1746065194.430671:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793721855697ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065194.430677:0:1385:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3149, 88 off266720 00000004:00080000:3.0:1746065194.430680:0:1385:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793721864295ns, next at 737095943431ns, rc = 0 00000004:00010000:2.0:1746065194.453981:0:1385:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b87a050 reply state ffff88009c2bcc00 transno 8589944371 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1385 initiator: MDT0 00000100:00100000:2.0:1746065194.453995:0:1385:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746065194.454003:0:1385:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.454005:0:1385:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065194.454013:0:1385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe3ab lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6172d expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.454093:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32083:x1830881263295744:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 30605us (31655us total) trans 8589944371 rc 0/0 00000100:00100000:2.0:1746065194.454101:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4349 00000001:00080000:1.0:1746065194.454180:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944370 is committed 00000001:00080000:1.0:1746065194.454193:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944371 is committed 00000004:00080000:1.0:1746065194.454195:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2430 committed 00000004:00080000:1.0:1746065194.454201:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2408 committed 00000004:00080000:1.0:1746065194.454205:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2407 committed 00000004:00080000:1.0:1746065194.454207:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2406 committed 00000004:00080000:1.0:1746065194.454208:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2405 committed 00000004:00080000:1.0:1746065194.454209:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2429 committed 00000004:00080000:1.0:1746065194.454210:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2404 committed 00000004:00080000:1.0:1746065194.454212:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2428 committed 00000004:00080000:1.0:1746065194.454213:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2403 committed 00000004:00080000:1.0:1746065194.454214:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2427 committed 00000004:00080000:1.0:1746065194.454215:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2426 committed 00000004:00080000:1.0:1746065194.454216:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2425 committed 00000004:00080000:1.0:1746065194.454217:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2402 committed 00000004:00080000:1.0:1746065194.454218:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2401 committed 00000004:00080000:1.0:1746065194.454220:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2424 committed 00000004:00080000:1.0:1746065194.454221:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2423 committed 00000004:00080000:1.0:1746065194.454222:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2400 committed 00000100:00100000:1.0:1746065194.454327:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260435072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.454357:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.454386:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260435584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.454396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.454404:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260436096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.454418:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.454427:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260436608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.454437:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.454447:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746065194.454451:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260435200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.454460:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.454468:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260435712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.454477:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.454487:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260436224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.454499:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.454508:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260436736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.454523:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.454543:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435072 00000100:00100000:1.0:1746065194.454548:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435072 00000100:00100000:1.0:1746065194.454571:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435584 00000100:00100000:1.0:1746065194.454573:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435584 00000100:00100000:1.0:1746065194.454582:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260436096 00000100:00100000:1.0:1746065194.454583:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260436096 00000100:00100000:1.0:1746065194.454593:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260436608 00000100:00100000:1.0:1746065194.454594:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260436608 00000100:00100000:1.0:1746065194.454601:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435200 00000100:00100000:1.0:1746065194.454603:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435200 00000100:00100000:1.0:1746065194.454607:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435712 00000100:00100000:1.0:1746065194.454609:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435712 00000100:00100000:1.0:1746065194.454613:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260436224 00000100:00100000:1.0:1746065194.454615:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260436224 00000100:00100000:1.0:1746065194.454620:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260436736 00000100:00100000:1.0:1746065194.454621:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260436736 00000100:00100000:1.0:1746065194.454631:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15049 00000100:00100000:1.0:1746065194.454636:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260435072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065194.454779:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065194.454782:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.454784:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.454786:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.454788:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065194.454807:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881260435072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (450us total) trans 17179873686 rc 0/0 00000100:00100000:1.0:1746065194.454812:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15049 00000100:00100000:1.0:1746065194.454837:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15050 00000100:00100000:1.0:1746065194.454841:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260435584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.454900:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881260435584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (503us total) trans 17179873687 rc 0/0 00000100:00100000:1.0:1746065194.454904:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15050 00000100:00100000:1.0:1746065194.454911:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15051 00000100:00100000:1.0:1746065194.454915:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881260436096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065194.454982:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065194.454984:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.454985:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.454987:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.454988:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746065194.455001:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881260436096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (583us total) trans 21474840974 rc 0/0 00000100:00100000:1.0:1746065194.455005:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15051 00000100:00100000:1.0:1746065194.455013:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15052 00000100:00100000:1.0:1746065194.455016:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881260436608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.455067:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881260436608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (629us total) trans 21474840975 rc 0/0 00000100:00100000:1.0:1746065194.455071:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15052 00000100:00100000:1.0:1746065194.455079:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15053 00000100:00100000:1.0:1746065194.455082:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260435200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065194.455131:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065194.455132:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.455134:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.455135:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.455137:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065194.455153:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881260435200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (691us total) trans 17179873688 rc 0/0 00000100:00100000:1.0:1746065194.455158:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15053 00000100:00100000:1.0:1746065194.455166:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15054 00000100:00100000:1.0:1746065194.455170:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3295:x1830881260435712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.455239:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3295:x1830881260435712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (760us total) trans 17179873689 rc 0/0 00000100:00100000:1.0:1746065194.455243:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15054 00000100:00100000:1.0:1746065194.455251:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15055 00000100:00100000:1.0:1746065194.455255:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881260436224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065194.455312:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:1.0:1746065194.455314:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.455316:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.455317:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065194.455319:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5767 -> 5767 00000100:00100000:1.0:1746065194.455336:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881260436224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (836us total) trans 21474840976 rc 0/0 00000100:00100000:1.0:1746065194.455341:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15055 00000100:00100000:1.0:1746065194.455350:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15056 00000100:00100000:1.0:1746065194.455354:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3295:x1830881260436736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065194.455408:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065194.455410:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.455412:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.455413:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.455414:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065194.455431:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830881260436736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (907us total) trans 21474840977 rc 0/0 00000100:00100000:1.0:1746065194.455436:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15056 00000004:00080000:1.0:1746065194.455618:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf70700/2, rc 0, transno 17179873688 00000100:00100000:1.0:1746065194.455623:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260435200:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065194.455630:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf71500/2, rc 0, transno 17179873689 00000100:00100000:1.0:1746065194.455632:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260435712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065194.455637:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf72300/2, rc 0, transno 21474840976 00000100:00100000:1.0:1746065194.455642:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260436224:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065194.455646:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf73100/2, rc 0, transno 21474840977 00000100:00100000:1.0:1746065194.455649:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260436736:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065194.455653:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf70380/2, rc 0, transno 17179873686 00000100:00100000:1.0:1746065194.455655:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260435072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065194.455659:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf71180/2, rc 0, transno 17179873687 00000100:00100000:1.0:1746065194.455661:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260435584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065194.455669:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf71f80/2, rc 0, transno 21474840974 00000100:00100000:1.0:1746065194.455671:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260436096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065194.455676:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf72d80/2, rc 0, transno 21474840975 00000100:00100000:1.0:1746065194.455678:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260436608:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065194.455839:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065194.455847:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065194.455853:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065194.455858:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25ca00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.455862:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065194.455867:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065194.455879:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff880133205600) 00010000:00010000:2.0:1746065194.455881:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065194.455884:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1746065194.455888:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe468 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1385 initiator: MDT0 00000100:00100000:2.0:1746065194.455908:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260435328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.455926:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.455948:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260435840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.455958:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.455965:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260436352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.455974:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.455980:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260436864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.455989:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.455997:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:2.0:1746065194.456000:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260434944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.456009:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.456015:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260435456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.456023:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.456029:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260435968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.456038:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.456044:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bf72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260436480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.456052:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.456057:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260436992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.456065:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.456079:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435328 00000100:00100000:2.0:1746065194.456082:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435328 00000100:00100000:2.0:1746065194.456092:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435840 00000100:00100000:2.0:1746065194.456094:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435840 00000100:00100000:2.0:1746065194.456098:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260436352 00000100:00100000:2.0:1746065194.456099:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260436352 00000100:00100000:2.0:1746065194.456103:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260436864 00000100:00100000:2.0:1746065194.456105:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260436864 00000100:00100000:2.0:1746065194.456109:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260434944 00000100:00100000:2.0:1746065194.456110:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260434944 00000100:00100000:2.0:1746065194.456113:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435456 00000100:00100000:2.0:1746065194.456114:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435456 00000100:00100000:2.0:1746065194.456118:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260435968 00000100:00100000:2.0:1746065194.456119:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260435968 00000100:00100000:2.0:1746065194.456123:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260436480 00000100:00100000:2.0:1746065194.456124:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260436480 00000100:00100000:2.0:1746065194.456128:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260436992 00000100:00100000:2.0:1746065194.456129:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260436992 00000100:00100000:2.0:1746065194.456134:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15057 00000100:00100000:2.0:1746065194.456137:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881260435328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065194.456197:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456199:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:2.0:1746065194.456201:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:2.0:1746065194.456202:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:2.0:1746065194.456204:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065194.456220:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260435328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (294us total) trans 17179873690 rc 0/0 00000100:00100000:2.0:1746065194.456224:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15057 00000100:00100000:2.0:1746065194.456234:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15058 00000100:00100000:2.0:1746065194.456237:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881260435840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.456292:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260435840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (333us total) trans 17179873691 rc 0/0 00000100:00100000:2.0:1746065194.456297:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15058 00000100:00100000:2.0:1746065194.456305:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15059 00000100:00100000:2.0:1746065194.456309:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260436352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065194.456367:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456369:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456371:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456372:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456374:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065194.456390:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881260436352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (415us total) trans 21474840978 rc 0/0 00000100:00100000:2.0:1746065194.456394:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15059 00000100:00100000:2.0:1746065194.456402:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15060 00000100:00100000:2.0:1746065194.456406:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260436864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.456470:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881260436864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (479us total) trans 21474840979 rc 0/0 00000100:00100000:2.0:1746065194.456474:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15060 00000100:00100000:2.0:1746065194.456482:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15061 00000100:00100000:2.0:1746065194.456485:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881260434944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065194.456544:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065194.456547:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.456548:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.456551:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.456552:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065194.456568:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260434944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (558us total) trans 17179873692 rc 0/0 00000100:00100000:2.0:1746065194.456572:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15061 00000100:00100000:2.0:1746065194.456581:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15062 00000100:00100000:2.0:1746065194.456584:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881260435456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065194.456640:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456641:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456643:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456644:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.456645:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065194.456662:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260435456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (638us total) trans 17179873693 rc 0/0 00000100:00100000:2.0:1746065194.456666:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15062 00000100:00100000:2.0:1746065194.456674:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15063 00000100:00100000:2.0:1746065194.456678:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260435968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065194.456754:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065194.456757:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.456758:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.456760:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.456761:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:2.0:1746065194.456778:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881260435968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (739us total) trans 21474840980 rc 0/0 00000100:00100000:2.0:1746065194.456783:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15063 00000100:00100000:2.0:1746065194.456791:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15064 00000100:00100000:2.0:1746065194.456795:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260436480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.456898:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881260436480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (844us total) trans 21474840981 rc 0/0 00000100:00100000:2.0:1746065194.456903:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15064 00000100:00100000:2.0:1746065194.456912:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15065 00000100:00100000:2.0:1746065194.456916:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260436992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.456983:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881260436992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (916us total) trans 21474840982 rc 0/0 00000100:00100000:2.0:1746065194.456988:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15065 00000004:00080000:2.0:1746065194.457023:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf70000/2, rc 0, transno 17179873692 00000100:00100000:2.0:1746065194.457027:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260434944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065194.457033:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf70e00/2, rc 0, transno 17179873693 00000100:00100000:2.0:1746065194.457035:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260435456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065194.457041:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf71c00/2, rc 0, transno 21474840980 00000100:00100000:2.0:1746065194.457043:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260435968:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065194.457048:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf72a00/2, rc 0, transno 21474840981 00000100:00100000:2.0:1746065194.457050:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260436480:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065194.457055:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b620000/2, rc 0, transno 21474840982 00000100:00100000:2.0:1746065194.457057:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260436992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065194.457062:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf70a80/2, rc 0, transno 17179873690 00000100:00100000:2.0:1746065194.457064:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260435328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065194.457069:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf71880/2, rc 0, transno 17179873691 00000100:00100000:2.0:1746065194.457072:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260435840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065194.457079:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf72680/2, rc 0, transno 21474840978 00000100:00100000:2.0:1746065194.457081:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260436352:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065194.457087:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bf73480/2, rc 0, transno 21474840979 00000100:00100000:2.0:1746065194.457089:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bf73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260436864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.459895:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.463404:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296000 00000100:00100000:2.0:1746065194.463415:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296000 00000100:00100000:2.0:1746065194.463468:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10085 00000100:00100000:2.0:1746065194.463476:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:32083:x1830881263296000:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065194.463494:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.463509:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6176c expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.463554:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.463564:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.463579:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.463581:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065194.463583:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bddc200, rc 0) 00000100:00100000:2.0:1746065194.464007:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32083:x1830881263296000:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 530us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.464013:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10085 00000100:00100000:0.0:1746065194.469472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.469749:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296256 00000100:00100000:2.0:1746065194.469756:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296256 00000100:00100000:2.0:1746065194.469847:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4350 00000100:00100000:2.0:1746065194.469855:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32083:x1830881263296256:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1746065194.470072:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32083:x1830881263296256:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 217us (606us total) trans 8589944372 rc 0/0 00000100:00100000:2.0:1746065194.470079:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4350 00000100:00100000:0.0:1746065194.490493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.490760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.490936:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296512 00000100:00100000:2.0:1746065194.490943:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296512 00000100:00100000:2.0:1746065194.490981:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263296768 00000100:00100000:2.0:1746065194.490983:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263296768 00000100:00100000:3.0:1746065194.490995:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10086 00000100:00100000:2.0:1746065194.491004:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10087 00000100:00100000:3.0:1746065194.491006:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:32094:x1830881263296512:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065194.491009:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+6:32091:x1830881263296768:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065194.491024:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.491024:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.491037:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25dc00/0x14b4f8542d4fe47d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61773 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.491037:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6177a expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.491130:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.491136:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065194.491140:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491148:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.491149:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491156:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065194.491160:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.491164:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065194.491165:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491170:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.491170:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491183:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491263:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065194.491264:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065194.491270:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491275:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065194.491282:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065194.491347:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491352:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491357:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491361:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bddd400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.491364:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491370:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491378:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065194.491380:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065194.491383:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491390:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddd400/0x14b4f8542d4fe48b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491415:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491419:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491423:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491427:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f429000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.491429:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491433:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491439:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012cf55b00) 00010000:00010000:2.0:1746065194.491441:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065194.491443:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491446:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe499 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.491473:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.491485:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.491494:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.491496:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065194.491498:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f429600, rc 0) 00010000:00010000:3.0:1746065194.491627:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491634:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065194.491641:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065194.491682:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491687:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491694:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491698:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25c800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065194.491710:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491715:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491722:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065194.491724:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065194.491726:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491730:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c800/0x14b4f8542d4fe484 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491752:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491756:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491761:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491765:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f25d000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065194.491768:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491772:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491781:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012cf55b00) 00010000:00010000:3.0:1746065194.491783:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065194.491785:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491790:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25d000/0x14b4f8542d4fe492 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.491990:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25dc00/0x14b4f8542d4fe47d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.491999:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.492004:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065194.492005:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065194.492007:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25c200, rc 0) 00000100:00100000:2.0:1746065194.492015:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:32091:x1830881263296768:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1004us (1253us total) trans 8589944373 rc 0/0 00000100:00100000:2.0:1746065194.492021:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10087 00000100:00100000:3.0:1746065194.492025:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32094:x1830881263296512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1022us (1540us total) trans 8589944374 rc 0/0 00000100:00100000:3.0:1746065194.492031:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10086 00000100:00100000:2.0:1746065194.494647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.494714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.495546:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297152 00000100:00100000:3.0:1746065194.495554:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297152 00000100:00100000:3.0:1746065194.495605:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15066 00000100:00100000:3.0:1746065194.495613:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32094:x1830881263297152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.495627:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.495641:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61788 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.495662:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.495664:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.495670:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.495682:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 35 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.495691:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25d400, rc 0) 00000100:00100000:3.0:1746065194.496046:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:32094:x1830881263297152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 432us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.496052:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15066 00000100:00100000:3.0:1746065194.496071:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297024 00000100:00100000:3.0:1746065194.496075:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297024 00000100:00100000:3.0:1746065194.496091:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10088 00000100:00100000:3.0:1746065194.496095:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32090:x1830881263297024:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065194.496107:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.496116:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25de00/0x14b4f8542d4fe4c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61781 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.496183:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.496194:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.496199:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.496205:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.496228:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.496238:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 250 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.496247:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260437120:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.497163:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.497172:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 7 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.497179:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260437248:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.497200:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.500858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.501785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.501831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.501914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.501939:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297920 00000100:00100000:2.0:1746065194.501945:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297920 00002000:00100000:2.0:1746065194.501979:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880093ba1c00 x1830881263297920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.501988:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1c00 with x1830881263297920 ext(0->1048575) 00002000:00010000:2.0:1746065194.501993:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba1c00 00000100:00100000:2.0:1746065194.502009:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8514 00000100:00100000:2.0:1746065194.502014:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263297920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065194.502135:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297280 00000100:00100000:0.0:1746065194.502139:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297280 00010000:00010000:0.0:1746065194.502162:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 251 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.502179:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297536 00000100:00100000:0.0:1746065194.502181:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297536 00010000:00010000:0.0:1746065194.502190:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 8 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065194.502202:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7758 00000100:00100000:0.0:1746065194.502207:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881263297280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.502214:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.502220:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 251 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.502228:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 251 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.502246:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065194.502250:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065194.502257:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065194.502261:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.502295:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881263297280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.502301:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7758 00000100:00100000:0.0:1746065194.502316:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7759 00000100:00100000:0.0:1746065194.502321:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1958:x1830881263297536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.502326:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.502330:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 8 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.502337:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 8 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.502347:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065194.502350:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065194.502356:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065194.502361:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065194.502374:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.502388:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1958:x1830881263297536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.502393:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7759 00000100:00100000:1.0:1746065194.502477:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263297664 00000100:00100000:1.0:1746065194.502481:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263297664 00000100:00100000:1.0:1746065194.502514:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10089 00000100:00100000:1.0:1746065194.502520:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:32095:x1830881263297664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065194.502533:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.502543:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fe4d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6178f expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.502606:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.502614:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.502620:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:1.0:1746065194.502628:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065194.502721:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fe4d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.502736:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.502742:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.502745:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065194.502747:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b5600, rc 0) 00000100:00100000:1.0:1746065194.502770:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:32095:x1830881263297664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 251us (1921us total) trans 8589944375 rc 0/0 00000100:00100000:1.0:1746065194.502774:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10089 00010000:00010000:3.0:1746065194.502997:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c200/0x14b4f8542d4fe4a7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61773 expref: 250 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.503022:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260437120:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.503033:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429600/0x14b4f8542d4fe4a0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6177a expref: 9 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.503041:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260437248:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.503057:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.503063:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065194.503067:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065194.503076:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065194.503130:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25de00/0x14b4f8542d4fe4c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.503140:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.503145:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065194.503147:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065194.503149:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25c400, rc 0) 00000100:00100000:3.0:1746065194.503170:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32090:x1830881263297024:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7074us (8613us total) trans 8589944376 rc 0/0 00000100:00100000:3.0:1746065194.503175:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10088 00000100:00100000:0.0:1746065194.509188:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.509288:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298048 00000100:00100000:2.0:1746065194.509296:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298048 00000100:00100000:2.0:1746065194.509343:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10090 00000100:00100000:2.0:1746065194.509349:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:32095:x1830881263298048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065194.509369:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.509384:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe4ed lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61796 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.509880:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065194.509893:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.509900:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065194.509925:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.509935:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 249 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.509945:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437376:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.510026:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a59d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.510653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.511190:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263297920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9174us (9356us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.511199:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8514 00002000:00100000:2.0:1746065194.511208:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880093ba1c00 x1830881263297920/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.511216:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1c00 with x1830881263297920 ext(0->1048575) 00002000:00010000:2.0:1746065194.511219:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba1c00 00000100:00100000:2.0:1746065194.511245:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298176 00000100:00100000:2.0:1746065194.511250:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298176 00000100:00100000:2.0:1746065194.511283:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10091 00000100:00100000:2.0:1746065194.511289:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32090:x1830881263298176:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065194.511301:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.511311:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428400/0x14b4f8542d4fe4fb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6179d expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.511344:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428400/0x14b4f8542d4fe4fb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6179d expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.511354:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428400/0x14b4f8542d4fe4fb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6179d expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.511369:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.511372:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065194.511374:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f428400, rc 0) 00000100:00100000:2.0:1746065194.511468:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32090:x1830881263298176:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 177us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.511473:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10091 00000100:00100000:2.0:1746065194.511893:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437376:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.511909:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065194.512497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.512562:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298304 00000100:00100000:1.0:1746065194.512566:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298304 00010000:00010000:1.0:1746065194.512582:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 251 pid: 14644 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.512599:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7760 00000100:00100000:1.0:1746065194.512604:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1959:x1830881263298304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.512613:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.512617:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 251 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.512626:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 251 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.512640:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c400/0x14b4f8542d4fe4ca lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61781 expref: 251 pid: 14644 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.512668:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.512671:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.512677:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.512685:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.512715:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.512735:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1959:x1830881263298304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.512740:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7760 00010000:00010000:3.0:1746065194.513052:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065194.513059:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065194.513086:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065194.513090:0:24350:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065194.513102:0:24350:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065194.513127:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f429000/0x14b4f8542d4fe4ed lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 11 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.513139:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.513145:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065194.513147:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065194.513149:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bddcc00, rc 0) 00000100:00100000:3.0:1746065194.513171:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:32095:x1830881263298048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3822us (3992us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.513177:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10090 00000100:00100000:2.0:1746065194.513572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.514057:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298560 00000100:00100000:3.0:1746065194.514062:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298560 00000100:00100000:3.0:1746065194.514115:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10092 00000100:00100000:3.0:1746065194.514120:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32090:x1830881263298560:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065194.514131:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.514133:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065194.514288:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f428400/0x14b4f8542d4fe4fb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6179d expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.514298:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065194.514301:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065194.514309:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c600/0x14b4f8542d4fe502 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617a4 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.514346:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065194.514355:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.514361:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.514367:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.514371:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065194.514392:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.514402:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 9 pid: 24350 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.514412:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437504:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.514486:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.514493:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 9 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.514505:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437632:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.514528:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.514535:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 7 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.514540:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437760:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.514554:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.516110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.516161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.516227:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298688 00000100:00100000:1.0:1746065194.516233:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298688 00010000:00010000:1.0:1746065194.516254:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 10 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.516273:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298816 00000100:00100000:1.0:1746065194.516276:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298816 00010000:00010000:1.0:1746065194.516285:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 8 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.516299:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7761 00000100:00100000:1.0:1746065194.516304:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881263298688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065194.516308:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7762 00010000:00010000:1.0:1746065194.516313:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065194.516314:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263298816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.516317:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 10 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.516319:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.516322:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 8 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.516325:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 10 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.516334:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 8 pid: 16767 timeout: 893 lvb_type: 0 00000100:00100000:3.0:1746065194.516383:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437504:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.516390:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437632:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.516397:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437760:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065194.516411:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe4d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6178f expref: 10 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.516414:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.516429:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.516432:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.516438:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.516443:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.516480:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263298688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 175us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.516486:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7761 00010000:00010000:0.0:1746065194.516541:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddc200/0x14b4f8542d4fe46f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6176c expref: 8 pid: 16767 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065194.516554:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065194.516557:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065194.516561:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:0.0:1746065194.516565:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.516580:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263298816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 267us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.516593:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7762 00000100:00100000:0.0:1746065194.519812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.519872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.519908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.519969:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263298944 00000100:00100000:2.0:1746065194.519969:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299200 00000100:00100000:3.0:1746065194.519975:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263298944 00000100:00100000:2.0:1746065194.519975:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299200 00000100:00100000:1.0:1746065194.520011:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299072 00000100:00100000:3.0:1746065194.520012:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15067 00000100:00100000:1.0:1746065194.520015:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299072 00000100:00100000:3.0:1746065194.520019:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+30:32095:x1830881263298944:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.520031:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.520035:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 9 pid: 24350 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.520042:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617ab expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.520053:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7763 00000100:00100000:1.0:1746065194.520058:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263299072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.520062:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.520064:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.520066:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.520069:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 31 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.520072:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 9 pid: 24350 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.520080:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 31 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.520081:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 9 pid: 24350 timeout: 893 lvb_type: 0 00010000:00010000:3.0:1746065194.520089:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff55000, rc 0) 00010000:00010000:1.0:1746065194.520095:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bddcc00/0x14b4f8542d4fe4f4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61796 expref: 9 pid: 24350 timeout: 893 lvb_type: 0 00010000:00010000:1.0:1746065194.520113:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.520117:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065194.520123:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+31:32095:x1830881263298944:12345-192.168.202.46@tcp:101:cat.0 Request processed in 104us (317us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065194.520124:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065194.520128:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15067 00010000:00010000:1.0:1746065194.520129:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065194.520141:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15068 00010000:00010000:1.0:1746065194.520144:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.520145:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:32094:x1830881263299200:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.520152:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.520159:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617b2 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.520161:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:1959:x1830881263299072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.520166:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7763 00010000:00010000:3.0:1746065194.520169:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.520170:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.520174:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 39 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.520182:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 39 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.520183:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065194.520188:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff55e00, rc 0) 00010000:00010000:1.0:1746065194.520189:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065194.520201:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:32094:x1830881263299200:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.520208:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15068 00000040:00080000:1.0:1746065194.521609:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3129, 88 off264784 00000004:00080000:1.0:1746065194.521616:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793812800449ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.521661:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3150, 88 off266808 00000004:00080000:1.0:1746065194.521666:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793812850469ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065194.521683:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3151, 88 off266896 00000004:00080000:1.0:1746065194.523227:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793814409510ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065194.523268:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3130, 88 off264872 00000004:00080000:1.0:1746065194.523274:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793814459052ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.523299:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3131, 88 off264960 00000004:00080000:1.0:1746065194.523302:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793814487007ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.523313:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3152, 88 off266984 00000004:00080000:1.0:1746065194.523316:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793814500717ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065194.523323:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3153, 88 off267072 00000004:00080000:1.0:1746065194.523325:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793814509450ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065194.523331:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3154, 88 off267160 00000004:00080000:1.0:1746065194.523333:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793814517705ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065194.523340:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3132, 88 off265048 00000004:00080000:1.0:1746065194.523344:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793814528525ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.523350:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3155, 88 off267248 00000004:00080000:1.0:1746065194.523353:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793814537480ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065194.523359:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3133, 88 off265136 00000004:00080000:1.0:1746065194.523361:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793814546046ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.523368:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3156, 88 off267336 00000004:00080000:1.0:1746065194.523370:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793814554725ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065194.523376:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3134, 88 off265224 00000004:00080000:1.0:1746065194.523378:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793814562900ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.523384:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3135, 88 off265312 00000004:00080000:1.0:1746065194.523386:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793814571241ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.523393:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3136, 88 off265400 00000004:00080000:1.0:1746065194.523395:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793814579963ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.523401:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3137, 88 off265488 00000004:00080000:1.0:1746065194.523404:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793814588390ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065194.523410:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3157, 88 off267424 00000004:00080000:1.0:1746065194.523412:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793814596723ns, next at 737095943431ns, rc = 0 00000100:00100000:3.0:1746065194.523719:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.523797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.523991:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299328 00000100:00100000:1.0:1746065194.523998:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299328 00000100:00100000:1.0:1746065194.524028:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299456 00000100:00100000:1.0:1746065194.524030:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299456 00000100:00100000:1.0:1746065194.524045:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10093 00000100:00100000:1.0:1746065194.524051:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:32095:x1830881263299328:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065194.524161:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10094 00000100:00100000:1.0:1746065194.524167:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32094:x1830881263299456:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065194.524176:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.524190:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617c0 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.524228:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.524235:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.524248:0:20754:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.524257:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.524267:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.524270:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065194.524272:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.524277:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdeee00, rc 0) 00000100:00100000:1.0:1746065194.524313:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32094:x1830881263299456:12345-192.168.202.46@tcp:101:cat.0 Request processed in 146us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.524319:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10094 00010000:00010000:1.0:1746065194.524339:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.524345:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617b9 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.524364:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.524372:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.524378:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.524380:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065194.524382:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 252 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.524388:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdef000, rc 0) 00000100:00100000:1.0:1746065194.524403:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:32095:x1830881263299328:12345-192.168.202.46@tcp:101:cat.0 Request processed in 353us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.524408:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10093 00000100:00100000:2.0:1746065194.546048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.546073:0:14641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299584 00000100:00100000:2.0:1746065194.546080:0:14641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299584 00000100:00100000:2.0:1746065194.546109:0:14641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 225 00000100:00100000:2.0:1746065194.546116:0:14641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a593dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edf50a1e-6d84-485b-9392-04c729e87e94+15:1961:x1830881263299584:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1746065194.546158:0:14641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a593dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edf50a1e-6d84-485b-9392-04c729e87e94+15:1961:x1830881263299584:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.546164:0:14641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 225 00010000:00010000:1.0:1746065194.571842:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.571855:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.571857:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065194.571861:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.571875:0:24350:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.571881:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.571888:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.571893:0:24350:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.571898:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.571927:0:24350:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.571938:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b620380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437888:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065194.572200:0:24350:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 253 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.572208:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b620700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260438016:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065194.572228:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4a80 going to sleep for 11 seconds 00000001:00080000:1.0:1746065194.572243:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944377 is committed 00000004:00080000:1.0:1746065194.572248:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2438 committed 00000004:00080000:1.0:1746065194.572952:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2417 committed 00000004:00080000:1.0:1746065194.572991:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2416 committed 00000004:00080000:1.0:1746065194.572994:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2415 committed 00000004:00080000:1.0:1746065194.572995:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2414 committed 00000004:00080000:1.0:1746065194.572996:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2437 committed 00000004:00080000:1.0:1746065194.572998:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2413 committed 00000004:00080000:1.0:1746065194.572999:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2436 committed 00000004:00080000:1.0:1746065194.573001:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2412 committed 00000004:00080000:1.0:1746065194.573002:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2435 committed 00000004:00080000:1.0:1746065194.573004:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2434 committed 00000004:00080000:1.0:1746065194.573005:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2433 committed 00000004:00080000:1.0:1746065194.573007:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2411 committed 00000004:00080000:1.0:1746065194.573008:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2410 committed 00000004:00080000:1.0:1746065194.573010:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2432 committed 00000004:00080000:1.0:1746065194.573012:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2431 committed 00000004:00080000:1.0:1746065194.573013:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2409 committed 00000001:00080000:1.0:1746065194.573020:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944375 is committed 00000001:00080000:1.0:1746065194.573028:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944372 is committed 00000100:00100000:3.0:1746065194.574045:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260438528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.574081:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.574101:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260439040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.574115:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.574131:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065194.574135:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260438400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.574148:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.574159:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260438912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.574170:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.574192:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260438528 00000100:00100000:3.0:1746065194.574198:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260438528 00000100:00100000:3.0:1746065194.574224:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439040 00000100:00100000:3.0:1746065194.574226:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439040 00000100:00100000:3.0:1746065194.574237:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15069 00000100:00100000:3.0:1746065194.574243:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3298:x1830881260438528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065194.574372:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065194.574375:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.574377:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.574379:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065194.574380:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065194.574407:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3298:x1830881260438528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (326us total) trans 21474840983 rc 0/0 00000100:00100000:3.0:1746065194.574413:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15069 00000100:00100000:3.0:1746065194.574424:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260438400 00000100:00100000:2.0:1746065194.574538:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260438272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.574557:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574570:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260438784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.574581:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574591:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260439296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.574603:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574613:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260439808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.574624:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574635:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746065194.574639:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260438144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.574650:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574660:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260438656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.574670:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574679:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260439168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.574691:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574696:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260439680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.574720:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574735:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260439424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.574749:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574755:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260439936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.574765:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574772:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065194.574775:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260439552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.574786:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574792:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260440064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.574801:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.574830:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260438912 00000100:00100000:2.0:1746065194.574833:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260438912 00000100:00100000:2.0:1746065194.574844:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260438272 00000100:00100000:2.0:1746065194.574846:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260438272 00000100:00100000:2.0:1746065194.574850:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260438784 00000100:00100000:2.0:1746065194.574852:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260438784 00000100:00100000:2.0:1746065194.574857:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439296 00000100:00100000:2.0:1746065194.574858:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439296 00000100:00100000:2.0:1746065194.574864:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439808 00000100:00100000:2.0:1746065194.574866:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439808 00000100:00100000:2.0:1746065194.574870:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260438144 00000100:00100000:2.0:1746065194.574872:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260438144 00000100:00100000:2.0:1746065194.574877:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260438656 00000100:00100000:2.0:1746065194.574878:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260438656 00000100:00100000:2.0:1746065194.574884:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439168 00000100:00100000:2.0:1746065194.574886:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439168 00000100:00100000:2.0:1746065194.574891:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439680 00000100:00100000:2.0:1746065194.574892:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439680 00000100:00100000:2.0:1746065194.574897:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439424 00000100:00100000:2.0:1746065194.574899:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439424 00000100:00100000:2.0:1746065194.574904:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439936 00000100:00100000:2.0:1746065194.574905:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439936 00000100:00100000:2.0:1746065194.574910:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260439552 00000100:00100000:2.0:1746065194.574912:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260439552 00000100:00100000:2.0:1746065194.574917:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260440064 00000100:00100000:2.0:1746065194.574918:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260440064 00000100:00100000:2.0:1746065194.574924:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15070 00000100:00100000:2.0:1746065194.574929:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3298:x1830881260439040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.575009:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3298:x1830881260439040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (892us total) trans 21474840984 rc 0/0 00000100:00100000:2.0:1746065194.575014:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15070 00000100:00100000:2.0:1746065194.575024:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15071 00000100:00100000:2.0:1746065194.575028:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3298:x1830881260438912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065194.575092:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065194.575094:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.575095:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.575097:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.575098:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065194.575115:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3298:x1830881260438912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (944us total) trans 21474840985 rc 0/0 00000100:00100000:2.0:1746065194.575120:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15071 00000100:00100000:2.0:1746065194.575131:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15072 00000100:00100000:2.0:1746065194.575135:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3296:x1830881260438272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065194.575196:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065194.575198:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575200:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575201:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575203:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746065194.575223:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3296:x1830881260438272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (666us total) trans 21474840986 rc 0/0 00000100:00100000:2.0:1746065194.575229:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15072 00000100:00100000:2.0:1746065194.575237:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15073 00000100:00100000:2.0:1746065194.575241:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3296:x1830881260438784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.575313:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3296:x1830881260438784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (730us total) trans 21474840987 rc 0/0 00000100:00100000:2.0:1746065194.575318:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15073 00000100:00100000:2.0:1746065194.575327:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15074 00000100:00100000:2.0:1746065194.575331:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830881260439296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065194.575415:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065194.575417:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575419:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575420:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575422:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065194.575440:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3296:x1830881260439296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (835us total) trans 17179873694 rc 0/0 00000100:00100000:2.0:1746065194.575444:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15074 00000100:00100000:2.0:1746065194.575453:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15075 00000100:00100000:2.0:1746065194.575457:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830881260439808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.575529:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3296:x1830881260439808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (903us total) trans 17179873695 rc 0/0 00000100:00100000:2.0:1746065194.575534:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15075 00000100:00100000:2.0:1746065194.575542:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15076 00000100:00100000:2.0:1746065194.575546:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3296:x1830881260438144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065194.575608:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065194.575611:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575613:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575614:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575616:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:2.0:1746065194.575634:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3296:x1830881260438144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (982us total) trans 21474840988 rc 0/0 00000100:00100000:2.0:1746065194.575638:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15076 00000100:00100000:2.0:1746065194.575646:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15077 00000100:00100000:2.0:1746065194.575650:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3296:x1830881260438656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.575730:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3296:x1830881260438656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1058us total) trans 21474840989 rc 0/0 00000100:00100000:2.0:1746065194.575734:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15077 00000100:00100000:2.0:1746065194.575744:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15078 00000100:00100000:2.0:1746065194.575748:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830881260439168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065194.575811:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065194.575831:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575833:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575834:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.575836:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065194.575853:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3296:x1830881260439168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (1161us total) trans 17179873696 rc 0/0 00000100:00100000:2.0:1746065194.575858:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15078 00000100:00100000:2.0:1746065194.575868:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15079 00000100:00100000:2.0:1746065194.575872:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830881260439680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065194.575929:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065194.575931:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.575933:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.575934:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065194.575936:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065194.575952:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3296:x1830881260439680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1231us total) trans 17179873697 rc 0/0 00000100:00100000:2.0:1746065194.575956:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15079 00000100:00100000:2.0:1746065194.575965:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15080 00000100:00100000:2.0:1746065194.575969:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881260439424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065194.576025:0:4545:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065194.576027:0:4545:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.576028:0:4545:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.576030:0:4545:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065194.576032:0:4545:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746065194.576053:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260439424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1303us total) trans 17179873698 rc 0/0 00000100:00100000:2.0:1746065194.576058:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15080 00000100:00100000:2.0:1746065194.576065:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15081 00000100:00100000:2.0:1746065194.576069:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881260439936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.576370:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260438400 00000100:00100000:3.0:1746065194.576388:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15082 00000100:00100000:3.0:1746065194.576393:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260439552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065194.576459:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065194.576461:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065194.576463:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065194.576464:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065194.576466:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065194.576487:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3297:x1830881260439552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1700us total) trans 17179873700 rc 0/0 00000100:00100000:3.0:1746065194.576492:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15082 00000100:00100000:3.0:1746065194.576501:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15083 00000100:00100000:3.0:1746065194.576505:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260440064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.577393:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3297:x1830881260440064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 885us (2587us total) trans 17179873701 rc 0/0 00000100:00100000:3.0:1746065194.577398:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15083 00000100:00100000:3.0:1746065194.577409:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15084 00000100:00100000:3.0:1746065194.577414:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3298:x1830881260438400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065194.577498:0:2462:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:3.0:1746065194.577500:0:2462:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:3.0:1746065194.577502:0:2462:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:3.0:1746065194.577504:0:2462:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:3.0:1746065194.577505:0:2462:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5767 -> 5767 00000100:00100000:3.0:1746065194.577525:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3298:x1830881260438400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (3376us total) trans 21474840990 rc 0/0 00000100:00100000:3.0:1746065194.577533:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15084 00000004:00080000:3.0:1746065194.577579:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5883100/2, rc 0, transno 21474840990 00000100:00100000:3.0:1746065194.577588:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260438400:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065194.577596:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3ed80/2, rc 0, transno 21474840985 00000100:00100000:3.0:1746065194.577598:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260438912:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065194.577605:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5883800/2, rc 0, transno 21474840983 00000100:00100000:3.0:1746065194.577608:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260438528:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065194.577615:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bd3f100/2, rc 0, transno 21474840984 00000100:00100000:3.0:1746065194.577617:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260439040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.578612:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.578699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.578731:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299712 00000100:00100000:0.0:1746065194.578735:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299712 00000100:00100000:0.0:1746065194.578761:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299840 00000100:00100000:0.0:1746065194.578762:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299840 00000100:00100000:0.0:1746065194.578774:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4351 00000100:00100000:0.0:1746065194.578778:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32094:x1830881263299712:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065194.578874:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32094:x1830881263299712:12345-192.168.202.46@tcp:49:cat.0 Request processed in 94us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.578879:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4351 00000100:00100000:0.0:1746065194.578891:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4352 00000100:00100000:0.0:1746065194.578895:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:32095:x1830881263299840:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:0.0:1746065194.578920:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:32095:x1830881263299840:12345-192.168.202.46@tcp:49:cat.0 Request processed in 24us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.578924:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4352 00000100:00100000:0.0:1746065194.579421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.579438:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263299968 00000100:00100000:0.0:1746065194.579441:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263299968 00000100:00100000:0.0:1746065194.579459:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10095 00000100:00100000:0.0:1746065194.579464:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+7:32091:x1830881263299968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065194.579474:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065194.579487:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe52c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617c7 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.579518:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe52c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c7 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.579529:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe52c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c7 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.579541:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065194.579544:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065194.579547:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25ca00, rc 0) 00000100:00100000:0.0:1746065194.579565:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:32091:x1830881263299968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 102us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.579570:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10095 00000100:00100000:0.0:1746065194.579863:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260440192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.579890:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.579915:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260440192 00000100:00100000:0.0:1746065194.579918:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260440192 00000100:00100000:0.0:1746065194.579931:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15085 00000100:00100000:0.0:1746065194.579934:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3295:x1830881260440192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.581335:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b620380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260437888:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065194.581346:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b620700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260438016:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065194.581372:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25c600/0x14b4f8542d4fe502 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 250 pid: 24350 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065194.581392:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.581409:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25cc00, rc 0) 00000100:00100000:1.0:1746065194.581439:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32090:x1830881263298560:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 67318us (67867us total) trans 8589944377 rc 0/0 00000100:00100000:1.0:1746065194.581447:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10092 00000100:00100000:0.0:1746065194.581551:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3295:x1830881260440192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1615us (1659us total) trans 21474840991 rc 0/0 00000100:00100000:0.0:1746065194.581557:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15085 00000004:00080000:0.0:1746065194.581887:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba0e00/2, rc 0, transno 17179873700 00000100:00100000:0.0:1746065194.581892:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260439552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065194.581902:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a97800/2, rc 0, transno 17179873701 00000100:00100000:0.0:1746065194.581904:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260440064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065194.581911:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1500/2, rc 0, transno 17179873698 00000100:00100000:0.0:1746065194.581913:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260439424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065194.581933:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880700/2, rc 0, transno 21474840988 00000100:00100000:0.0:1746065194.581935:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260438144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065194.581943:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5882d80/2, rc 0, transno 21474840989 00000100:00100000:0.0:1746065194.581945:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260438656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065194.581951:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba1f80/2, rc 0, transno 17179873696 00000100:00100000:0.0:1746065194.581953:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260439168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065194.581960:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f8380/2, rc 0, transno 17179873697 00000100:00100000:0.0:1746065194.581962:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260439680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065194.581969:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880a80/2, rc 0, transno 21474840986 00000100:00100000:0.0:1746065194.581971:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260438272:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065194.581977:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880000/2, rc 0, transno 21474840987 00000100:00100000:0.0:1746065194.581980:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260438784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065194.581986:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba0700/2, rc 0, transno 17179873694 00000100:00100000:0.0:1746065194.581988:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260439296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065194.581993:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9500/2, rc 0, transno 17179873695 00000100:00100000:0.0:1746065194.581995:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260439808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065194.582052:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b9fed80/2, rc 0, transno 21474840991 00000100:00100000:1.0:1746065194.582056:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260440192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.582319:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260439936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6248us (7551us total) trans 17179873699 rc 0/0 00000100:00100000:2.0:1746065194.582325:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15081 00000004:00080000:0.0:1746065194.582388:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a95f80/2, rc 0, transno 17179873699 00000100:00100000:0.0:1746065194.582391:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260439936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.589784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.589954:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300096 00000100:00100000:3.0:1746065194.589962:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300096 00000100:00100000:3.0:1746065194.589999:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15086 00000100:00100000:3.0:1746065194.590006:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+31:32091:x1830881263300096:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065194.590021:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.590036:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617ce expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.590060:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.590066:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.590068:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.590071:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1441792->1892351] (req 1441792->1892351) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 32 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.590099:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.590109:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 11 pid: 8428 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746065194.590119:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260440320:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.590173:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.591770:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.591812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.591897:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300480 00000100:00100000:3.0:1746065194.591903:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300480 00000100:00100000:2.0:1746065194.591906:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300352 00000100:00100000:2.0:1746065194.591910:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300352 00000100:00100000:3.0:1746065194.591932:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15087 00002000:00100000:2.0:1746065194.591935:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012d7fc380 x1830881263300352/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065194.591938:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:32090:x1830881263300480:12345-192.168.202.46@tcp:101:multiop.0 00002000:00100000:2.0:1746065194.591948:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc380 with x1830881263300352 ext(0->1048575) 00010000:00010000:3.0:1746065194.591949:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746065194.591952:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fc380 00010000:00010000:3.0:1746065194.591962:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617d5 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.591964:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8515 00000100:00100000:2.0:1746065194.591967:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+33:1960:x1830881263300352:12345-192.168.202.46@tcp:3:multiop.0 00010000:00010000:3.0:1746065194.591981:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.591987:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.591988:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.591991:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2981888->3141631] (req 2981888->3141631) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 40 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.592012:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.592025:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 11 pid: 8427 timeout: 893 lvb_type: 1 00000100:00100000:3.0:1746065194.592034:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260440448:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.592075:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.592307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.592324:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300608 00000100:00100000:0.0:1746065194.592326:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300608 00000100:00100000:0.0:1746065194.592348:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 796 00000100:00100000:0.0:1746065194.592352:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263300608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.592359:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065194.592366:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260440320:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.592375:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25ca00/0x14b4f8542d4fe52c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c7 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.592386:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1441792->1892351] (req 1441792->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 33 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.592388:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065194.592391:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065194.592395:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff54600, rc 0) 00000100:00100000:0.0:1746065194.592410:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263300608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 57us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.592414:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+33:32091:x1830881263300096:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2409us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.592415:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 796 00000100:00100000:3.0:1746065194.592418:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15086 00000100:00100000:0.0:1746065194.594323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.594784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.594811:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300864 00000100:00100000:0.0:1746065194.594835:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300864 00010000:00010000:0.0:1746065194.594858:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 12 pid: 8427 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.594876:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263300736 00000100:00100000:0.0:1746065194.594878:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263300736 00010000:00010000:0.0:1746065194.594887:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 12 pid: 8428 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065194.594905:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7764 00000100:00100000:0.0:1746065194.594910:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1958:x1830881263300864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.594920:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065194.595226:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7765 00000100:00100000:1.0:1746065194.595234:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1958:x1830881263300736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.595242:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.595257:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 12 pid: 8428 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746065194.595267:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 12 pid: 8428 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746065194.595284:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a003b600/0x14b4f8542d4fe414 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61757 expref: 12 pid: 8428 timeout: 893 lvb_type: 1 00010000:00010000:1.0:1746065194.595300:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.595302:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.595307:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 32 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.595314:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 32 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.595339:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 32 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.595353:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b620700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260440576:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065194.595404:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.595608:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260440448:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.595627:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2981888->3141631] (req 2981888->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 40 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.595638:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa7800, rc 0) 00000100:00100000:3.0:1746065194.595659:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:32090:x1830881263300480:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 3720us (3845us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.595665:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15087 00010000:00010000:0.0:1746065194.596373:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 12 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.596383:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 12 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.596395:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4c9b800/0x14b4f8542d4fe40d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61765 expref: 12 pid: 8427 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065194.596403:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.596405:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.596408:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 39 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.596414:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 39 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.596432:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 39 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.596439:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ec88380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260440704:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065194.597268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.597482:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b620700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260440576:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065194.597492:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.597515:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881263300736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2282us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.597523:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7765 00000100:00100000:0.0:1746065194.597753:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.597825:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301120 00000100:00100000:3.0:1746065194.597831:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301120 00002000:00100000:3.0:1746065194.597859:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012b620380 x1830881263301120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.597867:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b620380 with x1830881263301120 ext(1048576->2097151) 00002000:00010000:3.0:1746065194.597871:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b620380 00000100:00100000:3.0:1746065194.597884:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8516 00000100:00100000:3.0:1746065194.597889:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881263301120:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065194.599377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.601371:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301376 00000100:00100000:2.0:1746065194.601382:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301376 00002000:00100000:2.0:1746065194.601530:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1441792->1445887) req@ffff88012b620700 x1830881263301376/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.601538:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b620700 with x1830881263301376 ext(1441792->1445887) 00002000:00010000:2.0:1746065194.601543:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b620700 00000100:00100000:2.0:1746065194.602453:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8517 00000100:00100000:2.0:1746065194.602463:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:1958:x1830881263301376:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065194.602613:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:1958:x1830881263301376:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 152us (3240us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065194.602619:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8517 00002000:00100000:2.0:1746065194.602625:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1441792->1445887) req@ffff88012b620700 x1830881263301376/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.602631:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b620700 with x1830881263301376 ext(1441792->1445887) 00002000:00010000:2.0:1746065194.602634:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b620700 00000100:00100000:0.0:1746065194.606945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.607370:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ec88380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260440704:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065194.607386:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.607433:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881263300864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 12522us (13114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.607442:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7764 00000100:00100000:1.0:1746065194.607516:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301632 00000100:00100000:1.0:1746065194.607522:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301632 00002000:00100000:1.0:1746065194.607549:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2981888->2985983) req@ffff88012ec88700 x1830881263301632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.607557:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec88700 with x1830881263301632 ext(2981888->2985983) 00002000:00010000:1.0:1746065194.607561:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec88700 00000100:00100000:1.0:1746065194.607574:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8518 00000100:00100000:1.0:1746065194.607579:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881263301632:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065194.607712:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:1961:x1830881263301632:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 132us (774us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065194.607717:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8518 00002000:00100000:1.0:1746065194.607722:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (2981888->2985983) req@ffff88012ec88700 x1830881263301632/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.607729:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec88700 with x1830881263301632 ext(2981888->2985983) 00002000:00010000:1.0:1746065194.607732:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec88700 00000100:00100000:3.0:1746065194.612940:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881263301120:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 15042us (15667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065194.612950:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8516 00002000:00100000:3.0:1746065194.612960:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012b620380 x1830881263301120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.612968:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b620380 with x1830881263301120 ext(1048576->2097151) 00002000:00010000:3.0:1746065194.612973:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b620380 00000100:00100000:2.0:1746065194.618013:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+32:1960:x1830881263300352:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 26035us (26237us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.618024:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8515 00002000:00100000:2.0:1746065194.618033:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012d7fc380 x1830881263300352/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.618041:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc380 with x1830881263300352 ext(0->1048575) 00002000:00010000:2.0:1746065194.618045:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fc380 00000100:00100000:0.0:1746065194.618287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.618349:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263301888 00000100:00100000:3.0:1746065194.618357:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263301888 00002000:00100000:3.0:1746065194.618387:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3137536->3141631) req@ffff88012ec88a80 x1830881263301888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.618394:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec88a80 with x1830881263301888 ext(3137536->3141631) 00002000:00010000:3.0:1746065194.618397:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec88a80 00000100:00100000:3.0:1746065194.618410:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8519 00000100:00100000:3.0:1746065194.618416:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881263301888:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065194.622495:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1961:x1830881263301888:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 4063us (4193us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065194.622508:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8519 00002000:00100000:3.0:1746065194.622524:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3137536->3141631) req@ffff88012ec88a80 x1830881263301888/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.622534:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec88a80 with x1830881263301888 ext(3137536->3141631) 00002000:00010000:3.0:1746065194.622539:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec88a80 00000100:00100000:2.0:1746065194.625165:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.625273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.625438:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302016 00000100:00100000:3.0:1746065194.625445:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302016 00000100:00100000:3.0:1746065194.625481:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15088 00000100:00100000:3.0:1746065194.625486:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:32094:x1830881263302016:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.625500:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.625513:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617dc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.625534:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.625536:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.625542:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 41 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.625554:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 41 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.625563:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa7000, rc 0) 00000100:00100000:0.0:1746065194.625929:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302272 00000100:00100000:0.0:1746065194.625934:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302272 00002000:00100000:0.0:1746065194.625960:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1888256->1892351) req@ffff880094d95500 x1830881263302272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.625968:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95500 with x1830881263302272 ext(1888256->1892351) 00002000:00010000:0.0:1746065194.625972:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95500 00000100:00100000:0.0:1746065194.625989:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8520 00000100:00100000:0.0:1746065194.625994:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263302272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065194.627024:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:32094:x1830881263302016:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1531us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.627031:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15088 00000100:00100000:0.0:1746065194.627427:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+32:1959:x1830881263302272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1430us (2151us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065194.627435:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8520 00002000:00100000:0.0:1746065194.627955:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1888256->1892351) req@ffff880094d95500 x1830881263302272/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.627964:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95500 with x1830881263302272 ext(1888256->1892351) 00002000:00010000:0.0:1746065194.627968:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d95500 00000100:00100000:2.0:1746065194.628209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.628239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.628255:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302656 00000100:00100000:2.0:1746065194.628260:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302656 00000100:00100000:2.0:1746065194.628287:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4353 00000100:00100000:2.0:1746065194.628293:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32090:x1830881263302656:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065194.628491:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32090:x1830881263302656:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 197us (251us total) trans 8589944378 rc 0/0 00000100:00100000:2.0:1746065194.628497:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4353 00000100:00100000:0.0:1746065194.628648:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302400 00000100:00100000:0.0:1746065194.628651:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302400 00000100:00100000:0.0:1746065194.628681:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15089 00000100:00100000:0.0:1746065194.628686:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+21:32095:x1830881263302400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065194.628694:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065194.628717:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617e3 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.628734:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.628736:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.628742:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.628755:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.628763:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25d000, rc 0) 00000100:00100000:0.0:1746065194.628783:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+22:32095:x1830881263302400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 97us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.628788:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15089 00000100:00100000:0.0:1746065194.633775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.633904:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263302912 00000100:00100000:2.0:1746065194.633912:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263302912 00002000:00100000:2.0:1746065194.633948:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012ec88e00 x1830881263302912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.633956:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec88e00 with x1830881263302912 ext(1048576->2097151) 00002000:00010000:2.0:1746065194.633961:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec88e00 00000100:00100000:2.0:1746065194.633975:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8521 00000100:00100000:2.0:1746065194.633982:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263302912:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065194.634157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.634223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.634494:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303168 00000100:00100000:0.0:1746065194.634498:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303168 00000100:00100000:0.0:1746065194.634536:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4354 00000100:00100000:0.0:1746065194.634542:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:32091:x1830881263303168:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065194.634725:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:32091:x1830881263303168:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 181us (567us total) trans 8589944379 rc 0/0 00000100:00100000:0.0:1746065194.634732:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4354 00000100:00100000:0.0:1746065194.634771:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303424 00000100:00100000:0.0:1746065194.634774:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303424 00002000:00100000:0.0:1746065194.634787:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012b620a80 x1830881263303424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.634794:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b620a80 with x1830881263303424 ext(1048576->2097151) 00002000:00010000:0.0:1746065194.634798:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b620a80 00000100:00100000:0.0:1746065194.634840:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8522 00000100:00100000:0.0:1746065194.634846:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263303424:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065194.647696:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263302912:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 13705us (13919us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.647717:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8521 00002000:00100000:2.0:1746065194.647730:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012ec88e00 x1830881263302912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.647743:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec88e00 with x1830881263302912 ext(1048576->2097151) 00002000:00010000:2.0:1746065194.647749:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec88e00 00000100:00100000:2.0:1746065194.651955:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+22:1961:x1830881263303424:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 17098us (17720us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.651966:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8522 00002000:00100000:2.0:1746065194.651978:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012b620a80 x1830881263303424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.651987:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b620a80 with x1830881263303424 ext(1048576->2097151) 00002000:00010000:2.0:1746065194.651992:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b620a80 00000100:00100000:0.0:1746065194.655644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.655685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.655785:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303552 00000100:00100000:3.0:1746065194.655792:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303552 00000100:00100000:3.0:1746065194.655940:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303680 00000100:00100000:3.0:1746065194.655943:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303680 00000100:00100000:3.0:1746065194.655959:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15090 00000100:00100000:3.0:1746065194.655964:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:32095:x1830881263303552:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.655979:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.655992:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617ea expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.656013:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.656015:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.656020:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.656031:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.656039:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b5c00, rc 0) 00000100:00100000:1.0:1746065194.656061:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15091 00000100:00100000:1.0:1746065194.656068:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:32094:x1830881263303680:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065194.656075:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.656084:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617f1 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.656100:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 31 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.656106:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065194.656108:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065194.656110:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.656132:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 31 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.656142:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 31 pid: 4545 timeout: 893 lvb_type: 0 00000100:00100000:1.0:1746065194.656152:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b620e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260440832:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.656158:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+23:32095:x1830881263303552:12345-192.168.202.46@tcp:101:cat.0 Request processed in 192us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.656163:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15090 00000100:00100000:1.0:1746065194.656259:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.658023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.658082:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263303808 00000100:00100000:2.0:1746065194.658089:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263303808 00002000:00100000:2.0:1746065194.658121:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1441792->1892351) req@ffff88012ec89880 x1830881263303808/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.658129:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec89880 with x1830881263303808 ext(1441792->1892351) 00010000:00010000:2.0:1746065194.658136:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 32 pid: 4545 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.658152:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 32 pid: 4545 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746065194.658158:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ec89880 00000100:00100000:2.0:1746065194.658188:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2583 00000100:00100000:2.0:1746065194.658194:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+32:1958:x1830881263303808:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:1.0:1746065194.658632:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b620e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260440832:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065194.658649:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.658664:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec47200, rc 0) 00000100:00100000:1.0:1746065194.658686:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:32094:x1830881263303680:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2619us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.658692:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15091 00000100:00100000:0.0:1746065194.665803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.665856:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304064 00000100:00100000:3.0:1746065194.665864:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304064 00002000:00100000:3.0:1746065194.665897:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012ec89c00 x1830881263304064/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.665906:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec89c00 with x1830881263304064 ext(1048576->2097151) 00002000:00010000:3.0:1746065194.665912:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec89c00 00000100:00100000:3.0:1746065194.665943:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8523 00000100:00100000:3.0:1746065194.665950:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263304064:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065194.666674:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+34:1958:x1830881263303808:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 8478us (8654us total) trans 21474840992 rc 0/0 00000100:00100000:2.0:1746065194.666681:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2583 00002000:00100000:2.0:1746065194.666687:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1441792->1892351) req@ffff88012ec89880 x1830881263303808/t21474840992(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.666694:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec89880 with x1830881263303808 ext(1441792->1892351) 00010000:00010000:2.0:1746065194.666710:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 34 pid: 4545 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.666722:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 34 pid: 4545 timeout: 893 lvb_type: 0 00002000:00010000:2.0:1746065194.666728:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ec89880 00000100:00100000:0.0:1746065194.674376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.675458:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304192 00000100:00100000:2.0:1746065194.675466:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304192 00010000:00010000:2.0:1746065194.675494:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 34 pid: 4545 timeout: 893 lvb_type: 0 00000100:00100000:2.0:1746065194.675526:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7766 00000100:00100000:2.0:1746065194.675533:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1958:x1830881263304192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.675544:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.675560:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 34 pid: 4545 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.675569:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 34 pid: 4545 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.675588:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54600/0x14b4f8542d4fe533 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ce expref: 34 pid: 4545 timeout: 893 lvb_type: 0 00010000:00010000:2.0:1746065194.675611:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.675612:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.675619:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.675627:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.675656:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.675667:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260440960:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065194.676025:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263304064:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10073us (10228us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.676030:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.676035:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8523 00002000:00100000:3.0:1746065194.676042:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012ec89c00 x1830881263304064/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.676050:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec89c00 with x1830881263304064 ext(1048576->2097151) 00002000:00010000:3.0:1746065194.676053:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec89c00 00000100:00100000:0.0:1746065194.681376:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.681425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.681451:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260440960:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065194.681508:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304320 00000100:00100000:1.0:1746065194.681514:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304320 00000100:00100000:1.0:1746065194.681550:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15092 00000100:00100000:1.0:1746065194.681556:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+34:32095:x1830881263304320:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065194.681573:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.681589:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617f8 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.681610:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.681611:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.681617:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.681627:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.681635:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec46400, rc 0) 00000100:00100000:1.0:1746065194.681678:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+35:32095:x1830881263304320:12345-192.168.202.46@tcp:101:cat.0 Request processed in 121us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.681683:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15092 00010000:00010000:2.0:1746065194.681740:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.681758:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+34:1958:x1830881263304192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6226us (7390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.681764:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7766 00000100:00100000:3.0:1746065194.681844:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304576 00000100:00100000:3.0:1746065194.681849:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304576 00002000:00100000:3.0:1746065194.681873:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012ec8a300 x1830881263304576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.681880:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8a300 with x1830881263304576 ext(1048576->2097151) 00002000:00010000:3.0:1746065194.681883:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8a300 00000100:00100000:3.0:1746065194.682038:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8524 00000100:00100000:3.0:1746065194.682045:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263304576:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065194.688898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.688958:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304832 00000100:00100000:1.0:1746065194.688967:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304832 00002000:00100000:1.0:1746065194.689002:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012ec8a680 x1830881263304832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.689012:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8a680 with x1830881263304832 ext(1048576->2097151) 00002000:00010000:1.0:1746065194.689016:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8a680 00000100:00100000:1.0:1746065194.689047:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8525 00000100:00100000:1.0:1746065194.689054:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263304832:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065194.690096:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263304576:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8049us (8667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065194.690104:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8524 00002000:00100000:3.0:1746065194.690110:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012ec8a300 x1830881263304576/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.690118:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8a300 with x1830881263304576 ext(1048576->2097151) 00002000:00010000:3.0:1746065194.690122:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8a300 00000100:00100000:0.0:1746065194.697395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.698711:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263304960 00000100:00100000:1.0:1746065194.698721:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263304960 00000100:00100000:1.0:1746065194.698759:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15093 00000100:00100000:1.0:1746065194.698766:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:32094:x1830881263304960:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065194.698781:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.698797:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e617ff expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.698836:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.698838:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.698845:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 37 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.698859:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 37 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.698868:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf6000, rc 0) 00000100:00100000:1.0:1746065194.699592:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:32094:x1830881263304960:12345-192.168.202.46@tcp:101:cat.0 Request processed in 823us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.699599:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15093 00000100:00100000:2.0:1746065194.700493:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+34:1961:x1830881263304832:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11437us (11600us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.700501:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8525 00002000:00100000:2.0:1746065194.700510:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012ec8a680 x1830881263304832/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.700518:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8a680 with x1830881263304832 ext(1048576->2097151) 00002000:00010000:2.0:1746065194.700522:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8a680 00000100:00100000:0.0:1746065194.711110:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.711172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.711538:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305216 00000100:00100000:1.0:1746065194.711548:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305216 00000100:00100000:1.0:1746065194.711599:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305344 00000100:00100000:1.0:1746065194.711601:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305344 00000100:00100000:1.0:1746065194.711619:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15094 00000100:00100000:1.0:1746065194.711626:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+34:1959:x1830881263305216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065194.711644:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.711660:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61806 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.711679:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.711681:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.711688:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 35 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065194.711697:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15095 00010000:00010000:1.0:1746065194.711711:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 35 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065194.711713:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263305344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.711720:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.711721:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec46c00, rc 0) 00010000:00010000:3.0:1746065194.711728:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fe572 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6180d expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.711760:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260441088:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065194.711767:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+35:1959:x1830881263305216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 142us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.711772:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15094 00000100:00100000:3.0:1746065194.712181:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.712515:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.712570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.712627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.712651:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305728 00000100:00100000:0.0:1746065194.712655:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305728 00002000:00100000:0.0:1746065194.712683:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012ec8b100 x1830881263305728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.712690:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8b100 with x1830881263305728 ext(3145728->4194303) 00002000:00010000:0.0:1746065194.712694:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8b100 00000100:00100000:0.0:1746065194.712716:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305472 00000100:00100000:0.0:1746065194.712719:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305472 00002000:00100000:0.0:1746065194.712729:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012ec8b480 x1830881263305472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.712736:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8b480 with x1830881263305472 ext(2097152->3145727) 00002000:00010000:0.0:1746065194.712738:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8b480 00000100:00100000:0.0:1746065194.712746:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263305984 00000100:00100000:0.0:1746065194.712748:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263305984 00002000:00100000:0.0:1746065194.712757:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3305471) req@ffff88012ec8b800 x1830881263305984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 504/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.712763:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8b800 with x1830881263305984 ext(2097152->3305471) 00002000:00010000:0.0:1746065194.712766:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec8b800 00000100:00100000:0.0:1746065194.712774:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8526 00000100:00100000:0.0:1746065194.712779:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263305728:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065194.714357:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8527 00000100:00100000:1.0:1746065194.714368:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8528 00000100:00100000:2.0:1746065194.714369:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1961:x1830881263305472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065194.714376:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263305984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065194.719022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.720382:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306240 00000100:00100000:3.0:1746065194.720393:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306240 00002000:00100000:3.0:1746065194.720430:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3305472->4194303) req@ffff880094d96680 x1830881263306240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.720440:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96680 with x1830881263306240 ext(3305472->4194303) 00002000:00010000:3.0:1746065194.720445:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d96680 00000100:00100000:3.0:1746065194.720464:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8529 00000100:00100000:3.0:1746065194.720469:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881263306240:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065194.725587:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260441088:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065194.725616:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fe572 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6180d expref: 24 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.725627:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfdc00/0x14b4f8542d4fe572 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6180d expref: 24 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.726214:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfdc00, rc 0) 00000100:00100000:3.0:1746065194.726266:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263305344:12345-192.168.202.46@tcp:101:cat.0 Request processed in 14553us (15093us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065194.726276:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15095 00000100:00100000:1.0:1746065194.727635:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263305728:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13797us (14062us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065194.727645:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8526 00002000:00100000:1.0:1746065194.727656:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012ec8b100 x1830881263305728/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.727664:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8b100 with x1830881263305728 ext(3145728->4194303) 00002000:00010000:1.0:1746065194.727668:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8b100 00000100:00100000:2.0:1746065194.731300:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263305472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16925us (18720us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.731310:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8527 00002000:00100000:2.0:1746065194.731320:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012ec8b480 x1830881263305472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.731327:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8b480 with x1830881263305472 ext(2097152->3145727) 00002000:00010000:2.0:1746065194.731332:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8b480 00000100:00100000:0.0:1746065194.733109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.733215:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306496 00000100:00100000:2.0:1746065194.733223:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306496 00002000:00100000:2.0:1746065194.733259:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012ec8bb80 x1830881263306496/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.733267:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8bb80 with x1830881263306496 ext(2097152->3145727) 00002000:00010000:2.0:1746065194.733272:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8bb80 00000100:00100000:2.0:1746065194.733303:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8530 00000100:00100000:2.0:1746065194.733310:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+35:1961:x1830881263306496:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065194.740251:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881263305984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25868us (27615us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065194.740260:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8528 00002000:00100000:1.0:1746065194.740271:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3305471) req@ffff88012ec8b800 x1830881263305984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 504/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.740279:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8b800 with x1830881263305984 ext(2097152->3305471) 00002000:00010000:1.0:1746065194.740284:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec8b800 00000100:00100000:3.0:1746065194.743195:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1961:x1830881263306240:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22717us (24174us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746065194.743205:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8529 00002000:00100000:3.0:1746065194.743214:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (3305472->4194303) req@ffff880094d96680 x1830881263306240/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.743223:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96680 with x1830881263306240 ext(3305472->4194303) 00002000:00010000:3.0:1746065194.743228:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d96680 00000100:00100000:2.0:1746065194.750019:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+35:1961:x1830881263306496:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16701us (16906us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.750029:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8530 00002000:00100000:2.0:1746065194.750040:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012ec8bb80 x1830881263306496/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.750048:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8bb80 with x1830881263306496 ext(2097152->3145727) 00002000:00010000:2.0:1746065194.750053:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec8bb80 00000100:00100000:0.0:1746065194.760342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.760397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.760546:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306624 00000100:00100000:3.0:1746065194.760554:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306624 00000100:00100000:2.0:1746065194.760975:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263306880 00000100:00100000:2.0:1746065194.760981:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263306880 00002000:00100000:2.0:1746065194.761010:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88012ec89500 x1830881263306880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.761018:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec89500 with x1830881263306880 ext(4194304->5013503) 00002000:00010000:2.0:1746065194.761023:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec89500 00000100:00100000:2.0:1746065194.761040:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8531 00000100:00100000:2.0:1746065194.761047:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263306880:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065194.761232:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15096 00000100:00100000:3.0:1746065194.761239:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+23:32095:x1830881263306624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.761248:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.761262:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61814 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.761282:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 40 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.761289:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065194.761290:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065194.761293:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.761324:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 40 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.761521:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 40 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.761533:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260441216:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.762686:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.765016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.765259:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307264 00000100:00100000:1.0:1746065194.765267:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307264 00000100:00100000:3.0:1746065194.765295:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260441216:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065194.765299:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10096 00000100:00100000:1.0:1746065194.765305:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32100:x1830881263307264:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065194.765319:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 24 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.765322:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.765334:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfda00, rc 0) 00010000:00010000:1.0:1746065194.765334:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5afa00/0x14b4f8542d4fe580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6181b expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.765367:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:26bbd020-9fba-464a-bebc-8395a287959e+24:32095:x1830881263306624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4129us (5034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.765373:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15096 00010000:00010000:1.0:1746065194.765417:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765428:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765438:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765452:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765457:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765461:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765549:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765556:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765561:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:1.0:1746065194.765567:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065194.765634:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765640:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765645:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765650:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5af800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065194.765653:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765658:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765667:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065194.765670:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065194.765673:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765677:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af800/0x14b4f8542d4fe587 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765706:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765711:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765715:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765718:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5af600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065194.765720:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765723:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765728:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f715000) 00010000:00010000:1.0:1746065194.765730:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065194.765731:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765735:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af600/0x14b4f8542d4fe58e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.765762:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5afa00/0x14b4f8542d4fe580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.765770:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 252 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.765775:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.765777:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065194.765778:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5af400, rc 0) 00000100:00100000:1.0:1746065194.765795:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32100:x1830881263307264:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 491us (786us total) trans 8589944380 rc 0/0 00000100:00100000:1.0:1746065194.765800:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10096 00000100:00100000:0.0:1746065194.768321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.768872:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307136 00000100:00100000:3.0:1746065194.768878:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263306880:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7830us (8480us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065194.768879:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307136 00000100:00100000:3.0:1746065194.768887:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8531 00002000:00100000:3.0:1746065194.768896:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88012ec89500 x1830881263306880/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.768904:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec89500 with x1830881263306880 ext(4194304->5013503) 00002000:00100000:2.0:1746065194.768906:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2981888->3141631) req@ffff88012ec8aa00 x1830881263307136/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746065194.768908:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ec89500 00002000:00100000:2.0:1746065194.768913:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8aa00 with x1830881263307136 ext(2981888->3141631) 00010000:00010000:2.0:1746065194.768921:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 41 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.768932:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 41 pid: 25185 timeout: 894 lvb_type: 0 00002000:00010000:2.0:1746065194.768938:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ec8aa00 00000100:00100000:2.0:1746065194.769682:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2584 00000100:00100000:2.0:1746065194.769690:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1959:x1830881263307136:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065194.771590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.772792:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307520 00000100:00100000:2.0:1746065194.772801:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307520 00000100:00100000:2.0:1746065194.772899:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10097 00000100:00100000:2.0:1746065194.772906:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:32102:x1830881263307520:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065194.772926:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.772944:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fe5a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61822 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.773043:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773053:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773062:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773077:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773082:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773086:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773170:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773178:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773183:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065194.773191:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065194.773257:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773263:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773268:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773272:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129cf7200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.773275:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773280:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773289:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065194.773291:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065194.773294:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.773298:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf7200/0x14b4f8542d4fe5aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.775334:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.775343:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.775348:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.775352:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c756200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.775354:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.775359:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.775370:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b5371f00) 00010000:00010000:2.0:1746065194.775372:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065194.775374:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.775384:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756200/0x14b4f8542d4fe5b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.775431:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4fe5a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.775442:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.775448:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.775450:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065194.775452:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756000, rc 0) 00000100:00100000:2.0:1746065194.775497:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:32102:x1830881263307520:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2591us (3912us total) trans 8589944381 rc 0/0 00000100:00100000:2.0:1746065194.775504:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10097 00000100:00100000:3.0:1746065194.777160:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881263307136:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7466us (8840us total) trans 17179873702 rc 0/0 00000100:00100000:3.0:1746065194.777170:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2584 00002000:00100000:3.0:1746065194.777179:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2981888->3141631) req@ffff88012ec8aa00 x1830881263307136/t17179873702(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.777187:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8aa00 with x1830881263307136 ext(2981888->3141631) 00010000:00010000:3.0:1746065194.777195:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 43 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.777206:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 43 pid: 25185 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746065194.777212:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ec8aa00 00000100:00100000:0.0:1746065194.783119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.783464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.784422:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307648 00000100:00100000:1.0:1746065194.784422:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307776 00000100:00100000:3.0:1746065194.784429:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307648 00000100:00100000:1.0:1746065194.784429:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307776 00000100:00100000:3.0:1746065194.784471:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15097 00000100:00100000:3.0:1746065194.784478:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1961:x1830881263307648:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.784491:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.784504:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe5c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61829 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.784548:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260441344:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065194.784618:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.785059:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15098 00000100:00100000:3.0:1746065194.785066:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:32100:x1830881263307776:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065194.785072:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.785079:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61830 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.785098:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.785105:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.785111:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 46 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.785116:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.785117:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.785120:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 6/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1978368->2097151] (req 1978368->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 46 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.785137:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 46 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.785145:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 46 pid: 21235 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.785153:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260441472:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.785178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065194.785183:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.785190:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 23 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.785197:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260441600:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.785216:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.785223:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 10 pid: 8428 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746065194.785229:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260441728:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.785259:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263307904 00000100:00100000:2.0:1746065194.785264:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263307904 00010000:00010000:2.0:1746065194.785288:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 47 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.785314:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7767 00000100:00100000:2.0:1746065194.785321:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+47:1959:x1830881263307904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.785331:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.785353:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 47 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.785363:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 47 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.785364:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6600 going to sleep for 11 seconds 00010000:00010000:2.0:1746065194.785382:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.785384:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.785556:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.785567:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.785594:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 23 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.785604:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260441856:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065194.785638:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.790379:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.790400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.790417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.790472:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308032 00000100:00100000:1.0:1746065194.790478:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308032 00010000:00010000:1.0:1746065194.790505:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 11 pid: 8428 timeout: 894 lvb_type: 1 00000100:00100000:1.0:1746065194.790523:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308160 00000100:00100000:1.0:1746065194.790525:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308160 00010000:00010000:1.0:1746065194.790535:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 48 pid: 21235 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.790548:0:4545:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.46@tcp) returned -22 from glimpse AST (req@ffff88012b45ea00 x1830881260441344) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 48 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.790549:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308288 00000100:00100000:1.0:1746065194.790550:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308288 00010000:00010000:1.0:1746065194.790561:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 24 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.790576:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7800/0x14b4f8542d4fe53a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2981888->3141631) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617d5 expref: 48 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.790576:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7768 00000100:00100000:1.0:1746065194.790584:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263308032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065194.790593:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260441344:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065194.790597:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.790612:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 11 pid: 8428 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746065194.790616:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe5c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61829 expref: 47 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.790620:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 11 pid: 8428 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746065194.790626:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc400/0x14b4f8542d4fe5c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61829 expref: 47 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.790633:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc400, rc 0) 00010000:00010000:1.0:1746065194.790639:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.790680:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+46:1961:x1830881263307648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6202us (7569us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065194.790685:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263308032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.790686:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15097 00000100:00100000:1.0:1746065194.790691:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7768 00000100:00100000:1.0:1746065194.790715:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7769 00000100:00100000:1.0:1746065194.790720:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881263308160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.790726:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065194.790728:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7770 00010000:00010000:1.0:1746065194.790733:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 45 pid: 21235 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.790734:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263308288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.790740:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 45 pid: 21235 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.790741:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.790750:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065194.790751:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 24 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.790760:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 24 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.790763:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881263308160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 42us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.790768:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7769 00010000:00010000:3.0:1746065194.790770:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.790772:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.790778:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 44 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.790786:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 44 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.790807:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 44 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.790837:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260441984:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065194.790849:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff55e00/0x14b4f8542d4fe517 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b2 expref: 44 pid: 21235 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.790864:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260441472:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.790877:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00010000:00010000:2.0:1746065194.790878:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f25d000/0x14b4f8542d4fe548 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617e3 expref: 24 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.790887:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260441600:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.790897:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe406 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61749 expref: 10 pid: 8428 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746065194.790905:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260441856:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065194.790906:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260441728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.790915:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.790927:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1959:x1830881263307904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5608us (5753us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065194.790930:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 43 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.790932:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7767 00010000:00010000:2.0:1746065194.790943:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd000, rc 0) 00000100:00100000:2.0:1746065194.790968:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+42:32100:x1830881263307776:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5901us (7505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.790973:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15098 00000100:00100000:0.0:1746065194.794637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.794673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.795291:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308544 00000100:00100000:3.0:1746065194.795299:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308544 00002000:00100000:3.0:1746065194.795337:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012d7fea00 x1830881263308544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.795345:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fea00 with x1830881263308544 ext(2097152->3145727) 00002000:00010000:3.0:1746065194.795350:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fea00 00000100:00100000:1.0:1746065194.795361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.795472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.795496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.795612:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309056 00000100:00100000:3.0:1746065194.795616:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309056 00000100:00100000:3.0:1746065194.795645:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260441984:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065194.795657:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.795693:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263308288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4959us (5273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.795712:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7770 00000100:00100000:0.0:1746065194.795771:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263308800 00000100:00100000:0.0:1746065194.795774:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263308800 00002000:00100000:0.0:1746065194.795791:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b620e00 x1830881263308800/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.795798:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b620e00 with x1830881263308800 ext(3145728->4194303) 00002000:00010000:0.0:1746065194.795801:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b620e00 00000100:00100000:0.0:1746065194.795812:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8532 00000100:00100000:0.0:1746065194.795831:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263308544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065194.795976:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309184 00000100:00100000:3.0:1746065194.795980:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309184 00000100:00100000:3.0:1746065194.795995:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309312 00000100:00100000:3.0:1746065194.795997:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309312 00000100:00100000:3.0:1746065194.796013:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15099 00000100:00100000:3.0:1746065194.796017:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881263309184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.796025:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.796037:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe5d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61837 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.796074:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260442112:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065194.796110:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.796122:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15100 00000100:00100000:3.0:1746065194.796127:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881263309312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.796133:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.796139:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6183e expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.796148:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.796149:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.796156:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 45 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.796168:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 45 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.796176:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfcc00, rc 0) 00000100:00100000:3.0:1746065194.796191:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881263309312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.796196:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15100 00002000:00100000:3.0:1746065194.796217:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012d7fc000 x1830881263309056/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.796223:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc000 with x1830881263309056 ext(3145728->4194303) 00002000:00010000:3.0:1746065194.796227:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fc000 00000100:00100000:3.0:1746065194.796243:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8533 00000100:00100000:3.0:1746065194.796248:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1961:x1830881263308800:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065194.796491:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8534 00000100:00100000:1.0:1746065194.796498:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263309056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065194.799724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.799808:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309568 00000100:00100000:2.0:1746065194.799830:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309568 00002000:00100000:2.0:1746065194.799863:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1978368->1982463) req@ffff88012d7fca80 x1830881263309568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.799871:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fca80 with x1830881263309568 ext(1978368->1982463) 00002000:00010000:2.0:1746065194.799876:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fca80 00000100:00100000:2.0:1746065194.799942:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8535 00000100:00100000:2.0:1746065194.799949:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881263309568:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065194.800075:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881263309568:12345-192.168.202.46@tcp:3:cat.0 Request processed in 126us (358us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065194.800080:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8535 00002000:00100000:2.0:1746065194.800085:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1978368->1982463) req@ffff88012d7fca80 x1830881263309568/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.800091:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fca80 with x1830881263309568 ext(1978368->1982463) 00002000:00010000:2.0:1746065194.800094:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fca80 00000100:00100000:3.0:1746065194.802665:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260442112:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065194.802695:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe5d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61837 expref: 44 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.802715:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd400/0x14b4f8542d4fe5d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61837 expref: 44 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.802738:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd400, rc 0) 00000100:00100000:3.0:1746065194.802776:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881263309184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6757us (7303us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065194.802783:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15099 00000100:00100000:2.0:1746065194.805161:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+25:1961:x1830881263308544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9321us (10522us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.805172:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8532 00002000:00100000:2.0:1746065194.805183:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012d7fea00 x1830881263308544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.805193:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fea00 with x1830881263308544 ext(2097152->3145727) 00002000:00010000:2.0:1746065194.805199:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fea00 00000100:00100000:1.0:1746065194.808101:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263309056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11595us (13419us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065194.808111:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8534 00002000:00100000:1.0:1746065194.808119:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012d7fc000 x1830881263309056/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065194.808127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:1.0:1746065194.808128:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc000 with x1830881263309056 ext(3145728->4194303) 00002000:00010000:1.0:1746065194.808133:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fc000 00000100:00100000:3.0:1746065194.808597:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309824 00000100:00100000:3.0:1746065194.808604:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309824 00000100:00100000:3.0:1746065194.808633:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4355 00000100:00100000:3.0:1746065194.808640:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32094:x1830881263309824:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065194.808881:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263308800:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12631us (13519us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065194.808887:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8533 00002000:00100000:2.0:1746065194.808893:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b620e00 x1830881263308800/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.808900:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b620e00 with x1830881263308800 ext(3145728->4194303) 00002000:00010000:2.0:1746065194.808904:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b620e00 00000100:00100000:3.0:1746065194.809072:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32094:x1830881263309824:12345-192.168.202.46@tcp:35:cat.0 Request processed in 432us (944us total) trans 8589944382 rc 0/0 00000100:00100000:3.0:1746065194.809078:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4355 00000100:00100000:0.0:1746065194.810974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.811139:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263309952 00000100:00100000:3.0:1746065194.811145:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263309952 00000100:00100000:3.0:1746065194.811232:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15101 00000100:00100000:3.0:1746065194.811239:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:32100:x1830881263309952:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065194.811252:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.811267:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61845 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.811294:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.811302:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.811308:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 44 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.811313:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.811315:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.811318:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 44 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.811343:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 44 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.811353:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 44 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.811364:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260442240:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.811769:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.811777:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 22 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.811785:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260442368:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.811809:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.811836:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 9 pid: 8427 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746065194.811844:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260442496:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.812202:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.815144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.815196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.815209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.815277:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.815376:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310208 00000100:00100000:3.0:1746065194.815383:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310208 00010000:00010000:3.0:1746065194.815412:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.815435:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310336 00000100:00100000:3.0:1746065194.815437:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310336 00010000:00010000:3.0:1746065194.815446:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 23 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.815456:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310464 00000100:00100000:3.0:1746065194.815458:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310464 00010000:00010000:3.0:1746065194.815467:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 10 pid: 8427 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746065194.815479:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7771 00000100:00100000:3.0:1746065194.815485:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1959:x1830881263310208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.815496:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.815514:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.815523:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.815544:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.815575:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1959:x1830881263310208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.815581:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7771 00000100:00100000:3.0:1746065194.815593:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7772 00000100:00100000:3.0:1746065194.815597:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263310336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.815602:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.815609:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 23 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.815617:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 23 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.815632:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.815645:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263310336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.815648:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7773 00000100:00100000:1.0:1746065194.815655:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263310464:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.815661:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.815669:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 10 pid: 8427 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746065194.815678:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 10 pid: 8427 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746065194.815688:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.815690:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.815696:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 44 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.815717:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 44 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.815744:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 44 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.815755:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b621880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260442624:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065194.815804:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.815833:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310080 00000100:00100000:1.0:1746065194.815836:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310080 00000100:00100000:1.0:1746065194.815854:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15102 00000100:00100000:1.0:1746065194.815858:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263310080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065194.815868:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.815876:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f25c400/0x14b4f8542d4fe5e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6184c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.815898:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b621c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260442752:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065194.815917:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.816037:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7772 00010000:00010000:3.0:1746065194.816069:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa7000/0x14b4f8542d4fe541 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617dc expref: 44 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.816098:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260442240:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.816114:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b5c00/0x14b4f8542d4fe54f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ea expref: 24 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.816121:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260442368:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.816128:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f73c000/0x14b4f8542d4fe41b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61750 expref: 10 pid: 8427 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746065194.816136:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260442496:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.816153:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 43 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.816160:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc600, rc 0) 00000100:00100000:3.0:1746065194.816230:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:32100:x1830881263309952:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4990us (5261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.816236:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15101 00000100:00100000:1.0:1746065194.817244:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b621880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260442624:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065194.817254:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.817275:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263310464:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1620us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.817281:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7773 00000100:00100000:2.0:1746065194.817532:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b621c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260442752:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065194.817548:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f25c400/0x14b4f8542d4fe5e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6184c expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.817557:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f25c400/0x14b4f8542d4fe5e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6184c expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.817577:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f25c400, rc 0) 00000100:00100000:2.0:1746065194.817598:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:1960:x1830881263310080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1739us (2461us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065194.817604:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15102 00000100:00100000:0.0:1746065194.818609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.818682:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310720 00000100:00100000:2.0:1746065194.818688:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310720 00002000:00100000:2.0:1746065194.818730:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1232896->1236991) req@ffff88012d135180 x1830881263310720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.818744:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135180 with x1830881263310720 ext(1232896->1236991) 00002000:00010000:2.0:1746065194.818748:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d135180 00000100:00100000:2.0:1746065194.818778:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8536 00000100:00100000:2.0:1746065194.818784:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881263310720:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065194.818932:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881263310720:12345-192.168.202.46@tcp:3:cat.0 Request processed in 148us (325us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065194.818937:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8536 00002000:00100000:2.0:1746065194.818942:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x388:0x0] (1232896->1236991) req@ffff88012d135180 x1830881263310720/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.818948:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135180 with x1830881263310720 ext(1232896->1236991) 00002000:00010000:2.0:1746065194.818951:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d135180 00000100:00100000:2.0:1746065194.822269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.822314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.822385:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263310976 00000100:00100000:1.0:1746065194.822392:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263310976 00002000:00100000:1.0:1746065194.822432:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d96d80 x1830881263310976/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065194.822445:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96d80 with x1830881263310976 ext(4194304->5013503) 00002000:00010000:1.0:1746065194.822449:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d96d80 00000100:00100000:1.0:1746065194.822465:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8537 00000100:00100000:1.0:1746065194.822470:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+35:1958:x1830881263310976:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065194.822910:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311232 00000100:00100000:3.0:1746065194.822917:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311232 00000100:00100000:3.0:1746065194.823091:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4356 00000100:00100000:3.0:1746065194.823096:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32100:x1830881263311232:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065194.823992:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:32100:x1830881263311232:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 893us (1674us total) trans 8589944383 rc 0/0 00000100:00100000:3.0:1746065194.823998:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4356 00000100:00100000:0.0:1746065194.825358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.825374:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311360 00000100:00100000:2.0:1746065194.825379:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311360 00000100:00100000:2.0:1746065194.825416:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15103 00000100:00100000:2.0:1746065194.825423:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+37:32102:x1830881263311360:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065194.825434:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.825448:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61853 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.825470:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.825481:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 38 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.825488:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 36 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.825493:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.825495:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.825497:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.825521:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 36 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.825532:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 36 pid: 21235 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.825542:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260442880:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.825622:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 38 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.825631:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 38 pid: 21235 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.825638:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260443008:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.825664:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 10 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.825671:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 10 pid: 2462 timeout: 894 lvb_type: 1 00000100:00100000:2.0:1746065194.825678:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260443136:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.825694:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.827624:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260442880:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.827636:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260443008:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.827643:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260443136:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.827669:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 38 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.827682:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756400, rc 0) 00000100:00100000:2.0:1746065194.827726:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+38:32102:x1830881263311360:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2303us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.827733:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15103 00000100:00100000:0.0:1746065194.828333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.828416:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311488 00000100:00100000:1.0:1746065194.828508:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311488 00010000:00010000:1.0:1746065194.828532:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 37 pid: 21235 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.828565:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7774 00000100:00100000:1.0:1746065194.828571:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1959:x1830881263311488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.828581:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.828598:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 37 pid: 21235 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.828609:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 37 pid: 21235 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.828627:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f25d400/0x14b4f8542d4fe4bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61788 expref: 37 pid: 21235 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.828642:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.828664:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1959:x1830881263311488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.828669:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7774 00000100:00100000:0.0:1746065194.829635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.829665:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.829762:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311616 00000100:00100000:3.0:1746065194.829767:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311616 00000100:00100000:1.0:1746065194.829774:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263311744 00000100:00100000:1.0:1746065194.829778:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263311744 00010000:00010000:3.0:1746065194.829787:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 11 pid: 2462 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746065194.829791:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 38 pid: 21235 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.829898:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7775 00000100:00100000:1.0:1746065194.829903:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7776 00000100:00100000:2.0:1746065194.829905:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263311616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065194.829907:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+38:1958:x1830881263311744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.829914:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.829914:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.829926:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 11 pid: 2462 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746065194.829926:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 38 pid: 21235 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.829934:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 38 pid: 21235 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.829941:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 11 pid: 2462 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746065194.829953:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff55000/0x14b4f8542d4fe510 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ab expref: 38 pid: 21235 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.829956:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f25da00/0x14b4f8542d4fe3ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61742 expref: 11 pid: 2462 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746065194.829961:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.829963:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.829969:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 37 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.829977:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 37 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.829983:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065194.829999:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 37 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.830013:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b621880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260443264:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065194.830085:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263311616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 180us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.830090:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7775 00000100:00100000:1.0:1746065194.830103:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.830269:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+36:1958:x1830881263310976:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7797us (8004us total) trans 0 rc 819200/819200 00000100:00100000:0.0:1746065194.830276:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8537 00002000:00100000:0.0:1746065194.830284:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d96d80 x1830881263310976/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.830292:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d96d80 with x1830881263310976 ext(4194304->5013503) 00002000:00010000:0.0:1746065194.830295:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d96d80 00000100:00100000:0.0:1746065194.834100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.834182:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312000 00000100:00100000:2.0:1746065194.834188:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312000 00000100:00100000:1.0:1746065194.834196:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b621880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260443264:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065194.834211:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065194.834222:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (1040384->1044479) req@ffff88012d136300 x1830881263312000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.834228:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136300 with x1830881263312000 ext(1040384->1044479) 00002000:00010000:2.0:1746065194.834232:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d136300 00000100:00100000:1.0:1746065194.834245:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+36:1958:x1830881263311744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4337us (4578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.834253:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7776 00000100:00100000:2.0:1746065194.834255:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8538 00000100:00100000:2.0:1746065194.834259:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+36:1961:x1830881263312000:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065194.834372:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+35:1961:x1830881263312000:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 112us (286us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065194.834375:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8538 00002000:00100000:2.0:1746065194.834378:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (1040384->1044479) req@ffff88012d136300 x1830881263312000/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.834383:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d136300 with x1830881263312000 ext(1040384->1044479) 00002000:00010000:2.0:1746065194.834385:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d136300 00000100:00100000:0.0:1746065194.836065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.836262:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312128 00000100:00100000:2.0:1746065194.836271:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312128 00000100:00100000:2.0:1746065194.836318:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15104 00000100:00100000:2.0:1746065194.836324:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+22:32102:x1830881263312128:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065194.836336:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.836351:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6185a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.836374:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 42 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.836380:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065194.836381:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065194.836384:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->1556479] (req 1048576->1556479) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.836409:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 42 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.836419:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 42 pid: 8428 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.836429:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260443392:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.836500:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.836855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.836912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.837080:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312384 00000100:00100000:3.0:1746065194.837084:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312384 00000100:00100000:3.0:1746065194.837104:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312256 00000100:00100000:3.0:1746065194.837106:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312256 00000100:00100000:3.0:1746065194.837118:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15105 00000100:00100000:3.0:1746065194.837123:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263312384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.837130:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.837137:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfce00/0x14b4f8542d4fe5fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61868 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.837161:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260443520:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065194.837204:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.837223:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15106 00000100:00100000:3.0:1746065194.837228:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+26:1958:x1830881263312256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065194.837234:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.837312:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fe605 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61861 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.837337:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260443648:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065194.837392:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.838171:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260443392:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.838187:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->1556479] (req 1048576->1556479) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 27 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.838196:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c757400, rc 0) 00000100:00100000:2.0:1746065194.838229:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+27:32102:x1830881263312128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1905us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.838235:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15104 00000100:00100000:2.0:1746065194.838679:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260443648:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065194.838695:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fe605 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61861 expref: 26 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.838712:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc000/0x14b4f8542d4fe605 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61861 expref: 26 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.838731:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfc000, rc 0) 00000100:00100000:2.0:1746065194.838759:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+25:1958:x1830881263312256:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1531us (1847us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065194.838765:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15106 00000100:00100000:3.0:1746065194.838811:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260443520:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065194.838847:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfce00/0x14b4f8542d4fe5fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61868 expref: 24 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.838855:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfce00/0x14b4f8542d4fe5fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61868 expref: 24 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.838864:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfce00, rc 0) 00000100:00100000:3.0:1746065194.838879:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881263312384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1756us (2025us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065194.838884:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15105 00000100:00100000:0.0:1746065194.842083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.842121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.842160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.842231:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312512 00000100:00100000:3.0:1746065194.842238:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312512 00002000:00100000:3.0:1746065194.842273:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1978368->2097151) req@ffff88012d137100 x1830881263312512/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.842283:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137100 with x1830881263312512 ext(1978368->2097151) 00010000:00010000:3.0:1746065194.842290:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 43 pid: 8428 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.842308:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 43 pid: 8428 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746065194.842315:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d137100 00000100:00100000:3.0:1746065194.842331:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2585 00000100:00100000:2.0:1746065194.842334:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312640 00000100:00100000:3.0:1746065194.842338:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1961:x1830881263312512:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065194.842338:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312640 00000100:00100000:2.0:1746065194.842354:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263312768 00000100:00100000:2.0:1746065194.842356:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263312768 00000100:00100000:2.0:1746065194.842367:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15107 00000100:00100000:2.0:1746065194.842371:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263312640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065194.842381:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.842392:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c756200/0x14b4f8542d4fe60c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6186f expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.842431:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260443776:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065194.842495:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.842509:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15108 00000100:00100000:2.0:1746065194.842514:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:1959:x1830881263312768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065194.842519:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.842525:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fe613 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61876 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.842543:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260443904:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065194.842560:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.843605:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260443904:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065194.843614:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260443776:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065194.843622:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fe613 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61876 expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.843625:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c756200/0x14b4f8542d4fe60c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6186f expref: 26 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.843631:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bddda00/0x14b4f8542d4fe613 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61876 expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.843638:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c756200/0x14b4f8542d4fe60c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6186f expref: 25 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.843639:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bddda00, rc 0) 00010000:00010000:3.0:1746065194.843644:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756200, rc 0) 00000100:00100000:2.0:1746065194.843673:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1959:x1830881263312768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1157us (1511us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065194.843679:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15108 00000100:00100000:3.0:1746065194.843921:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+23:1959:x1830881263312640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1548us (1798us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065194.843926:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15107 00000100:00100000:3.0:1746065194.846510:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1961:x1830881263312512:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4166us (4427us total) trans 17179873703 rc 0/0 00000100:00100000:3.0:1746065194.846520:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2585 00002000:00100000:3.0:1746065194.846531:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1978368->2097151) req@ffff88012d137100 x1830881263312512/t17179873703(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.846540:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137100 with x1830881263312512 ext(1978368->2097151) 00010000:00010000:3.0:1746065194.846548:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 45 pid: 8428 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.846560:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 45 pid: 8428 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746065194.846567:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d137100 00000100:00100000:0.0:1746065194.848797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.849182:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313024 00000100:00100000:3.0:1746065194.849190:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313024 00000100:00100000:3.0:1746065194.849227:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4357 00000100:00100000:3.0:1746065194.849234:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:32095:x1830881263313024:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:3.0:1746065194.849409:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:32095:x1830881263313024:12345-192.168.202.46@tcp:35:cat.0 Request processed in 175us (622us total) trans 8589944384 rc 0/0 00000100:00100000:3.0:1746065194.849416:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4357 00000100:00100000:2.0:1746065194.849945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.849987:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313152 00000100:00100000:1.0:1746065194.849992:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313152 00010000:00010000:1.0:1746065194.850012:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 45 pid: 8428 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.850041:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7777 00000100:00100000:1.0:1746065194.850046:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881263313152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.850056:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.850074:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 45 pid: 8428 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.850084:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 45 pid: 8428 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.850102:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfd000/0x14b4f8542d4fe5cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1978368->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61830 expref: 45 pid: 8428 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.850130:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.850132:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.850138:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.850146:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.850171:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.850181:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b621880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260444032:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065194.850241:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.852376:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b621880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260444032:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065194.852392:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.853643:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1960:x1830881263313152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3590us (3692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.853652:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7777 00000100:00100000:0.0:1746065194.854995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.855080:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313408 00000100:00100000:3.0:1746065194.855088:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313408 00002000:00100000:3.0:1746065194.855124:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1552384->1556479) req@ffff88012d134a80 x1830881263313408/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.855132:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134a80 with x1830881263313408 ext(1552384->1556479) 00002000:00010000:3.0:1746065194.855137:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d134a80 00000100:00100000:3.0:1746065194.855153:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8539 00000100:00100000:3.0:1746065194.855160:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263313408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065194.855299:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+23:1961:x1830881263313408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 139us (308us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065194.855306:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8539 00002000:00100000:3.0:1746065194.855310:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1552384->1556479) req@ffff88012d134a80 x1830881263313408/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/4536 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.855317:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134a80 with x1830881263313408 ext(1552384->1556479) 00002000:00010000:3.0:1746065194.855320:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d134a80 00000100:00100000:0.0:1746065194.857156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.857666:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313664 00000100:00100000:2.0:1746065194.857674:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313664 00000100:00100000:2.0:1746065194.857726:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4358 00000100:00100000:2.0:1746065194.857733:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:32102:x1830881263313664:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065194.857939:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:32102:x1830881263313664:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 205us (786us total) trans 8589944385 rc 0/0 00000100:00100000:2.0:1746065194.857945:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4358 00000100:00100000:0.0:1746065194.866350:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.866984:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313792 00000100:00100000:2.0:1746065194.866993:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313792 00000100:00100000:2.0:1746065194.867045:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10098 00000100:00100000:2.0:1746065194.867052:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:32108:x1830881263313792:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065194.867071:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.867085:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136003e00/0x14b4f8542d4fe61a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6187d expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.867132:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867142:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867151:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867162:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867168:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867172:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867266:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867274:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867279:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065194.867304:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065194.867308:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065194.867319:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867327:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867332:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867336:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867341:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867346:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0087600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.867348:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867354:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867363:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065194.867366:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065194.867369:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867373:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087600/0x14b4f8542d4fe621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867399:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867403:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867408:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867412:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0086e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.867414:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867419:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867424:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b5371f00) 00010000:00010000:2.0:1746065194.867426:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065194.867428:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867432:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0086e00/0x14b4f8542d4fe628 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.867456:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136003e00/0x14b4f8542d4fe61a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.867469:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 7 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.867475:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.867477:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065194.867478:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0087800, rc 0) 00000100:00100000:2.0:1746065194.867526:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32108:x1830881263313792:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 474us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.867532:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10098 00000100:00100000:0.0:1746065194.870809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.871084:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263313920 00000100:00100000:0.0:1746065194.871086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.871091:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263313920 00000100:00100000:0.0:1746065194.871112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.871124:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.871125:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314176 00000100:00100000:2.0:1746065194.871128:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314176 00000100:00100000:0.0:1746065194.871148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.871167:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314432 00000100:00100000:2.0:1746065194.871169:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314432 00000100:00100000:2.0:1746065194.871180:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314048 00000100:00100000:2.0:1746065194.871182:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314048 00000100:00100000:0.0:1746065194.871189:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314304 00000100:00100000:0.0:1746065194.871191:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314304 00000100:00100000:2.0:1746065194.871194:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15109 00000100:00100000:2.0:1746065194.871200:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263314176:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065194.871217:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15110 00010000:00010000:2.0:1746065194.871222:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065194.871227:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263314432:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065194.871236:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.871242:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe636 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61892 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.871246:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618a0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.871265:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.871267:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.871276:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.871291:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065194.871293:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15111 00000100:00100000:0.0:1746065194.871298:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1960:x1830881263314048:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065194.871301:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa6000, rc 0) 00010000:00010000:0.0:1746065194.871303:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065194.871311:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe644 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6188b expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.871319:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260444160:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065194.871331:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260444288:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065194.871355:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1960:x1830881263314432:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.871361:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15110 00000100:00100000:0.0:1746065194.871377:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.871381:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15112 00000100:00100000:1.0:1746065194.871387:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263314304:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:3.0:1746065194.871391:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15113 00010000:00010000:1.0:1746065194.871394:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065194.871399:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263313920:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065194.871405:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.871405:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61899 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.871413:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fe652 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61884 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.871417:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.871418:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.871423:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.871433:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 13 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.871440:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faa6c00, rc 0) 00000100:00100000:3.0:1746065194.871443:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260444416:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065194.871455:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.871457:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1960:x1830881263314304:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 70us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.871465:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15112 00000100:00100000:3.0:1746065194.871467:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.873713:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260444160:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065194.873722:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260444288:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065194.873741:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe636 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61892 expref: 13 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.873741:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe644 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6188b expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.873752:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe636 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61892 expref: 13 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.873756:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0b4600/0x14b4f8542d4fe644 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6188b expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.873765:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136003e00, rc 0) 00010000:00010000:2.0:1746065194.873779:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0b4600, rc 0) 00000100:00100000:3.0:1746065194.873798:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263314176:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2597us (2712us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065194.873800:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263314048:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2501us (2673us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065194.873803:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15109 00000100:00100000:2.0:1746065194.873807:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15111 00000100:00100000:3.0:1746065194.873865:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260444416:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065194.873878:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fe652 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61884 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.873886:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092770600/0x14b4f8542d4fe652 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61884 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.873894:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092770600, rc 0) 00000100:00100000:3.0:1746065194.873909:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263313920:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2512us (3107us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065194.873913:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15113 00000100:00100000:0.0:1746065194.876959:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.877151:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314688 00000100:00100000:2.0:1746065194.877158:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314688 00000100:00100000:2.0:1746065194.877287:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10099 00000100:00100000:2.0:1746065194.877295:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32108:x1830881263314688:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065194.877312:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.877327:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66b800/0x14b4f8542d4fe659 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618a7 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.877414:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.877429:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.877436:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.877442:0:16767:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.877451:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.877479:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.877489:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 8 pid: 16767 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.877501:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260444544:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.878045:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 11 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.878053:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 11 pid: 16767 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.878061:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260444672:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.878087:0:16767:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.878095:0:16767:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 253 pid: 24350 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.878109:0:16767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260444800:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.878125:0:16767:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065194.880520:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260444544:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.880530:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260444672:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.880536:0:16767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16767:1830881260444800:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.880555:0:16767:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065194.881266:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.881401:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314816 00000100:00100000:1.0:1746065194.881407:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314816 00010000:00010000:1.0:1746065194.881435:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 9 pid: 16767 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.881473:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7778 00000100:00100000:1.0:1746065194.881479:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263314816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.881492:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.881496:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 9 pid: 16767 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.881504:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 9 pid: 16767 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.881523:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087800/0x14b4f8542d4fe62f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6187d expref: 9 pid: 16767 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065194.881527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065194.881550:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.881554:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.881561:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.881566:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.881598:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263314816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 119us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.881606:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7778 00000100:00100000:1.0:1746065194.881618:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315072 00000100:00100000:1.0:1746065194.881621:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315072 00000100:00100000:0.0:1746065194.881663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.881729:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263314944 00000100:00100000:2.0:1746065194.881733:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263314944 00010000:00010000:2.0:1746065194.881746:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 12 pid: 16767 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.881761:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7779 00000100:00100000:2.0:1746065194.881765:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263314944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.881771:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.881775:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 12 pid: 16767 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.881781:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 12 pid: 16767 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.881792:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c756000/0x14b4f8542d4fe5b8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61822 expref: 12 pid: 16767 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.881802:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.881805:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.881809:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.881837:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.881854:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263314944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.881859:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7779 00010000:00010000:1.0:1746065194.881909:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 254 pid: 24350 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.881923:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7780 00000100:00100000:1.0:1746065194.881928:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1961:x1830881263315072:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.881934:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.881937:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 254 pid: 24350 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.881944:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 254 pid: 24350 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.881953:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5af400/0x14b4f8542d4fe595 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6181b expref: 254 pid: 24350 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.881960:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.881963:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.881967:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.881972:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16767 initiator: MDT0 00010000:00010000:1.0:1746065194.881984:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.881997:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:1961:x1830881263315072:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.882002:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7780 00010000:00010000:2.0:1746065194.882231:0:16767:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.882237:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065194.882252:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065194.882365:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66b800/0x14b4f8542d4fe659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a7 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.882448:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a7 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.882455:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.882457:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065194.882459:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a66ba00, rc 0) 00000100:00100000:2.0:1746065194.882731:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32108:x1830881263314688:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 5286us (5628us total) trans 8589944386 rc 0/0 00000100:00100000:2.0:1746065194.882739:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10099 00000100:00100000:0.0:1746065194.884432:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.884517:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315328 00000100:00100000:2.0:1746065194.884525:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315328 00000100:00100000:2.0:1746065194.884662:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10100 00000100:00100000:2.0:1746065194.884669:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32108:x1830881263315328:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065194.884694:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.884706:0:16767:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065194.884726:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a66ba00/0x14b4f8542d4fe660 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a7 expref: 8 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.884740:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.884743:0:16767:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065194.884751:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef200/0x14b4f8542d4fe66e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618ae expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.884854:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeea00/0x14b4f8542d4fe675 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.884864:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeea00/0x14b4f8542d4fe675 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:2.0:1746065194.884918:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeea00/0x14b4f8542d4fe675 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:2.0:1746065194.884929:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065194.885023:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef200/0x14b4f8542d4fe66e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ae expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.885034:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeea00/0x14b4f8542d4fe675 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ae expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.885083:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.885087:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065194.885089:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdeea00, rc 0) 00000100:00100000:2.0:1746065194.885157:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32108:x1830881263315328:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 487us (728us total) trans 8589944387 rc 0/0 00000100:00100000:2.0:1746065194.885162:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10100 00000100:00100000:0.0:1746065194.887244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.887332:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315456 00000100:00100000:2.0:1746065194.887338:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315456 00000100:00100000:2.0:1746065194.887379:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10101 00000100:00100000:2.0:1746065194.887385:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32108:x1830881263315456:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065194.887402:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065194.887413:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee400/0x14b4f8542d4fe683 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618b5 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.887451:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee400/0x14b4f8542d4fe683 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618b5 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.887461:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee400/0x14b4f8542d4fe683 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618b5 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.887475:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.887478:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065194.887480:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdee400, rc 0) 00000100:00100000:2.0:1746065194.887521:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32108:x1830881263315456:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.887526:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10101 00000100:00100000:0.0:1746065194.889479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.889513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.889548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.889667:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315712 00000100:00100000:2.0:1746065194.889674:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315712 00000100:00100000:2.0:1746065194.889940:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315968 00000100:00100000:2.0:1746065194.889944:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315968 00000100:00100000:3.0:1746065194.889968:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316224 00000100:00100000:3.0:1746065194.889971:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316224 00000100:00100000:3.0:1746065194.889990:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15114 00000100:00100000:3.0:1746065194.889995:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263315712:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065194.890027:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.890042:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.890047:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065194.890049:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065194.890051:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.890074:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.890083:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 22 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.890093:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260444928:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.890140:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.890154:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15115 00000100:00100000:3.0:1746065194.890159:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263316224:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065194.890173:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.890175:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15116 00000100:00100000:2.0:1746065194.890182:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263315968:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065194.890184:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.890190:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.890196:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 43 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.890200:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.890201:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.890202:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.890204:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.890214:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.890217:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 43 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.890220:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.890225:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 43 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:2.0:1746065194.890227:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.890232:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260445056:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.890232:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.890233:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.890235:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.890249:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 34 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.890256:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 34 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.890263:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260445184:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.890269:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.890276:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 11 pid: 4545 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746065194.890287:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260445312:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.890292:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.890298:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 11 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746065194.890307:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 22 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.890309:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260445440:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.890314:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 22 pid: 4545 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.890320:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260445568:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.890330:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 35 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.890334:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065194.890336:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 35 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.890342:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260445696:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.890356:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.892093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.892177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.892212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.892272:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315584 00000100:00100000:1.0:1746065194.892279:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315584 00000100:00100000:1.0:1746065194.892302:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263315840 00000100:00100000:1.0:1746065194.892303:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263315840 00000100:00100000:1.0:1746065194.892325:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316096 00000100:00100000:1.0:1746065194.892327:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316096 00000100:00100000:1.0:1746065194.892339:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15117 00000100:00100000:1.0:1746065194.892345:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263315584:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065194.892373:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.892385:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.892391:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065194.892393:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065194.892395:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.892415:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 34 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.892423:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 34 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.892433:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b621880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260445824:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065194.892486:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.892536:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15118 00000100:00100000:3.0:1746065194.892544:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263315840:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065194.892560:0:2463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.892569:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 43 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.892574:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065194.892575:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065194.892577:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.892590:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 43 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.892602:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 43 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.892611:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260445952:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065194.892635:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e72900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.892689:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15119 00000100:00100000:0.0:1746065194.892696:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263316096:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065194.892721:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.892730:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 13 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.892736:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.892742:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.892746:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.892747:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.892749:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 6/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.892764:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 35 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.892776:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 35 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065194.892784:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260446080:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.893721:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 34 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.893731:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 34 pid: 25185 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746065194.893740:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260446208:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.893767:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 13 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.893774:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 13 pid: 8428 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746065194.893782:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260446336:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.893798:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065194.896625:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260444928:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.896646:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.897884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.897957:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260446080:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.897985:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260446208:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065194.898023:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260446336:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065194.898045:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.898103:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316480 00000100:00100000:1.0:1746065194.898109:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316480 00010000:00010000:1.0:1746065194.898135:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 44 pid: 4545 timeout: 894 lvb_type: 1 00000100:00100000:1.0:1746065194.898156:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7781 00000100:00100000:1.0:1746065194.898162:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1959:x1830881263316480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.898173:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.898190:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 44 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746065194.898199:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 44 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:1.0:1746065194.898218:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.898249:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1959:x1830881263316480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.898254:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7781 00000100:00100000:1.0:1746065194.898285:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b621880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260445824:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065194.898294:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065194.898360:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260445952:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065194.898369:0:2463:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.899171:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfcc00/0x14b4f8542d4fe5db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6183e expref: 43 pid: 4545 timeout: 894 lvb_type: 1 00000100:00100000:2.0:1746065194.899197:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260445056:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.899209:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260445312:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.899216:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260445568:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.899229:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.899252:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260445184:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.899258:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260445440:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065194.899264:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4544:1830881260445696:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065194.899277:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.902043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.902219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.902244:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316608 00000100:00100000:2.0:1746065194.902251:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316608 00010000:00010000:2.0:1746065194.902280:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 13 pid: 4545 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746065194.903112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.903468:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316992 00000100:00100000:3.0:1746065194.903474:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316992 00002000:00100000:3.0:1746065194.903502:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (1040384->1048575) req@ffff8800a90adc00 x1830881263316992/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 8680/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.903510:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90adc00 with x1830881263316992 ext(1040384->1048575) 00010000:00010000:3.0:1746065194.903518:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 35 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.903528:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 35 pid: 8851 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746065194.903538:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a90adc00 00000100:00100000:3.0:1746065194.903561:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2586 00000100:00100000:3.0:1746065194.903569:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+35:1960:x1830881263316992:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065194.903934:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:26bbd020-9fba-464a-bebc-8395a287959e+37:1960:x1830881263316992:12345-192.168.202.46@tcp:4:cat.0 Request processed in 365us (1898us total) trans 21474840993 rc 0/0 00000100:00100000:3.0:1746065194.903940:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2586 00002000:00100000:3.0:1746065194.903945:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (1040384->1048575) req@ffff8800a90adc00 x1830881263316992/t21474840993(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 8680/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.903952:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90adc00 with x1830881263316992 ext(1040384->1048575) 00010000:00010000:3.0:1746065194.903957:0:8434:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 37 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.903964:0:8434:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 37 pid: 8851 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746065194.903970:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a90adc00 00000100:00100000:2.0:1746065194.904266:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316864 00000100:00100000:2.0:1746065194.904271:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316864 00010000:00010000:2.0:1746065194.904285:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 36 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065194.904322:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.904550:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316736 00000100:00100000:2.0:1746065194.904553:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316736 00010000:00010000:2.0:1746065194.904568:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 14 pid: 4545 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746065194.904568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.904578:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263316352 00000100:00100000:0.0:1746065194.904582:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263316352 00000100:00100000:2.0:1746065194.904588:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7782 00000100:00100000:0.0:1746065194.904592:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7783 00000100:00100000:2.0:1746065194.904593:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1960:x1830881263316608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065194.904597:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881263316864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.904601:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.904602:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.904614:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 13 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746065194.904614:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 36 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.904623:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 13 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746065194.904623:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 36 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.904640:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faa6000/0x14b4f8542d4fe63d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618a0 expref: 13 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746065194.904640:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec47200/0x14b4f8542d4fe556 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f1 expref: 36 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.904653:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065194.904653:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.904669:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1960:x1830881263316608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.904669:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263316864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.904674:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7782 00000100:00100000:0.0:1746065194.904679:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7783 00000100:00100000:2.0:1746065194.904684:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7784 00000100:00100000:2.0:1746065194.904688:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1960:x1830881263316736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.904694:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746065194.904712:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1556479) req@ffff88012bd3ea00 x1830881263316352/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065194.904713:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 14 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:2.0:1746065194.904721:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 14 pid: 4545 timeout: 894 lvb_type: 1 00002000:00100000:0.0:1746065194.904725:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ea00 with x1830881263316352 ext(1048576->1556479) 00010000:00010000:0.0:1746065194.904729:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 23 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.904731:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa6c00/0x14b4f8542d4fe64b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61899 expref: 14 pid: 4545 timeout: 894 lvb_type: 1 00010000:00010000:0.0:1746065194.904736:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 23 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.904739:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1746065194.904741:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bd3ea00 00000100:00100000:2.0:1746065194.904751:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1960:x1830881263316736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 63us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.904751:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2587 00000100:00100000:0.0:1746065194.904755:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+23:1960:x1830881263316352:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065194.904756:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7784 00000100:00100000:2.0:1746065194.904782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.904795:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317120 00000100:00100000:2.0:1746065194.904798:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317120 00002000:00100000:2.0:1746065194.904810:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x388:0x0] (1048576->1236991) req@ffff880094d94380 x1830881263317120/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.904830:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94380 with x1830881263317120 ext(1048576->1236991) 00010000:00010000:2.0:1746065194.904835:0:4012:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 43 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.904843:0:4012:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 43 pid: 25185 timeout: 894 lvb_type: 0 00002000:00010000:2.0:1746065194.904848:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d94380 00000100:00100000:2.0:1746065194.904858:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2588 00000100:00100000:2.0:1746065194.904862:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+43:1960:x1830881263317120:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065194.905146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.905157:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317248 00000100:00100000:0.0:1746065194.905159:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317248 00010000:00010000:0.0:1746065194.905170:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 25 pid: 4545 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065194.905183:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7785 00000100:00100000:0.0:1746065194.905187:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+25:1960:x1830881263317248:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.905193:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.905200:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 25 pid: 4545 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065194.905207:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 25 pid: 4545 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065194.905222:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfda00/0x14b4f8542d4fe579 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61814 expref: 25 pid: 4545 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065194.905230:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.905231:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.905235:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.905242:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.905258:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.905270:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263317248:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.905560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.905574:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317504 00000100:00100000:2.0:1746065194.905578:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317504 00000100:00100000:3.0:1746065194.905586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065194.905588:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 13 pid: 8428 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746065194.905596:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317376 00000100:00100000:3.0:1746065194.905599:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317376 00000100:00100000:2.0:1746065194.905613:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7786 00000100:00100000:2.0:1746065194.905618:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263317504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.905624:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.905633:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 13 pid: 8428 timeout: 894 lvb_type: 1 00010000:00010000:2.0:1746065194.905640:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 13 pid: 8428 timeout: 894 lvb_type: 1 00010000:00010000:2.0:1746065194.905655:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a003ae00/0x14b4f8542d4fe422 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6175e expref: 13 pid: 8428 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746065194.905659:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 37 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.905663:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.905677:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263317504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.905682:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7786 00000100:00100000:2.0:1746065194.905692:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7787 00000100:00100000:2.0:1746065194.905696:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+37:1959:x1830881263317376:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065194.905710:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.905716:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 37 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.905724:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 37 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.905733:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46400/0x14b4f8542d4fe55d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617f8 expref: 37 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.905740:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.905741:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.905743:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.905749:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.905762:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065194.905773:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+36:1959:x1830881263317376:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.905777:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7787 00010000:00010000:2.0:1746065194.906515:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.906523:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.906540:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.906547:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.906552:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.906558:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fdefe00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065194.906561:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.906561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065194.906567:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.906575:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317632 00000100:00100000:1.0:1746065194.906578:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317632 00010000:00010000:2.0:1746065194.906581:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.906586:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdefe00/0x14b4f8542d4fe698 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.906591:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 35 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.906604:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7788 00000100:00100000:1.0:1746065194.906608:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263317632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.906613:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.906621:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 35 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.906622:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263315968:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 16442us (17109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.906628:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15116 00010000:00010000:1.0:1746065194.906629:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 35 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.906639:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6000/0x14b4f8542d4fe564 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617ff expref: 35 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.906651:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.906661:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263317632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.906666:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7788 00000100:00100000:0.0:1746065194.906715:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7785 00010000:00010000:0.0:1746065194.906757:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.906764:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.906778:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.906783:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.906793:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.906797:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136003e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065194.906800:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.906805:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.906828:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.906832:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136003e00/0x14b4f8542d4fe691 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.906859:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263316224:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 16699us (17310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.906863:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15115 00000100:00100000:0.0:1746065194.908867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.908937:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317760 00000100:00100000:1.0:1746065194.908944:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317760 00010000:00010000:1.0:1746065194.908970:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 36 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.909227:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7789 00000100:00100000:1.0:1746065194.909235:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+36:1961:x1830881263317760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.909246:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.909263:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 36 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.909272:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 36 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.909290:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c756400/0x14b4f8542d4fe5f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61853 expref: 36 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.909300:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.909301:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.909305:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.909312:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.909344:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.909383:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+35:1961:x1830881263317760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 148us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.909389:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7789 00010000:00010000:0.0:1746065194.909441:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.909448:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.909471:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.909477:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.909483:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.909488:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa7200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065194.909492:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.909498:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.909507:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.909512:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faa7200/0x14b4f8542d4fe69f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.909554:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263315584:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 17208us (17574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.909561:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15117 00000100:00100000:0.0:1746065194.911148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.911253:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263317888 00000100:00100000:3.0:1746065194.911259:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263317888 00010000:00010000:3.0:1746065194.911283:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 35 pid: 25185 timeout: 894 lvb_type: 1 00000100:00100000:3.0:1746065194.911305:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7790 00000100:00100000:3.0:1746065194.911311:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+35:1959:x1830881263317888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.911320:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.911335:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 35 pid: 25185 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746065194.911344:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 35 pid: 25185 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746065194.911358:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe56b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61806 expref: 35 pid: 25185 timeout: 894 lvb_type: 1 00010000:00010000:3.0:1746065194.911370:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.911372:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.911376:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.911383:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.911397:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.911422:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+34:1959:x1830881263317888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 111us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.911428:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7790 00010000:00010000:1.0:1746065194.911721:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.911729:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.911744:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.911751:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.911756:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.911763:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0b5600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065194.911765:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.911771:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.911779:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.911783:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0b5600/0x14b4f8542d4fe6ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065194.911832:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263316096:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 19137us (19620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.911838:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15119 00000100:00100000:2.0:1746065194.919539:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1960:x1830881263317120:12345-192.168.202.46@tcp:4:cat.0 Request processed in 14668us (14748us total) trans 17179873704 rc 0/0 00000100:00100000:2.0:1746065194.919549:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2588 00002000:00100000:2.0:1746065194.919559:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x388:0x0] (1048576->1236991) req@ffff880094d94380 x1830881263317120/t17179873704(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065194.919567:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94380 with x1830881263317120 ext(1048576->1236991) 00010000:00010000:2.0:1746065194.919576:0:4012:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.919588:0:4012:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00002000:00010000:2.0:1746065194.919594:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d94380 00000100:00100000:3.0:1746065194.921687:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+24:1960:x1830881263316352:12345-192.168.202.46@tcp:4:cat.0 Request processed in 16924us (17112us total) trans 17179873705 rc 0/0 00000100:00100000:3.0:1746065194.921696:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2587 00002000:00100000:3.0:1746065194.921713:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1556479) req@ffff88012bd3ea00 x1830881263316352/t17179873705(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065194.921720:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3ea00 with x1830881263316352 ext(1048576->1556479) 00010000:00010000:3.0:1746065194.921728:0:21483:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 24 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.921736:0:21483:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 24 pid: 8851 timeout: 894 lvb_type: 0 00002000:00010000:3.0:1746065194.921741:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bd3ea00 00000100:00100000:0.0:1746065194.922788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.922901:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318016 00000100:00100000:3.0:1746065194.922908:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318016 00010000:00010000:3.0:1746065194.922930:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.922962:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7791 00000100:00100000:3.0:1746065194.922969:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+45:1958:x1830881263318016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.922979:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.922993:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.923001:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.923022:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdfc600/0x14b4f8542d4fe5e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61845 expref: 45 pid: 25185 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.925266:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.925270:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.925275:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.925284:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.925307:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.925351:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+44:1958:x1830881263318016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2379us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.925359:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7791 00010000:00010000:2.0:1746065194.925489:0:2463:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.925504:0:2463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.925528:0:2463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.925534:0:2463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.925540:0:2463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.925545:0:2463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc24a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065194.925548:0:2463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.925554:0:2463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.925564:0:2463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.925569:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc24a00/0x14b4f8542d4fe6a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.925613:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263315840:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 33070us (33435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.925620:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15118 00000100:00100000:0.0:1746065194.930292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.930735:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318144 00000100:00100000:3.0:1746065194.930744:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318144 00010000:00010000:3.0:1746065194.930773:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 24 pid: 8851 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.930809:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7792 00000100:00100000:3.0:1746065194.930841:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+24:1958:x1830881263318144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.930852:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065194.930870:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 24 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.930884:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 24 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.930901:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c757400/0x14b4f8542d4fe5f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6185a expref: 24 pid: 8851 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.930911:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.930913:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.930916:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.930922:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.930946:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065194.930982:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+23:1958:x1830881263318144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 167us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.930989:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7792 00010000:00010000:2.0:1746065194.931437:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.931447:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.931469:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.931476:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.931483:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.931489:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092770600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065194.931492:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.931499:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.931510:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.931515:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092770600/0x14b4f8542d4fe68a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065194.931590:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263315712:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 41593us (42115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.931597:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15114 00000100:00100000:0.0:1746065194.937786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.937846:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318400 00000100:00100000:1.0:1746065194.937854:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318400 00000100:00100000:1.0:1746065194.937947:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10102 00000100:00100000:1.0:1746065194.937956:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32108:x1830881263318400:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:1.0:1746065194.937993:0:24350:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065194.938014:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdee400/0x14b4f8542d4fe683 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618b5 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.938039:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.938042:0:24350:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065194.938065:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.938074:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 252 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.938081:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 252 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.938087:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.938092:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.938116:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.938126:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 10 pid: 16767 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.938136:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b621f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260446464:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065194.938219:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 252 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.938227:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 252 pid: 20754 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.938234:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b622300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260446592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065194.938255:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 252 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065194.938261:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 252 pid: 24350 timeout: 894 lvb_type: 0 00000100:00100000:1.0:1746065194.938268:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b622680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260446720:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065194.938281:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129db4900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065194.940255:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b621f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260446464:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065194.940265:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b622300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260446592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065194.940271:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b622680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260446720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065194.940289:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:2.0:1746065194.940979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.941008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.941051:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318656 00000100:00100000:3.0:1746065194.941058:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318656 00000100:00100000:2.0:1746065194.941075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065194.941086:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 11 pid: 16767 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.941104:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318528 00000100:00100000:3.0:1746065194.941106:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318528 00010000:00010000:3.0:1746065194.941114:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 253 pid: 20754 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.941116:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318784 00000100:00100000:2.0:1746065194.941119:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318784 00000100:00100000:3.0:1746065194.941131:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7793 00010000:00010000:2.0:1746065194.941131:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 254 pid: 24350 timeout: 894 lvb_type: 0 00000100:00100000:3.0:1746065194.941137:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263318656:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.941145:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065194.941146:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7794 00010000:00010000:3.0:1746065194.941150:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 11 pid: 16767 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.941151:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1961:x1830881263318528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065194.941158:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 11 pid: 16767 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.941158:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065194.941162:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 254 pid: 20754 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.941169:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 254 pid: 20754 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.941190:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdef000/0x14b4f8542d4fe525 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617b9 expref: 11 pid: 16767 timeout: 894 lvb_type: 0 00010000:00010000:2.0:1746065194.941195:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeee00/0x14b4f8542d4fe51e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617c0 expref: 254 pid: 20754 timeout: 894 lvb_type: 0 00010000:00010000:3.0:1746065194.941202:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065194.941206:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065194.941212:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065194.941212:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.941216:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065194.941224:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065194.941227:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7795 00000100:00100000:1.0:1746065194.941234:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:1961:x1830881263318784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065194.941241:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065194.941243:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:1961:x1830881263318528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.941244:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263318656:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (266us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065194.941245:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 253 pid: 24350 timeout: 894 lvb_type: 0 00000100:00100000:2.0:1746065194.941249:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7794 00000100:00100000:3.0:1746065194.941252:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7793 00010000:00010000:1.0:1746065194.941258:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 252 pid: 24350 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.941269:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f25cc00/0x14b4f8542d4fe509 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e617a4 expref: 252 pid: 24350 timeout: 894 lvb_type: 0 00010000:00010000:1.0:1746065194.941289:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065194.941293:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.941299:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.941304:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24350 initiator: MDT0 00010000:00010000:1.0:1746065194.941318:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065194.941328:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065194.941334:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000040:00080000:2.0:1746065194.941908:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3138, 88 off265576 00000004:00080000:2.0:1746065194.941914:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233098195ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.941964:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3158, 88 off267512 00000004:00080000:2.0:1746065194.941968:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794233152194ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.941979:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3159, 88 off267600 00000004:00080000:2.0:1746065194.941982:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794233166270ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.941988:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3139, 88 off265664 00000004:00080000:2.0:1746065194.941990:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233175208ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.941996:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3140, 88 off265752 00000004:00080000:2.0:1746065194.941999:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233183397ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.942004:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3160, 88 off267688 00000004:00080000:2.0:1746065194.942007:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794233191580ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.942012:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3161, 88 off267776 00000004:00080000:2.0:1746065194.942015:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794233199409ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.942020:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3162, 88 off267864 00000004:00080000:2.0:1746065194.942022:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794233206918ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.942028:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3141, 88 off265840 00000004:00080000:2.0:1746065194.942031:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233215638ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.942037:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3163, 88 off267952 00000004:00080000:2.0:1746065194.942039:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794233223644ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.942045:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3142, 88 off265928 00000004:00080000:2.0:1746065194.942047:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233231597ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.942053:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3164, 88 off268040 00000004:00080000:2.0:1746065194.942055:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794233239637ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065194.942061:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3143, 88 off266016 00000004:00080000:2.0:1746065194.942063:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233247659ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.942069:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3144, 88 off266104 00000004:00080000:2.0:1746065194.942071:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233255380ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.942076:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3145, 88 off266192 00000004:00080000:2.0:1746065194.942079:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233263522ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.942089:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3146, 88 off266280 00000004:00080000:2.0:1746065194.942091:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794233276092ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065194.942098:0:24350:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3165, 88 off268128 00000004:00080000:2.0:1746065194.942101:0:24350:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794233285842ns, next at 737095943431ns, rc = 0 00000100:00100000:1.0:1746065194.942190:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1961:x1830881263318784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 954us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.942196:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7795 00000004:00010000:3.0:1746065194.971144:0:24350:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a90af100 reply state ffff88008ffb1400 transno 8589944388 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000100:00100000:3.0:1746065194.971160:0:24350:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746065194.971255:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:32108:x1830881263318400:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 33297us (33473us total) trans 8589944388 rc 0/0 00000100:00100000:3.0:1746065194.971263:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10102 00000001:00080000:1.0:1746065194.971430:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944379 is committed 00000001:00080000:1.0:1746065194.971551:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944380 is committed 00000001:00080000:1.0:1746065194.971565:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944388 is committed 00000004:00080000:1.0:1746065194.971569:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2446 committed 00000004:00080000:1.0:1746065194.971587:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2426 committed 00000004:00080000:1.0:1746065194.971594:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2425 committed 00000004:00080000:1.0:1746065194.971596:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2424 committed 00000004:00080000:1.0:1746065194.971597:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2423 committed 00000004:00080000:1.0:1746065194.971599:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2445 committed 00000004:00080000:1.0:1746065194.971602:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2422 committed 00000004:00080000:1.0:1746065194.971603:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2444 committed 00000004:00080000:1.0:1746065194.971605:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2421 committed 00000004:00080000:1.0:1746065194.971606:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2443 committed 00000004:00080000:1.0:1746065194.971607:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2442 committed 00000004:00080000:1.0:1746065194.971608:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2441 committed 00000004:00080000:1.0:1746065194.971609:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2420 committed 00000004:00080000:1.0:1746065194.971610:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2419 committed 00000004:00080000:1.0:1746065194.971611:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2440 committed 00000004:00080000:1.0:1746065194.971612:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2439 committed 00010000:00010000:2.0:1746065194.971614:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00000004:00080000:1.0:1746065194.971614:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2418 committed 00010000:00010000:2.0:1746065194.971622:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065194.971628:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00000001:00080000:1.0:1746065194.971628:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944385 is committed 00010000:00010000:2.0:1746065194.971632:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faa6e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065194.971636:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00000001:00080000:1.0:1746065194.971639:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944383 is committed 00010000:00010000:2.0:1746065194.971645:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065194.971657:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065194.971660:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065194.971668:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065194.971673:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faa6e00/0x14b4f8542d4fe6b4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00000100:00100000:0.0:1746065194.971781:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260446976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.971846:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.971880:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260447488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.971897:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.971913:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260448000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.971934:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260447104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.971951:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a90af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260446848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.971964:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260446976 00000100:00100000:2.0:1746065194.971968:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260446976 00000100:00100000:1.0:1746065194.971975:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260447232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.971993:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260447488 00000100:00100000:2.0:1746065194.971995:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260447488 00000100:00100000:2.0:1746065194.972004:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15120 00000100:00100000:1.0:1746065194.972009:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15121 00000100:00100000:2.0:1746065194.972010:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3297:x1830881260446976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.972015:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3297:x1830881260447488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.972174:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3297:x1830881260447488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (275us total) trans 21474840994 rc 0/0 00000100:00100000:1.0:1746065194.972179:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15121 00000100:00100000:0.0:1746065194.972287:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.972334:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260448000 00000100:00100000:1.0:1746065194.972337:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260448000 00000100:00100000:1.0:1746065194.972351:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15122 00000100:00100000:1.0:1746065194.972355:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3297:x1830881260448000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.972573:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3297:x1830881260448000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (643us total) trans 21474840996 rc 0/0 00000100:00100000:1.0:1746065194.972578:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15122 00000100:00100000:1.0:1746065194.972594:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.972606:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260447744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.972619:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.972627:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260448256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.972636:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.972644:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260448768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.972653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.972671:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260447232 00000100:00100000:1.0:1746065194.972673:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260447232 00000100:00100000:1.0:1746065194.972683:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260447744 00000100:00100000:1.0:1746065194.972684:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260447744 00000100:00100000:1.0:1746065194.972691:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260448256 00000100:00100000:1.0:1746065194.972692:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260448256 00000100:00100000:1.0:1746065194.972710:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260448768 00000100:00100000:1.0:1746065194.972712:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260448768 00000100:00100000:1.0:1746065194.972721:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15123 00000100:00100000:1.0:1746065194.972724:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3295:x1830881260447232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.972810:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881260447232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (215us total) trans 21474840997 rc 0/0 00000100:00100000:1.0:1746065194.972831:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15123 00000100:00100000:1.0:1746065194.972841:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15124 00000100:00100000:1.0:1746065194.972845:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3295:x1830881260447744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065194.972907:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065194.972910:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.972912:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.972913:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065194.972914:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065194.972933:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881260447744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (312us total) trans 21474840998 rc 0/0 00000100:00100000:1.0:1746065194.972937:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15124 00000100:00100000:1.0:1746065194.972946:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15125 00000100:00100000:1.0:1746065194.972950:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260448256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.973038:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3295:x1830881260448256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (401us total) trans 17179873706 rc 0/0 00000100:00100000:1.0:1746065194.973043:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15125 00000100:00100000:3.0:1746065194.974594:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15126 00000100:00100000:3.0:1746065194.974605:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3295:x1830881260448768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.974745:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881260448768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (2089us total) trans 21474840999 rc 0/0 00000100:00100000:3.0:1746065194.974750:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15126 00000004:00080000:1.0:1746065194.975236:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45c000/2, rc 0, transno 21474840997 00000100:00100000:1.0:1746065194.975247:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260447232:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065194.975257:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45df80/2, rc 0, transno 21474840998 00000100:00100000:1.0:1746065194.975260:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260447744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065194.975268:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094091500/2, rc 0, transno 17179873706 00000100:00100000:1.0:1746065194.975271:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260448256:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065194.975278:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45f800/2, rc 0, transno 21474840999 00000100:00100000:1.0:1746065194.975281:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260448768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.975299:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065194.975324:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260446848 00000100:00100000:1.0:1746065194.975329:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260446848 00000100:00100000:1.0:1746065194.975352:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15127 00000100:00100000:1.0:1746065194.975356:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3296:x1830881260446848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.975461:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3297:x1830881260446976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3450us (3614us total) trans 21474840995 rc 0/0 00000100:00100000:2.0:1746065194.975466:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15120 00000100:00100000:1.0:1746065194.975476:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3296:x1830881260446848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (176us total) trans 17179873707 rc 0/0 00000100:00100000:1.0:1746065194.975481:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15127 00000100:00100000:2.0:1746065194.975583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.975645:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.975663:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260447104 00000100:00100000:2.0:1746065194.975666:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260447104 00000100:00100000:2.0:1746065194.975681:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15128 00000100:00100000:2.0:1746065194.975686:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3298:x1830881260447104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.975791:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3298:x1830881260447104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (145us total) trans 17179873708 rc 0/0 00000100:00100000:2.0:1746065194.975796:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15128 00000004:00080000:0.0:1746065194.976960:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45ea00/2, rc 0, transno 21474840996 00000100:00100000:0.0:1746065194.976967:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260448000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.976975:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260448384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.977002:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065194.977028:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45d500/2, rc 0, transno 21474840995 00000100:00100000:0.0:1746065194.977031:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260446976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065194.977038:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45ca80/2, rc 0, transno 21474840994 00000100:00100000:0.0:1746065194.977041:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260447488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065194.977180:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263318912 00000100:00100000:3.0:1746065194.977184:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263318912 00000100:00100000:3.0:1746065194.977213:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10103 00000100:00100000:3.0:1746065194.977219:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32108:x1830881263318912:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065194.977234:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.977248:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618bc expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.977295:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.977307:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.977322:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065194.977325:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065194.977328:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66aa00, rc 0) 00000100:00100000:3.0:1746065194.977360:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32108:x1830881263318912:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 141us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.977365:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10103 00000100:00100000:2.0:1746065194.977472:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260448384 00000100:00100000:2.0:1746065194.977476:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260448384 00000004:00080000:1.0:1746065194.977521:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a90af800/2, rc 0, transno 17179873707 00000100:00100000:1.0:1746065194.977525:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a90af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260446848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.977531:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260447360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065194.977562:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065194.977569:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260448896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.977605:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.978805:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260448896 00000100:00100000:2.0:1746065194.978811:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260448896 00000100:00100000:1.0:1746065194.978812:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15129 00000100:00100000:1.0:1746065194.978836:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bf73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3297:x1830881260448384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.978843:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.978846:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15130 00000100:00100000:2.0:1746065194.978851:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3295:x1830881260448896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065194.978866:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260447872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.978880:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260447360 00000100:00100000:2.0:1746065194.978882:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260447360 00000100:00100000:0.0:1746065194.978883:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.978895:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260448512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.978896:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260447872 00000100:00100000:2.0:1746065194.978898:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260447872 00000100:00100000:0.0:1746065194.978907:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.978909:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15131 00000100:00100000:2.0:1746065194.978913:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3296:x1830881260447360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065194.978928:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260448512 00000100:00100000:0.0:1746065194.978930:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260448512 00000100:00100000:0.0:1746065194.978946:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15132 00000100:00100000:0.0:1746065194.978950:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3296:x1830881260447872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.978989:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bf73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3297:x1830881260448384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (1986us total) trans 21474841000 rc 0/0 00000100:00100000:1.0:1746065194.978994:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15129 00000100:00100000:1.0:1746065194.979005:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15133 00000100:00100000:1.0:1746065194.979009:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3296:x1830881260448512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065194.979023:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065194.979026:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065194.979028:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746065194.979029:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3296:x1830881260447360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (184us total) trans 17179873709 rc 0/0 00002000:00010000:0.0:1746065194.979029:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065194.979031:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065194.979035:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15131 00000100:00100000:0.0:1746065194.979048:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3296:x1830881260447872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (163us total) trans 17179873710 rc 0/0 00000100:00100000:0.0:1746065194.979053:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15132 00000004:00080000:2.0:1746065194.979063:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f468380/2, rc 0, transno 17179873708 00000100:00100000:2.0:1746065194.979067:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260447104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.979073:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260447616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065194.979074:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095351c00/2, rc 0, transno 17179873709 00000100:00100000:1.0:1746065194.979077:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3296:x1830881260448512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (168us total) trans 17179873711 rc 0/0 00000100:00100000:0.0:1746065194.979078:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260447360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.979081:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15133 00000004:00080000:0.0:1746065194.979085:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ec2d880/2, rc 0, transno 17179873710 00000100:00100000:0.0:1746065194.979087:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260447872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.979090:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065194.979092:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0ea00/2, rc 0, transno 17179873711 00000100:00100000:0.0:1746065194.979094:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260448512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065194.979105:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260448128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065194.979106:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260447616 00000004:00080000:0.0:1746065194.979108:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45c700/2, rc 0, transno 21474841000 00000100:00100000:1.0:1746065194.979109:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260447616 00000100:00100000:0.0:1746065194.979110:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260448384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.979118:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065194.983212:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260448640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065194.983260:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065194.983320:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260448128 00000100:00100000:3.0:1746065194.983328:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260448128 00000100:00100000:3.0:1746065194.983366:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15134 00000100:00100000:3.0:1746065194.983373:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3298:x1830881260447616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065194.983956:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065194.983960:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065194.983962:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065194.983964:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065194.983965:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065194.983993:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3298:x1830881260447616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 620us (4901us total) trans 17179873712 rc 0/0 00000100:00100000:3.0:1746065194.983998:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15134 00000100:00100000:3.0:1746065194.984012:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15135 00000100:00100000:3.0:1746065194.984017:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3298:x1830881260448128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065194.984081:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3298:x1830881260448128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (4961us total) trans 17179873713 rc 0/0 00000100:00100000:3.0:1746065194.984085:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15135 00000100:00100000:3.0:1746065194.984471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065194.984489:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319040 00000100:00100000:3.0:1746065194.984493:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319040 00000100:00100000:3.0:1746065194.984513:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10104 00000100:00100000:3.0:1746065194.984517:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32108:x1830881263319040:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065194.984527:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.984540:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ac00/0x14b4f8542d4fe6c2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618c3 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.984760:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00000100:00100000:0.0:1746065194.984808:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260448640 00000100:00100000:0.0:1746065194.984812:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260448640 00000100:00100000:0.0:1746065194.984843:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15136 00000100:00100000:0.0:1746065194.984847:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3298:x1830881260448640:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065194.984853:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb10e00/2, rc 0, transno 17179873712 00000100:00100000:2.0:1746065194.984859:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260447616:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065194.984866:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ec2c380/2, rc 0, transno 17179873713 00000100:00100000:2.0:1746065194.984869:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260448128:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065194.984949:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065194.984951:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065194.984953:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065194.984954:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065194.984956:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065194.984981:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3298:x1830881260448640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (1721us total) trans 21474841001 rc 0/0 00000100:00100000:0.0:1746065194.984990:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15136 00000004:00080000:2.0:1746065194.985166:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45e300/2, rc 0, transno 21474841001 00000100:00100000:2.0:1746065194.985171:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260448640:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065194.985362:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065194.985371:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065194.985392:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065194.985396:0:16767:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065194.985406:0:16767:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065194.985430:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ac00/0x14b4f8542d4fe6c2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 10 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.985442:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.985449:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065194.985451:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065194.985453:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66ae00, rc 0) 00000100:00100000:3.0:1746065194.985482:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32108:x1830881263319040:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 965us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.985487:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10104 00000100:00100000:1.0:1746065194.985564:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3295:x1830881260448896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6712us (7957us total) trans 21474841002 rc 0/0 00000100:00100000:1.0:1746065194.985570:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15130 00000004:00080000:0.0:1746065194.985839:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45f100/2, rc 0, transno 21474841002 00000100:00100000:0.0:1746065194.985844:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260448896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065194.991022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.991928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065194.991962:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319168 00000100:00100000:1.0:1746065194.991970:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319168 00000100:00100000:1.0:1746065194.992017:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319296 00000100:00100000:1.0:1746065194.992020:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319296 00000100:00100000:1.0:1746065194.992041:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15137 00000100:00100000:1.0:1746065194.992047:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263319168:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:3.0:1746065194.992052:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15138 00000100:00100000:3.0:1746065194.992060:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263319296:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065194.992061:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.992068:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065194.992076:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618ca expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.992078:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618d1 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065194.992097:0:2463:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x821 00002000:00010000:1.0:1746065194.992097:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x7b1 00010000:00010000:3.0:1746065194.992111:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.992113:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.992120:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.992133:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.992142:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66a800, rc 0) 00000100:00100000:3.0:1746065194.992182:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263319296:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 123us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.992189:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15138 00010000:00010000:1.0:1746065194.992218:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.992220:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065194.992225:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.992234:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 10 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065194.992241:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0087a00, rc 0) 00000100:00100000:1.0:1746065194.992261:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263319168:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 215us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065194.992265:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15137 00000100:00100000:0.0:1746065194.992856:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.992879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065194.992897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.992917:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319424 00000100:00100000:2.0:1746065194.992920:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319424 00000100:00100000:0.0:1746065194.992923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065194.992948:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319680 00000100:00100000:2.0:1746065194.992950:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319680 00000100:00100000:0.0:1746065194.993012:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319552 00000100:00100000:2.0:1746065194.993013:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263319808 00000100:00100000:2.0:1746065194.993015:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319808 00000100:00100000:0.0:1746065194.993016:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263319552 00000100:00100000:3.0:1746065194.993017:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15139 00000100:00100000:3.0:1746065194.993024:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263319424:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:2.0:1746065194.993029:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15140 00010000:00010000:3.0:1746065194.993031:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065194.993034:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263319680:12345-192.168.202.46@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065194.993035:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15141 00010000:00010000:3.0:1746065194.993040:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618d8 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065194.993040:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065194.993040:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263319808:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065194.993047:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618e6 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.993047:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746065194.993050:0:2463:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x821 00010000:00010000:0.0:1746065194.993055:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618ed expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065194.993059:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.993060:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.993064:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746065194.993065:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x1029 00002000:00010000:2.0:1746065194.993070:0:8427:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x1687 00010000:00010000:0.0:1746065194.993072:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.993074:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.993077:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.993078:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 13 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.993078:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.993079:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065194.993083:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.993085:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66b200, rc 0) 00010000:00010000:2.0:1746065194.993092:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 12 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065194.993092:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065194.993098:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec2ac00, rc 0) 00010000:00010000:0.0:1746065194.993099:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c756000, rc 0) 00000100:00100000:3.0:1746065194.993105:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263319424:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.993111:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15139 00000100:00100000:0.0:1746065194.993115:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263319808:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065194.993119:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263319680:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.993120:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15141 00000100:00100000:3.0:1746065194.993124:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15142 00000100:00100000:2.0:1746065194.993127:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15140 00000100:00100000:3.0:1746065194.993129:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263319552:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065194.993134:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065194.993142:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618df expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065194.993152:0:2463:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x81d 00010000:00010000:3.0:1746065194.993158:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.993160:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065194.993163:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.993171:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 12 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065194.993177:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66b400, rc 0) 00000100:00100000:3.0:1746065194.993193:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263319552:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 64us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065194.993201:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15142 00010000:00010000:2.0:1746065195.024153:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1746065195.188804:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873710 is committed 00000001:00080000:0.0:1746065195.188834:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873711 is committed 00000001:00080000:0.0:1746065195.188853:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873674 is committed 00000001:00080000:0.0:1746065195.188863:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873669 is committed 00000001:00080000:0.0:1746065195.188883:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873705 is committed 00000001:00080000:0.0:1746065195.188887:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873704 is committed 00000001:00080000:0.0:1746065195.188914:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873685 is committed 00000001:00080000:0.0:1746065195.188938:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873713 is committed 00000001:00080000:1.0:1746065195.200899:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841001 is committed 00000001:00080000:1.0:1746065195.200921:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840952 is committed 00000001:00080000:1.0:1746065195.200929:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841002 is committed 00000001:00080000:1.0:1746065195.200947:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840973 is committed 00000001:00080000:1.0:1746065195.200955:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840960 is committed 00000001:00080000:1.0:1746065195.200964:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840953 is committed 00000001:00080000:1.0:1746065195.200992:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840992 is committed 00000001:00080000:1.0:1746065195.201063:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840993 is committed 00000100:00100000:0.0:1746065196.016162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.016220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.016243:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263320064 00000100:00100000:3.0:1746065196.016253:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263320064 00000100:00100000:3.0:1746065196.016322:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263320320 00000100:00100000:3.0:1746065196.016325:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263320320 00000100:00100000:3.0:1746065196.016345:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8540 00000100:00100000:3.0:1746065196.016352:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263320064:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065196.016381:0:21483:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.016384:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8541 00000100:00100000:2.0:1746065196.016392:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263320320:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065196.016393:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.016394:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.016399:0:21483:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.016409:0:4012:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.016411:0:21483:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.016417:0:4012:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.016418:0:4012:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.016421:0:4012:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.016429:0:4012:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746065196.017160:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065196.017164:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065196.021068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.021225:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263320576 00000100:00100000:0.0:1746065196.021234:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263320576 00000100:00100000:0.0:1746065196.021293:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8542 00000100:00100000:0.0:1746065196.021300:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263320576:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065196.021327:0:8434:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.021339:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.021341:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.021346:0:8434:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.021356:0:8434:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.022422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.022461:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263320832 00000100:00100000:3.0:1746065196.022466:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263320832 00000100:00100000:3.0:1746065196.022490:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8543 00000100:00100000:3.0:1746065196.022496:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263320832:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065196.022515:0:21487:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.022524:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.022526:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.022529:0:21487:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.022539:0:21487:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.026124:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065196.031959:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.032002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.032064:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321088 00000100:00100000:1.0:1746065196.032073:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321088 00000100:00100000:1.0:1746065196.032137:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321344 00000100:00100000:1.0:1746065196.032140:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321344 00000100:00100000:1.0:1746065196.032161:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8544 00000100:00100000:1.0:1746065196.032168:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263321088:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065196.032205:0:8433:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.032221:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065196.032223:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065196.032229:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.032243:0:8433:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065196.032331:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8545 00000100:00100000:1.0:1746065196.032338:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263321344:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065196.032355:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.032363:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065196.032364:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065196.032367:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.032375:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065196.033321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.033360:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321728 00000100:00100000:0.0:1746065196.033365:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321728 00000100:00100000:0.0:1746065196.033401:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8546 00000100:00100000:1.0:1746065196.033407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.033408:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263321728:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065196.033424:0:21488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065196.033430:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321856 00010000:00010000:0.0:1746065196.033432:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.033433:0:21488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.033436:0:21488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.033443:0:21488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065196.034603:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321856 00000100:00100000:1.0:1746065196.034634:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8547 00000100:00100000:1.0:1746065196.034640:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:1961:x1830881263321856:12345-192.168.202.46@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065196.034657:0:21485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.034665:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065196.034667:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065196.034670:0:21485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.034679:0:21485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.055055:0:21483:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.055070:0:21483:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.055077:0:21483:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.055083:0:21483:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e0d800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065196.055087:0:21483:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.055094:0:21483:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.055114:0:21483:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.055120:0:21483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e0d800/0x14b4f8542d4fe6fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.055199:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1961:x1830881263320064:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 38843us (39041us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.055211:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8540 00010000:00010000:2.0:1746065196.065852:0:8434:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.065868:0:8434:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.065875:0:8434:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.065882:0:8434:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f66b600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065196.065886:0:8434:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.065892:0:8434:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.065909:0:8434:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.065915:0:8434:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f66b600/0x14b4f8542d4fe708 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.066009:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+15:1960:x1830881263320576:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 44705us (44945us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.066018:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8542 00010000:00010000:0.0:1746065196.067086:0:8433:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.067096:0:8433:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.067106:0:8433:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.067111:0:8433:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a565b600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065196.067114:0:8433:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.067120:0:8433:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.067132:0:8433:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.067138:0:8433:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a565b600/0x14b4f8542d4fe716 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065196.067176:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263321088:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 35007us (35224us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065196.067183:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8544 00010000:00010000:2.0:1746065196.067683:0:4012:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.067702:0:4012:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.067708:0:4012:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.067712:0:4012:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec2a000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065196.067715:0:4012:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.067720:0:4012:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.067730:0:4012:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.067735:0:4012:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec2a000/0x14b4f8542d4fe701 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.069516:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263320320:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 53116us (53287us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.069528:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8541 00010000:00010000:2.0:1746065196.074439:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.074455:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.074462:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.074468:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a565ac00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065196.074471:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.074477:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.074493:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.074503:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a565ac00/0x14b4f8542d4fe71d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.074578:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263321344:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 42237us (42571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.074585:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8545 00010000:00010000:2.0:1746065196.082223:0:21487:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.082242:0:21487:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.082249:0:21487:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.082256:0:21487:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b62f2600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065196.082260:0:21487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.082266:0:21487:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.082284:0:21487:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.082290:0:21487:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b62f2600/0x14b4f8542d4fe70f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.082374:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263320832:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 59872us (59948us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.082385:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8543 00010000:00010000:2.0:1746065196.088391:0:21488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.088406:0:21488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.088413:0:21488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.088419:0:21488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f66be00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065196.088423:0:21488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.088430:0:21488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.088444:0:21488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.088449:0:21488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fe724 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.088505:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263321728:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 55094us (55183us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.088514:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8546 00010000:00010000:2.0:1746065196.091533:0:21485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.091548:0:21485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.091555:0:21485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.091562:0:21485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a565be00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065196.091565:0:21485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.091571:0:21485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.091586:0:21485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.091591:0:21485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a565be00/0x14b4f8542d4fe72b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.092034:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263321856:12345-192.168.202.46@tcp:3:mirror_io.0 Request processed in 57389us (58671us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.092043:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8547 00000100:00100000:0.0:1746065196.097272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.097435:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263321984 00000100:00100000:2.0:1746065196.097444:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263321984 00000100:00100000:0.0:1746065196.097535:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 797 00000100:00100000:0.0:1746065196.097543:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32108:x1830881263321984:12345-192.168.202.46@tcp:103:mirror_io.0 00000100:00080000:1.0:1746065196.097550:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746065196.097555:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.097577:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdeea00/0x14b4f8542d4fe675 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ae expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.097600:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065196.097604:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.097638:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32108:x1830881263321984:12345-192.168.202.46@tcp:103:mirror_io.0 Request processed in 96us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.097643:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 797 00000100:00100000:0.0:1746065196.099200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.099301:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322240 00000100:00100000:3.0:1746065196.099308:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322240 00000100:00100000:3.0:1746065196.099341:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4359 00000100:00100000:3.0:1746065196.099347:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32108:x1830881263322240:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065196.099546:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32108:x1830881263322240:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 198us (349us total) trans 8589944389 rc 0/0 00000100:00100000:3.0:1746065196.099552:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4359 00000100:00100000:0.0:1746065196.102971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.103635:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322496 00000100:00100000:2.0:1746065196.103643:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322496 00000100:00100000:2.0:1746065196.103696:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4360 00000100:00100000:2.0:1746065196.103703:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32108:x1830881263322496:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065196.103896:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32108:x1830881263322496:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 194us (931us total) trans 8589944390 rc 0/0 00000100:00100000:2.0:1746065196.103902:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4360 00000100:00100000:0.0:1746065196.123091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.124449:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263322752 00000100:00100000:3.0:1746065196.124459:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263322752 00000100:00080000:1.0:1746065196.124518:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065196.124528:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10105 00000100:00100000:3.0:1746065196.124534:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:32119:x1830881263322752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.124556:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.124570:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4fe732 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618f4 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.124798:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.124810:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.124857:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.124869:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.124875:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.124887:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125140:0:16767:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125147:0:16767:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125153:0:16767:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16767 initiator: MDT0 00000004:00200000:3.0:1746065196.125160:0:16767:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065196.125228:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125233:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125238:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125243:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f89200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065196.125247:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125252:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125261:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065196.125264:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065196.125267:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125275:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125302:0:16767:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125307:0:16767:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125312:0:16767:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125316:0:16767:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f88400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065196.125318:0:16767:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125322:0:16767:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125328:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093f18600) 00010000:00010000:3.0:1746065196.125330:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065196.125332:0:16767:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125337:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe740 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16767 initiator: MDT0 00010000:00010000:3.0:1746065196.125367:0:16767:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89a00/0x14b4f8542d4fe732 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.125376:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 249 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.125391:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.125393:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065196.125395:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b0400, rc 0) 00000100:00100000:3.0:1746065196.125447:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32119:x1830881263322752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 912us (2364us total) trans 8589944391 rc 0/0 00000100:00100000:3.0:1746065196.125453:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10105 00000100:00100000:0.0:1746065196.133399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.133464:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323008 00000100:00100000:2.0:1746065196.133472:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323008 00000100:00100000:2.0:1746065196.133539:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10106 00000100:00100000:2.0:1746065196.133550:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:26bbd020-9fba-464a-bebc-8395a287959e+6:32118:x1830881263323008:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065196.133571:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.133588:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2b800/0x14b4f8542d4fe755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e618fb expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.133679:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.133699:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.133709:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.133722:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.133727:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.133736:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.133852:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.133859:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00000100:00080000:1.0:1746065196.134012:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065196.134160:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065196.134168:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065196.134236:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134242:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134247:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134252:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec2bc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065196.134255:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134260:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134268:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065196.134270:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065196.134273:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134281:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2bc00/0x14b4f8542d4fe75c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134695:0:24350:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134701:0:24350:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134705:0:24350:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134708:0:24350:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec2ae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065196.134710:0:24350:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134714:0:24350:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134720:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6fa00) 00010000:00010000:2.0:1746065196.134721:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065196.134723:0:24350:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134727:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe763 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.134761:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2b800/0x14b4f8542d4fe755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.134772:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.134781:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065196.134783:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065196.134785:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec2a200, rc 0) 00000100:00100000:2.0:1746065196.135620:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:26bbd020-9fba-464a-bebc-8395a287959e+8:32118:x1830881263323008:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2071us (2225us total) trans 8589944392 rc 0/0 00000100:00100000:2.0:1746065196.135628:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10106 00000100:00100000:0.0:1746065196.135777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.136779:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323136 00000100:00100000:3.0:1746065196.136787:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323136 00000100:00100000:3.0:1746065196.136846:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15143 00000100:00100000:3.0:1746065196.136852:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+10:1958:x1830881263323136:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.136864:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.136877:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61902 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.136895:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.136897:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.136904:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 11 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.136915:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 11 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.136924:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f88400, rc 0) 00000100:00100000:3.0:1746065196.136957:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+11:1958:x1830881263323136:12345-192.168.202.46@tcp:101:cat.0 Request processed in 105us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.136962:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15143 00000100:00080000:1.0:1746065196.137202:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065196.137963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.138221:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323520 00000100:00100000:3.0:1746065196.138225:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323520 00000100:00100000:3.0:1746065196.138247:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10107 00000100:00100000:3.0:1746065196.138252:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32115:x1830881263323520:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065196.138264:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.138274:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe77f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61910 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.138338:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065196.138348:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.138354:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.138359:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.138364:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065196.138388:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 7 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.138399:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 7 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.138410:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260449024:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.138483:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 250 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.138491:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 250 pid: 16767 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.138498:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260449152:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.138526:0:24350:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.138533:0:24350:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 9 pid: 16767 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.138539:0:24350:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260449280:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065196.138553:0:24350:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.138761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.138807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.138969:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323264 00000100:00100000:2.0:1746065196.138973:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323264 00000100:00100000:2.0:1746065196.138995:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323648 00000100:00100000:2.0:1746065196.138997:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323648 00000100:00080000:1.0:1746065196.139167:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065196.139228:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15144 00000100:00100000:2.0:1746065196.139234:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263323264:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.139243:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.139255:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61909 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.139267:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.139269:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.139274:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.139284:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 20 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.139297:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66be00, rc 0) 00000100:00100000:3.0:1746065196.140383:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15145 00000100:00100000:3.0:1746065196.140392:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263323648:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065196.140448:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263323264:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1213us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.140454:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15144 00000100:00100000:2.0:1746065196.140678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.140762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.140785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.140798:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323776 00000100:00100000:2.0:1746065196.140803:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323776 00000100:00100000:2.0:1746065196.140835:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263323904 00000100:00100000:2.0:1746065196.140836:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263323904 00000100:00100000:2.0:1746065196.140845:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324032 00000100:00100000:2.0:1746065196.140846:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324032 00000100:00100000:2.0:1746065196.140856:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15146 00000100:00100000:2.0:1746065196.140860:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+12:1959:x1830881263323776:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.140868:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.140879:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6191e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.140891:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.140893:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.140898:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.140910:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.140921:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec2ae00, rc 0) 00010000:00010000:3.0:1746065196.140955:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.140965:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61917 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.140975:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.140976:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.140980:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 21 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.140988:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 21 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.140994:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8800, rc 0) 00000100:00100000:3.0:1746065196.141066:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263323648:12345-192.168.202.46@tcp:101:cat.0 Request processed in 677us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.141072:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15145 00000100:00100000:3.0:1746065196.141083:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15147 00000100:00100000:3.0:1746065196.141088:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1959:x1830881263323904:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.141093:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.141099:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61925 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.141108:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.141109:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.141112:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 14 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.141120:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 14 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.141126:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8c00, rc 0) 00000100:00100000:3.0:1746065196.141137:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1959:x1830881263323904:12345-192.168.202.46@tcp:101:cat.0 Request processed in 50us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.141142:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15147 00000100:00100000:3.0:1746065196.141150:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15148 00000100:00100000:3.0:1746065196.141154:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263324032:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.141161:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.141166:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6192c expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.141174:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.141175:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.141178:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 21 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.141185:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 21 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.141190:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9800, rc 0) 00000100:00100000:3.0:1746065196.141200:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263324032:12345-192.168.202.46@tcp:101:cat.0 Request processed in 47us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.141205:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15148 00000100:00100000:2.0:1746065196.146077:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1959:x1830881263323776:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5205us (5388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.146087:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15146 00000100:00100000:2.0:1746065196.147920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.148440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.148461:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324544 00000100:00100000:2.0:1746065196.148468:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324544 00010000:00010000:2.0:1746065196.148497:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 251 pid: 16767 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.148517:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7796 00000100:00100000:2.0:1746065196.148523:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881263324544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065196.148533:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065196.148537:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 251 pid: 16767 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.148546:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 251 pid: 16767 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.148564:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065196.148567:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.148573:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.148582:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065196.148608:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881263324544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.148613:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7796 00000100:00100000:2.0:1746065196.148637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.148645:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324416 00000100:00100000:2.0:1746065196.148648:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324416 00010000:00010000:2.0:1746065196.148655:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 8 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.148665:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7797 00000100:00100000:2.0:1746065196.148669:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263324416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065196.148673:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065196.148676:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 8 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.148682:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 8 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.148700:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065196.148703:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.148707:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.148710:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065196.148721:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263324416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.148725:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7797 00000100:00100000:2.0:1746065196.148758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.148766:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324672 00000100:00100000:2.0:1746065196.148768:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324672 00010000:00010000:2.0:1746065196.148777:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 10 pid: 16767 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.148787:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7798 00000100:00100000:2.0:1746065196.148790:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263324672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065196.148795:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065196.148797:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 10 pid: 16767 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.148804:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 10 pid: 16767 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.148812:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065196.148830:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.148835:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.148841:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.148853:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065196.148864:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263324672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 73us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.148871:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7798 00010000:00010000:3.0:1746065196.148975:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec2a200/0x14b4f8542d4fe76a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618fb expref: 7 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.148990:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260449024:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.149000:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4fe747 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618f4 expref: 250 pid: 16767 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.149007:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260449152:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.149013:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4fe6c9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618c3 expref: 9 pid: 16767 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.149023:0:24350:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:24350:1830881260449280:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.149044:0:24350:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065196.149052:0:24350:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065196.149056:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065196.149070:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065196.149176:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f89200/0x14b4f8542d4fe77f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 251 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.149185:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.149190:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.149192:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065196.149194:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f88800, rc 0) 00000100:00100000:3.0:1746065196.149211:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32115:x1830881263323520:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10959us (11250us total) trans 8589944393 rc 0/0 00000100:00100000:3.0:1746065196.149215:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10107 00000100:00100000:3.0:1746065196.149225:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324288 00000100:00100000:3.0:1746065196.149227:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324288 00000100:00100000:3.0:1746065196.149242:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10108 00000100:00100000:3.0:1746065196.149246:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:26bbd020-9fba-464a-bebc-8395a287959e+7:32121:x1830881263324288:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.149260:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.149267:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61933 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.149310:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065196.149316:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:3.0:1746065196.149322:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:3.0:1746065196.149326:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065196.149359:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 10 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.149367:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.149371:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.149373:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065196.149375:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9c00, rc 0) 00000100:00100000:3.0:1746065196.149387:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:32121:x1830881263324288:12345-192.168.202.46@tcp:101:cat.0 Request processed in 141us (1472us total) trans 8589944394 rc 0/0 00000100:00100000:3.0:1746065196.149391:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10108 00000100:00100000:2.0:1746065196.154138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.154209:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324800 00000100:00100000:0.0:1746065196.154217:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324800 00000100:00100000:0.0:1746065196.154261:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10109 00000100:00100000:0.0:1746065196.154267:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:32121:x1830881263324800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065196.154289:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.154305:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fe7cc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6193a expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.154365:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.154375:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.154380:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.154402:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 249 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.154412:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 249 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065196.154422:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260449408:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065196.158739:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065196.160366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.160502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.160590:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325056 00000100:00100000:3.0:1746065196.160597:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325056 00010000:00010000:3.0:1746065196.160628:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 250 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.160658:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7799 00000100:00100000:3.0:1746065196.160665:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1961:x1830881263325056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065196.160676:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.160681:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 250 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.160705:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 250 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.160725:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.160728:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.160736:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.160742:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.160758:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.160798:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1961:x1830881263325056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 134us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.160804:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7799 00010000:00010000:0.0:1746065196.161153:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f88800/0x14b4f8542d4fe786 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61910 expref: 249 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065196.161174:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fcafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260449408:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065196.161194:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.161202:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.161207:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065196.161267:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:0.0:1746065196.161272:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065196.161292:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.161331:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12e00/0x14b4f8542d4fe7cc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.161347:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.161359:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065196.161363:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065196.161365:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe12200, rc 0) 00000100:00100000:0.0:1746065196.161397:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:32121:x1830881263324800:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7130us (7267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.161404:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10109 00000100:00100000:0.0:1746065196.161433:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263324928 00000100:00100000:0.0:1746065196.161436:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263324928 00000100:00100000:0.0:1746065196.162566:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10110 00000100:00100000:0.0:1746065196.162577:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32119:x1830881263324928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065196.162599:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.162614:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4fe7da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61941 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.162659:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4fe7da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61941 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.162670:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4fe7da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61941 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.162697:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065196.162700:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065196.162702:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe12600, rc 0) 00000100:00100000:0.0:1746065196.164489:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32119:x1830881263324928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1905us (4122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.164499:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10110 00000100:00100000:3.0:1746065196.164644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.164759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.164782:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325184 00000100:00100000:3.0:1746065196.164788:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325184 00000100:00100000:3.0:1746065196.164839:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325312 00000100:00100000:3.0:1746065196.164842:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325312 00000100:00100000:3.0:1746065196.164858:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15149 00000100:00100000:3.0:1746065196.164862:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+6:1961:x1830881263325184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.164875:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.164888:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61948 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.164906:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.164908:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.164915:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.164928:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.164937:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8a00, rc 0) 00000100:00100000:3.0:1746065196.165711:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:1961:x1830881263325184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 846us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.165716:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15149 00000100:00100000:3.0:1746065196.165728:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15150 00000100:00100000:3.0:1746065196.165733:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+5:1960:x1830881263325312:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.165742:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.165753:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6194f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.165764:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.165765:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.165770:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.165780:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.166026:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8400, rc 0) 00000100:00100000:3.0:1746065196.166043:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+6:1960:x1830881263325312:12345-192.168.202.46@tcp:101:cat.0 Request processed in 310us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.166047:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15150 00000100:00100000:3.0:1746065196.166079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.166490:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.166605:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325440 00000100:00100000:0.0:1746065196.166611:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325440 00000100:00100000:0.0:1746065196.166631:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325568 00000100:00100000:0.0:1746065196.166633:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325568 00000100:00100000:0.0:1746065196.166653:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15151 00000100:00100000:0.0:1746065196.166657:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+6:1961:x1830881263325440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065196.166664:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.166671:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61956 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.166682:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.166683:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.166696:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.166706:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.166713:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe13c00, rc 0) 00000100:00100000:0.0:1746065196.166731:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:1961:x1830881263325440:12345-192.168.202.46@tcp:101:cat.0 Request processed in 74us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.166735:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15151 00000100:00100000:0.0:1746065196.166749:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15152 00000100:00100000:0.0:1746065196.166753:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263325568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065196.166758:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.166766:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6195d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.166780:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.166781:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.166785:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.166793:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.166799:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe13000, rc 0) 00000100:00100000:0.0:1746065196.166810:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263325568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.166833:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15152 00000100:00080000:0.0:1746065196.166848:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065196.166852:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065196.166905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.166943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.167063:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325696 00000100:00100000:3.0:1746065196.167066:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325696 00000100:00100000:3.0:1746065196.167083:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263325824 00000100:00100000:3.0:1746065196.167084:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263325824 00000100:00100000:3.0:1746065196.167094:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15153 00000100:00100000:3.0:1746065196.167098:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263325696:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.167103:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.167110:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61964 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.167120:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.167121:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.167126:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.167135:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.167148:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9a00, rc 0) 00000100:00100000:3.0:1746065196.167162:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263325696:12345-192.168.202.46@tcp:101:cat.0 Request processed in 64us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.167166:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15153 00000100:00100000:3.0:1746065196.167174:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15154 00000100:00100000:3.0:1746065196.167178:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263325824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.167183:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.167189:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6196b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.167198:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.167199:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.167202:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.167210:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.167216:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9400, rc 0) 00000100:00100000:3.0:1746065196.167225:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263325824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 48us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.167230:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15154 00000100:00100000:0.0:1746065196.186174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.186245:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326080 00000100:00100000:2.0:1746065196.186253:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326080 00002000:00100000:2.0:1746065196.186288:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009fcafb80 x1830881263326080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.186296:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcafb80 with x1830881263326080 ext(0->1048575) 00002000:00010000:2.0:1746065196.186301:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fcafb80 00000100:00100000:2.0:1746065196.186316:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8548 00000100:00100000:2.0:1746065196.186321:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1958:x1830881263326080:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.213019:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.213103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.213127:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326336 00000100:00100000:0.0:1746065196.213134:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326336 00002000:00100000:0.0:1746065196.213170:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fcaed80 x1830881263326336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.213179:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaed80 with x1830881263326336 ext(1048576->2097151) 00002000:00010000:0.0:1746065196.213184:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcaed80 00000100:00100000:0.0:1746065196.213197:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326592 00000100:00100000:0.0:1746065196.213199:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326592 00002000:00100000:0.0:1746065196.213206:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009fcac380 x1830881263326592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.213218:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcac380 with x1830881263326592 ext(1048576->2097151) 00002000:00010000:0.0:1746065196.213221:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcac380 00000100:00100000:0.0:1746065196.213230:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8549 00000100:00100000:0.0:1746065196.213236:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263326336:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.214510:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8550 00000100:00100000:0.0:1746065196.214518:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263326592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065196.216389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.217178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.217195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.217216:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263326848 00000100:00100000:1.0:1746065196.217223:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263326848 00002000:00100000:1.0:1746065196.217259:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012b623800 x1830881263326848/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.217269:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b623800 with x1830881263326848 ext(1048576->2097151) 00002000:00010000:1.0:1746065196.217274:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b623800 00000100:00100000:1.0:1746065196.217305:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327104 00000100:00100000:1.0:1746065196.217307:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327104 00002000:00100000:1.0:1746065196.217316:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012b623b80 x1830881263327104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.217323:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b623b80 with x1830881263327104 ext(0->1048575) 00002000:00010000:1.0:1746065196.217325:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b623b80 00000100:00100000:1.0:1746065196.217332:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327360 00000100:00100000:1.0:1746065196.217334:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327360 00002000:00100000:1.0:1746065196.217342:0:8434:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012b621880 x1830881263327360/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.217347:0:8434:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b621880 with x1830881263327360 ext(1048576->2097151) 00002000:00010000:1.0:1746065196.217349:0:8434:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b621880 00000100:00100000:2.0:1746065196.219123:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8551 00000100:00100000:2.0:1746065196.219135:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881263326848:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065196.219513:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8552 00000100:00100000:3.0:1746065196.219522:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263327104:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065196.220449:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8553 00000100:00100000:2.0:1746065196.220456:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263327360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065196.220632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.221312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.221329:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327616 00000100:00100000:3.0:1746065196.221336:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327616 00002000:00100000:3.0:1746065196.221363:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009380f480 x1830881263327616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.221373:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380f480 with x1830881263327616 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.221378:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009380f480 00000100:00100000:3.0:1746065196.221391:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263327872 00000100:00100000:3.0:1746065196.221392:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263327872 00002000:00100000:3.0:1746065196.221401:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009380df80 x1830881263327872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.221407:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380df80 with x1830881263327872 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.221410:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380df80 00000100:00100000:3.0:1746065196.221419:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8554 00000100:00100000:3.0:1746065196.221423:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263327616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065196.221889:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881263326080:12345-192.168.202.46@tcp:3:cat.0 Request processed in 35566us (35721us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.221896:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8548 00002000:00100000:2.0:1746065196.221901:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009fcafb80 x1830881263326080/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.221907:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcafb80 with x1830881263326080 ext(0->1048575) 00002000:00010000:2.0:1746065196.221910:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fcafb80 00000100:00100000:2.0:1746065196.221924:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8555 00000100:00100000:2.0:1746065196.221929:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263327872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065196.226248:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263326336:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13002us (13228us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065196.226258:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8549 00002000:00100000:1.0:1746065196.226269:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fcaed80 x1830881263326336/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.226277:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaed80 with x1830881263326336 ext(1048576->2097151) 00002000:00010000:1.0:1746065196.226282:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcaed80 00000100:00100000:2.0:1746065196.255586:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1958:x1830881263326848:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36447us (39197us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.255596:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8551 00002000:00100000:2.0:1746065196.255605:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012b623800 x1830881263326848/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.255613:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b623800 with x1830881263326848 ext(1048576->2097151) 00002000:00010000:2.0:1746065196.255618:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b623800 00000100:00100000:3.0:1746065196.264908:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263327104:12345-192.168.202.46@tcp:3:cat.0 Request processed in 45380us (47723us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.264917:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8552 00002000:00100000:3.0:1746065196.264926:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012b623b80 x1830881263327104/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.264932:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b623b80 with x1830881263327104 ext(0->1048575) 00002000:00010000:3.0:1746065196.264935:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b623b80 00000100:00100000:2.0:1746065196.269639:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263327360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 49175us (52435us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.269650:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8553 00002000:00100000:2.0:1746065196.269659:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012b621880 x1830881263327360/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.269668:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b621880 with x1830881263327360 ext(1048576->2097151) 00002000:00010000:2.0:1746065196.269673:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b621880 00000100:00100000:0.0:1746065196.280947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.281355:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328128 00000100:00100000:2.0:1746065196.281363:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328128 00000100:00100000:2.0:1746065196.281411:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10111 00000100:00100000:2.0:1746065196.281418:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32115:x1830881263328128:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065196.281435:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.281438:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065196.281460:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12600/0x14b4f8542d4fe7da lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61941 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.282168:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263327872:12345-192.168.202.46@tcp:3:cat.0 Request processed in 60236us (60854us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.282178:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8555 00002000:00100000:3.0:1746065196.282186:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009380df80 x1830881263327872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.282194:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380df80 with x1830881263327872 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.282197:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009380df80 00010000:00010000:2.0:1746065196.282475:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065196.282480:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065196.282492:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c394400/0x14b4f8542d4fe80b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61972 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.282528:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065196.282538:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.282545:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.282552:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.282557:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065196.282578:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.282588:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 9 pid: 14644 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.282598:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260449536:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.282650:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 9 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.282657:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 9 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.282663:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260449664:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.282680:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 8 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.282696:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 8 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.282703:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260449792:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.282717:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009436e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.295445:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263326592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 80919us (82332us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.295455:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8550 00002000:00100000:2.0:1746065196.295466:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009fcac380 x1830881263326592/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.295475:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcac380 with x1830881263326592 ext(1048576->2097151) 00002000:00010000:2.0:1746065196.295480:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcac380 00000100:00100000:0.0:1746065196.303390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.303419:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260449536:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065196.303425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.303428:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260449664:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.303457:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328256 00000100:00100000:0.0:1746065196.303461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.303462:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328256 00000100:00100000:1.0:1746065196.303514:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328384 00000100:00100000:1.0:1746065196.303518:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328384 00010000:00010000:1.0:1746065196.303540:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 11 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:1.0:1746065196.303559:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328512 00000100:00100000:1.0:1746065196.303561:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328512 00010000:00010000:1.0:1746065196.303569:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 9 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065196.303570:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7800 00000100:00100000:0.0:1746065196.303578:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263328384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065196.303582:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7801 00000100:00100000:1.0:1746065196.303586:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263328512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.303590:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065196.303592:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065196.303596:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 9 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065196.303596:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 11 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746065196.303603:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 9 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065196.303617:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 11 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065196.303635:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe7be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61933 expref: 11 pid: 24350 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065196.303650:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065196.303655:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.303662:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.303668:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065196.303703:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 10 pid: 14644 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065196.303711:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263328384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 134us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.303717:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7800 00000100:00100000:2.0:1746065196.303720:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7802 00000100:00100000:2.0:1746065196.303726:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263328256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065196.303733:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065196.303736:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 9 pid: 14644 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.303743:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 9 pid: 14644 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746065196.303770:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065196.303773:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065196.303778:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065196.303784:0:15963:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065196.303796:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065196.303882:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe12200/0x14b4f8542d4fe7d3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6193a expref: 9 pid: 14644 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.303896:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065196.303898:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065196.303942:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263328512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 355us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065196.303951:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7801 00000100:00100000:2.0:1746065196.304069:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263328256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 342us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.304075:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7802 00000100:00100000:3.0:1746065196.304126:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263327616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 82701us (83493us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746065196.304132:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66aa00/0x14b4f8542d4fe6bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618bc expref: 8 pid: 24350 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.304134:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8554 00000100:00100000:2.0:1746065196.304141:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260449792:192.168.202.46@tcp:104: 00002000:00100000:3.0:1746065196.304142:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009380f480 x1830881263327616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.304150:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009380f480 with x1830881263327616 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.304153:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009380f480 00010000:00010000:2.0:1746065196.304155:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065196.304162:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065196.304166:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000040:00080000:2.0:1746065196.304786:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3147, 88 off266368 00000004:00080000:2.0:1746065196.304794:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795595977844ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304852:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3166, 88 off268216 00000004:00080000:2.0:1746065196.304857:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795596041425ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065196.304881:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3167, 88 off268304 00000004:00080000:2.0:1746065196.304884:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795596068619ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065196.304891:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3148, 88 off266456 00000004:00080000:2.0:1746065196.304894:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795596078315ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304899:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3149, 88 off266544 00000004:00080000:2.0:1746065196.304902:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795596086430ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304908:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3168, 88 off268392 00000004:00080000:2.0:1746065196.304910:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795596094515ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065196.304915:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3169, 88 off268480 00000004:00080000:2.0:1746065196.304918:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795596102295ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065196.304923:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3170, 88 off268568 00000004:00080000:2.0:1746065196.304926:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795596110585ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065196.304932:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3150, 88 off266632 00000004:00080000:2.0:1746065196.304934:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795596118963ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304939:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3171, 88 off268656 00000004:00080000:2.0:1746065196.304941:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795596126183ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065196.304947:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3151, 88 off266720 00000004:00080000:2.0:1746065196.304949:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795596133702ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304954:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3172, 88 off268744 00000004:00080000:2.0:1746065196.304956:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795596140987ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065196.304961:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3152, 88 off266808 00000004:00080000:2.0:1746065196.304963:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795596148117ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304969:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3153, 88 off266896 00000004:00080000:2.0:1746065196.304971:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795596155832ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304976:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3154, 88 off266984 00000004:00080000:2.0:1746065196.304978:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795596162940ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304984:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3155, 88 off267072 00000004:00080000:2.0:1746065196.304986:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795596171055ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065196.304992:0:14644:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3173, 88 off268832 00000004:00080000:2.0:1746065196.304994:0:14644:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 795596178865ns, next at 737095943431ns, rc = 0 00000100:00100000:0.0:1746065196.307377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.307398:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328640 00000100:00100000:0.0:1746065196.307404:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328640 00000100:00100000:0.0:1746065196.307435:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10112 00000100:00100000:0.0:1746065196.307442:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32119:x1830881263328640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065196.307457:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.307470:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61979 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.307512:0:24350:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.307519:0:24350:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.307533:0:24350:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.307543:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.307554:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065196.307557:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065196.307560:0:24350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 253 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.307566:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd200, rc 0) 00000100:00100000:0.0:1746065196.307598:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32119:x1830881263328640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 156us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.307604:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10112 00000100:00100000:2.0:1746065196.312485:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.312960:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328768 00000100:00100000:0.0:1746065196.312968:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328768 00000100:00100000:0.0:1746065196.313003:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10113 00000100:00100000:0.0:1746065196.313010:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:32121:x1830881263328768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065196.313024:0:16767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.313038:0:16767:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61980 expref: -99 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.313084:0:16767:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.313093:0:16767:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 9 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.313104:0:16767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065196.313106:0:16767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065196.313109:0:16767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 252 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.313115:0:16767:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdfd600, rc 0) 00000100:00100000:0.0:1746065196.313153:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:32121:x1830881263328768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 143us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.313158:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10113 00000001:00080000:0.0:1746065196.338009:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944395 is committed 00000004:00080000:0.0:1746065196.338018:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2454 committed 00000004:00080000:0.0:1746065196.338025:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2435 committed 00000004:00080000:0.0:1746065196.338030:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2434 committed 00000004:00080000:0.0:1746065196.338031:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2433 committed 00000004:00080000:0.0:1746065196.338032:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2432 committed 00000004:00080000:0.0:1746065196.338033:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2453 committed 00000004:00080000:0.0:1746065196.338035:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2431 committed 00000004:00080000:0.0:1746065196.338036:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2452 committed 00000004:00080000:0.0:1746065196.338038:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2430 committed 00000004:00080000:0.0:1746065196.338039:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2451 committed 00000004:00080000:0.0:1746065196.338041:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2450 committed 00000004:00080000:0.0:1746065196.338046:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2449 committed 00000004:00080000:0.0:1746065196.338047:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2429 committed 00000004:00080000:0.0:1746065196.338049:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2428 committed 00000004:00080000:0.0:1746065196.338050:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2448 committed 00000004:00080000:0.0:1746065196.338051:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2447 committed 00000004:00080000:0.0:1746065196.338053:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2427 committed 00000001:00080000:0.0:1746065196.338058:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944392 is committed 00000001:00080000:0.0:1746065196.338062:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944390 is committed 00000001:00080000:0.0:1746065196.338066:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944394 is committed 00000100:00100000:0.0:1746065196.338175:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260449920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065196.338225:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.338261:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260450432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065196.338275:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.338290:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065196.338294:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260450048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065196.338307:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.338316:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260450560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065196.338327:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.338343:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260450176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065196.338356:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.338365:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260450688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065196.338375:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065196.338525:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260451072:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065196.338706:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.338718:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.338720:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065196.338724:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.338732:0:14644:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.338737:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.338747:0:14644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 6 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.338752:0:14644:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 6 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.338757:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 6 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.338777:0:14644:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 6 pid: 16767 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.338785:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260451968:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065196.338855:0:14644:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 250 pid: 24350 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.338863:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260452096:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065196.338881:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.340480:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260449920 00000100:00100000:2.0:1746065196.340489:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260449920 00000100:00100000:0.0:1746065196.340498:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260451200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065196.340527:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260450432 00000100:00100000:2.0:1746065196.340529:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260450432 00000100:00100000:0.0:1746065196.340529:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.340556:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260451712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065196.340571:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065196.341430:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260450048 00000100:00100000:2.0:1746065196.341435:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260450048 00000100:00100000:0.0:1746065196.341444:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746065196.341451:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260450304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065196.341461:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260450560 00000100:00100000:3.0:1746065196.341464:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260450560 00000100:00100000:0.0:1746065196.341469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.341481:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260450816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065196.341491:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.341499:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260451328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065196.341513:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260450176 00000100:00100000:1.0:1746065196.341517:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260450176 00000100:00100000:0.0:1746065196.341518:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.341527:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260451840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065196.341530:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260450688 00000100:00100000:1.0:1746065196.341533:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260450688 00000100:00100000:1.0:1746065196.341539:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260451200 00000100:00100000:0.0:1746065196.341539:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065196.341540:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260451200 00000100:00100000:1.0:1746065196.341550:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260451712 00000100:00100000:1.0:1746065196.341552:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260451712 00000100:00100000:1.0:1746065196.341557:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260450304 00000100:00100000:1.0:1746065196.341559:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260450304 00000100:00100000:0.0:1746065196.341562:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260450816 00000100:00100000:1.0:1746065196.341564:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260451328 00000100:00100000:0.0:1746065196.341565:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260450816 00000100:00100000:1.0:1746065196.341566:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260451328 00000100:00100000:1.0:1746065196.341572:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260451840 00000100:00100000:1.0:1746065196.341573:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260451840 00000100:00100000:0.0:1746065196.341580:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15155 00000100:00100000:0.0:1746065196.341587:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3297:x1830881260449920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065196.341855:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065196.341858:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:0.0:1746065196.341860:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:0.0:1746065196.341862:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:0.0:1746065196.341863:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065196.341888:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260449920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 301us (3663us total) trans 17179873714 rc 0/0 00000100:00100000:1.0:1746065196.342459:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15156 00000100:00100000:1.0:1746065196.342466:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260450432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065196.342543:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065196.342545:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.342547:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.342548:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.342550:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065196.342574:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881260450432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (4297us total) trans 17179873715 rc 0/0 00000100:00100000:1.0:1746065196.342580:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15156 00000100:00100000:1.0:1746065196.342592:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15157 00000100:00100000:1.0:1746065196.342596:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260450048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065196.342675:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065196.342678:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.342680:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.342681:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.342683:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746065196.342712:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881260450048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (4404us total) trans 17179873716 rc 0/0 00000100:00100000:1.0:1746065196.342717:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15157 00000100:00100000:1.0:1746065196.342726:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15158 00000100:00100000:1.0:1746065196.342729:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260450560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065196.342793:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881260450560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (4465us total) trans 17179873717 rc 0/0 00000100:00100000:1.0:1746065196.342798:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15158 00000100:00100000:1.0:1746065196.342806:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15159 00000100:00100000:1.0:1746065196.342809:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260450176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065196.342890:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065196.342892:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.342894:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.342896:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.342897:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065196.342917:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881260450176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (4561us total) trans 17179873718 rc 0/0 00000100:00100000:1.0:1746065196.342921:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15159 00000100:00100000:1.0:1746065196.342930:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15160 00000100:00100000:1.0:1746065196.342933:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260450688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065196.342990:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881260450688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (4614us total) trans 17179873719 rc 0/0 00000100:00100000:1.0:1746065196.342995:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15160 00000100:00100000:1.0:1746065196.343002:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15161 00000100:00100000:1.0:1746065196.343005:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881260451200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065196.343128:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:1.0:1746065196.343130:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.343132:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.343133:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:1.0:1746065196.343135:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5767 -> 5769 00000100:00100000:1.0:1746065196.343153:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260451200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (2623us total) trans 21474841003 rc 0/0 00000100:00100000:1.0:1746065196.343157:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15161 00000100:00100000:1.0:1746065196.343166:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15162 00000100:00100000:1.0:1746065196.343170:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881260451712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065196.343236:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343237:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343239:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343240:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343242:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065196.343260:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260451712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (2687us total) trans 21474841004 rc 0/0 00000100:00100000:1.0:1746065196.343264:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15162 00000100:00100000:1.0:1746065196.343272:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15163 00000100:00100000:1.0:1746065196.343276:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260450304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065196.343337:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343339:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065196.343341:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065196.343342:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065196.343344:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065196.343360:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881260450304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1890us total) trans 17179873720 rc 0/0 00000100:00100000:1.0:1746065196.343365:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15163 00000100:00100000:1.0:1746065196.343374:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15164 00000100:00100000:1.0:1746065196.343377:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881260451328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065196.343437:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343439:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343441:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343442:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065196.343443:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065196.343460:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260451328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (1941us total) trans 21474841005 rc 0/0 00000100:00100000:1.0:1746065196.343464:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15164 00000100:00100000:1.0:1746065196.343473:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15165 00000100:00100000:1.0:1746065196.343477:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260450816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065196.343549:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1830881260450816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (2055us total) trans 17179873721 rc 0/0 00000100:00100000:1.0:1746065196.343554:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15165 00000100:00100000:1.0:1746065196.343568:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15166 00000100:00100000:1.0:1746065196.343572:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1830881260451840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065196.343641:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260451840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (2100us total) trans 21474841006 rc 0/0 00000100:00100000:1.0:1746065196.343646:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15166 00000100:00100000:1.0:1746065196.343677:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873713 gen 2 00000004:00080000:1.0:1746065196.343681:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f146d80, transno 17179873644 00000004:00080000:1.0:1746065196.343699:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f146300, transno 17179873645 00000004:00080000:1.0:1746065196.343701:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f145c00, transno 17179873646 00000004:00080000:1.0:1746065196.343703:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f146680, transno 17179873647 00000004:00080000:1.0:1746065196.343704:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f145500, transno 17179873648 00000004:00080000:1.0:1746065196.343706:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f146a00, transno 17179873649 00000004:00080000:1.0:1746065196.343707:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f145f80, transno 17179873650 00000004:00080000:1.0:1746065196.343709:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f145880, transno 17179873651 00000004:00080000:1.0:1746065196.343711:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee1180, transno 17179873652 00000004:00080000:1.0:1746065196.343713:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee0e00, transno 17179873653 00000004:00080000:1.0:1746065196.343715:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee3480, transno 17179873654 00000004:00080000:1.0:1746065196.343716:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee2a00, transno 17179873655 00000004:00080000:1.0:1746065196.343718:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee0000, transno 17179873656 00000004:00080000:1.0:1746065196.343720:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee3100, transno 17179873657 00000004:00080000:1.0:1746065196.343722:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee1880, transno 17179873658 00000004:00080000:1.0:1746065196.343724:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee0a80, transno 17179873659 00000004:00080000:1.0:1746065196.343726:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095352300, transno 17179873675 00000004:00080000:1.0:1746065196.343728:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff4a80, transno 17179873676 00000004:00080000:1.0:1746065196.343730:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095350a80, transno 17179873677 00000004:00080000:1.0:1746065196.343732:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff7b80, transno 17179873678 00000004:00080000:1.0:1746065196.343734:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff5f80, transno 17179873679 00000004:00080000:1.0:1746065196.343736:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff4700, transno 17179873680 00000004:00080000:1.0:1746065196.343738:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff5880, transno 17179873681 00000004:00080000:1.0:1746065196.343740:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff6a00, transno 17179873682 00000004:00080000:1.0:1746065196.343742:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf70380, transno 17179873686 00000004:00080000:1.0:1746065196.343744:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf71180, transno 17179873687 00000004:00080000:1.0:1746065196.343745:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf70700, transno 17179873688 00000004:00080000:1.0:1746065196.343747:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf71500, transno 17179873689 00000004:00080000:1.0:1746065196.343750:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf70a80, transno 17179873690 00000004:00080000:1.0:1746065196.343752:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf71880, transno 17179873691 00000004:00080000:1.0:1746065196.343753:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf70000, transno 17179873692 00000004:00080000:1.0:1746065196.343755:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf70e00, transno 17179873693 00000004:00080000:1.0:1746065196.343757:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba0700, transno 17179873694 00000004:00080000:1.0:1746065196.343759:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f9500, transno 17179873695 00000004:00080000:1.0:1746065196.343761:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba1f80, transno 17179873696 00000004:00080000:1.0:1746065196.343763:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f8380, transno 17179873697 00000004:00080000:1.0:1746065196.343765:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba1500, transno 17179873698 00000004:00080000:1.0:1746065196.343767:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a95f80, transno 17179873699 00000004:00080000:1.0:1746065196.343769:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba0e00, transno 17179873700 00000004:00080000:1.0:1746065196.343771:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a97800, transno 17179873701 00000004:00080000:1.0:1746065196.343773:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094091500, transno 17179873706 00000004:00080000:1.0:1746065196.343775:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a90af800, transno 17179873707 00000004:00080000:1.0:1746065196.343777:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f468380, transno 17179873708 00000004:00080000:1.0:1746065196.343779:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095351c00, transno 17179873709 00000004:00080000:1.0:1746065196.343781:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ec2d880, transno 17179873710 00000004:00080000:1.0:1746065196.343783:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0ea00, transno 17179873711 00000004:00080000:1.0:1746065196.343785:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb10e00, transno 17179873712 00000004:00080000:1.0:1746065196.343787:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ec2c380, transno 17179873713 00000100:00100000:1.0:1746065196.343791:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009b82ca80 x1830881260450304/t17179873720(17179873720) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065212 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065196.343801:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82ca80/2, rc 0, transno 17179873720 00000100:00100000:1.0:1746065196.343805:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260450304:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065196.343830:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82d880/2, rc 0, transno 17179873721 00000100:00100000:1.0:1746065196.343833:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260450816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065196.343841:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841002 gen 2 00000004:00080000:1.0:1746065196.343844:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3d180, transno 21474840922 00000004:00080000:1.0:1746065196.343850:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3ce00, transno 21474840923 00000004:00080000:1.0:1746065196.343852:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba1d500, transno 21474840924 00000004:00080000:1.0:1746065196.343854:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3f800, transno 21474840925 00000004:00080000:1.0:1746065196.343856:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba1ea00, transno 21474840926 00000004:00080000:1.0:1746065196.343858:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3f480, transno 21474840927 00000004:00080000:1.0:1746065196.343860:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3e680, transno 21474840928 00000004:00080000:1.0:1746065196.343862:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3d500, transno 21474840929 00000004:00080000:1.0:1746065196.343863:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bee2d80, transno 21474840930 00000004:00080000:1.0:1746065196.343865:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46bb80, transno 21474840931 00000004:00080000:1.0:1746065196.343867:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46b800, transno 21474840932 00000004:00080000:1.0:1746065196.343868:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f469500, transno 21474840933 00000004:00080000:1.0:1746065196.343870:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f469180, transno 21474840934 00000004:00080000:1.0:1746065196.343872:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46ad80, transno 21474840935 00000004:00080000:1.0:1746065196.343873:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f469880, transno 21474840936 00000004:00080000:1.0:1746065196.343875:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46aa00, transno 21474840937 00000004:00080000:1.0:1746065196.343877:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f468e00, transno 21474840938 00000004:00080000:1.0:1746065196.343878:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f46b100, transno 21474840939 00000004:00080000:1.0:1746065196.343880:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff6300, transno 21474840962 00000004:00080000:1.0:1746065196.343881:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff4000, transno 21474840963 00000004:00080000:1.0:1746065196.343883:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff6680, transno 21474840964 00000004:00080000:1.0:1746065196.343884:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff7800, transno 21474840965 00000004:00080000:1.0:1746065196.343886:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff7100, transno 21474840966 00000004:00080000:1.0:1746065196.343887:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff4e00, transno 21474840967 00000004:00080000:1.0:1746065196.343889:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff7480, transno 21474840968 00000004:00080000:1.0:1746065196.343890:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff5180, transno 21474840969 00000004:00080000:1.0:1746065196.343892:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094ff4380, transno 21474840970 00000004:00080000:1.0:1746065196.343893:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf71f80, transno 21474840974 00000004:00080000:1.0:1746065196.343895:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf72d80, transno 21474840975 00000004:00080000:1.0:1746065196.343896:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf72300, transno 21474840976 00000004:00080000:1.0:1746065196.343898:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf73100, transno 21474840977 00000004:00080000:1.0:1746065196.343900:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf72680, transno 21474840978 00000004:00080000:1.0:1746065196.343902:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf73480, transno 21474840979 00000004:00080000:1.0:1746065196.343903:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf71c00, transno 21474840980 00000004:00080000:1.0:1746065196.343905:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bf72a00, transno 21474840981 00000004:00080000:1.0:1746065196.343907:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b620000, transno 21474840982 00000004:00080000:1.0:1746065196.343909:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5883800, transno 21474840983 00000004:00080000:1.0:1746065196.343910:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3f100, transno 21474840984 00000004:00080000:1.0:1746065196.343912:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bd3ed80, transno 21474840985 00000004:00080000:1.0:1746065196.343914:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880a80, transno 21474840986 00000004:00080000:1.0:1746065196.343916:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880000, transno 21474840987 00000004:00080000:1.0:1746065196.343918:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880700, transno 21474840988 00000004:00080000:1.0:1746065196.343920:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5882d80, transno 21474840989 00000004:00080000:1.0:1746065196.343922:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5883100, transno 21474840990 00000004:00080000:1.0:1746065196.343924:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b9fed80, transno 21474840991 00000004:00080000:1.0:1746065196.343926:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45ca80, transno 21474840994 00000004:00080000:1.0:1746065196.343927:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45d500, transno 21474840995 00000004:00080000:1.0:1746065196.343929:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45ea00, transno 21474840996 00000004:00080000:1.0:1746065196.343931:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45c000, transno 21474840997 00000004:00080000:1.0:1746065196.343933:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45df80, transno 21474840998 00000004:00080000:1.0:1746065196.343935:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45f800, transno 21474840999 00000004:00080000:1.0:1746065196.343937:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45c700, transno 21474841000 00000004:00080000:1.0:1746065196.343939:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45e300, transno 21474841001 00000004:00080000:1.0:1746065196.343940:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45f100, transno 21474841002 00000100:00100000:1.0:1746065196.343944:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009ba3c700 x1830881260451328/t21474841005(21474841005) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065212 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065196.343951:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3c700/2, rc 0, transno 21474841005 00000100:00100000:1.0:1746065196.343954:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260451328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065196.343962:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba0000/2, rc 0, transno 21474841006 00000100:00100000:1.0:1746065196.343964:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260451840:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065196.343971:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3d180/2, rc 0, transno 21474841003 00000100:00100000:1.0:1746065196.343973:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260451200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065196.343978:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ba2d80/2, rc 0, transno 21474841004 00000100:00100000:1.0:1746065196.343981:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260451712:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065196.343986:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82c700/2, rc 0, transno 17179873718 00000100:00100000:1.0:1746065196.343988:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260450176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065196.343993:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82d500/2, rc 0, transno 17179873719 00000100:00100000:1.0:1746065196.343995:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260450688:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065196.344249:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 48 done 00000004:00080000:1.0:1746065196.344470:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 54 done 00000100:00100000:2.0:1746065196.344835:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.344897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00080000:2.0:1746065196.344909:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746065196.344912:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065196.344926:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263328896 00000100:00100000:2.0:1746065196.344931:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263328896 00000100:00100000:2.0:1746065196.344951:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329024 00000100:00100000:2.0:1746065196.344952:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329024 00000100:00100000:2.0:1746065196.344964:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4361 00000100:00100000:2.0:1746065196.344968:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32119:x1830881263328896:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:2.0:1746065196.345037:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32119:x1830881263328896:12345-192.168.202.46@tcp:49:cat.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.345045:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4361 00000100:00100000:2.0:1746065196.345054:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4362 00000100:00100000:2.0:1746065196.345058:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:32121:x1830881263329024:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:2.0:1746065196.345084:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:32121:x1830881263329024:12345-192.168.202.46@tcp:49:cat.0 Request processed in 26us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.345088:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4362 00000100:00100000:2.0:1746065196.345104:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065196.345125:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260451584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065196.345144:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065196.345155:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1746065196.345159:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260450944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065196.345173:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.345176:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15155 00000100:00100000:2.0:1746065196.345183:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260451456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065196.345189:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260451072 00000100:00100000:0.0:1746065196.345192:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260451072 00000100:00100000:2.0:1746065196.345194:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065196.345202:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260452224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065196.345205:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260451584 00000100:00100000:0.0:1746065196.345207:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260451584 00000100:00100000:2.0:1746065196.345213:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.345214:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260450944 00000100:00100000:0.0:1746065196.345216:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260450944 00000100:00100000:0.0:1746065196.345221:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260451456 00000100:00100000:0.0:1746065196.345222:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260451456 00000100:00100000:0.0:1746065196.345227:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260452224 00000100:00100000:0.0:1746065196.345228:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260452224 00000100:00100000:2.0:1746065196.345232:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15167 00000100:00100000:2.0:1746065196.345237:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881260451072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065196.345241:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15168 00000100:00100000:0.0:1746065196.345246:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881260451584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065196.345338:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746065196.345340:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881260451584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (194us total) trans 21474841007 rc 0/0 00002000:00010000:2.0:1746065196.345341:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065196.345343:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065196.345344:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00000100:00100000:0.0:1746065196.345345:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15168 00002000:00010000:2.0:1746065196.345346:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2077 -> 2081 00000100:00100000:0.0:1746065196.345356:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15169 00000100:00100000:0.0:1746065196.345359:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881260450944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065196.345362:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881260451072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (257us total) trans 21474841008 rc 0/0 00000100:00100000:2.0:1746065196.345367:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15167 00000100:00100000:2.0:1746065196.345377:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15170 00000100:00100000:2.0:1746065196.345380:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881260451456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065196.345438:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1746065196.345440:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881260451456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (245us total) trans 21474841009 rc 0/0 00002000:00010000:0.0:1746065196.345441:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00000100:00100000:2.0:1746065196.345444:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15170 00002000:00010000:0.0:1746065196.345444:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:0.0:1746065196.345445:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:0.0:1746065196.345447:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:2.0:1746065196.345452:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15171 00000100:00100000:2.0:1746065196.345455:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881260452224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065196.345463:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881260450944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (289us total) trans 21474841010 rc 0/0 00000100:00100000:0.0:1746065196.345467:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15169 00000100:00100000:2.0:1746065196.345514:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881260452224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (300us total) trans 21474841011 rc 0/0 00000100:00100000:2.0:1746065196.345518:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15171 00000004:00080000:2.0:1746065196.345539:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3d880/2, rc 0, transno 21474841010 00000100:00100000:2.0:1746065196.345542:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260450944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065196.345546:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3f100/2, rc 0, transno 21474841009 00000100:00100000:2.0:1746065196.345548:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260451456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065196.345553:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b620000/2, rc 0, transno 21474841011 00000100:00100000:2.0:1746065196.345555:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260452224:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065196.345559:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba3ce00/2, rc 0, transno 21474841008 00000100:00100000:2.0:1746065196.345561:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260451072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065196.345565:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d95180/2, rc 0, transno 21474841007 00000100:00100000:2.0:1746065196.345567:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260451584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065196.345591:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82c380/2, rc 0, transno 17179873716 00000100:00100000:2.0:1746065196.345593:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260450048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065196.345784:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260451968:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065196.345792:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260452096:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065196.345847:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c394400/0x14b4f8542d4fe80b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 250 pid: 14644 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065196.345862:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.345879:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c395400, rc 0) 00000100:00100000:3.0:1746065196.345897:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32115:x1830881263328128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 64480us (64959us total) trans 8589944395 rc 0/0 00000100:00100000:3.0:1746065196.345903:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10111 00000004:00080000:2.0:1746065196.346184:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82d180/2, rc 0, transno 17179873717 00000100:00100000:2.0:1746065196.346187:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260450560:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065196.346194:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82c000/2, rc 0, transno 17179873714 00000100:00100000:2.0:1746065196.346196:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260449920:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065196.346202:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82ce00/2, rc 0, transno 17179873715 00000100:00100000:2.0:1746065196.346204:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260450432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065196.351869:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.351939:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329152 00000100:00100000:3.0:1746065196.351948:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329152 00000100:00100000:3.0:1746065196.351991:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4363 00000100:00100000:3.0:1746065196.351998:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32115:x1830881263329152:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:3.0:1746065196.352090:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32115:x1830881263329152:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.352096:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4363 00000100:00100000:0.0:1746065196.360683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.363987:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329280 00000100:00100000:2.0:1746065196.363999:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329280 00000100:00100000:2.0:1746065196.364042:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15172 00000100:00100000:2.0:1746065196.364049:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:32115:x1830881263329280:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065196.364063:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.364079:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61987 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.364104:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.364113:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.364119:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 22 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.364124:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.364126:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.364129:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.364154:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 22 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.364164:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 22 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.364176:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260452352:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.364267:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.364275:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 7 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.364283:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260452480:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.364309:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 8 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.364316:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 8 pid: 8851 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.364323:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260452608:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.364338:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.366079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.366865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.366892:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329536 00000100:00100000:2.0:1746065196.366892:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329792 00000100:00100000:3.0:1746065196.366898:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329536 00000100:00100000:2.0:1746065196.366898:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329792 00002000:00100000:3.0:1746065196.366934:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f145c00 x1830881263329536/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.366942:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f145c00 with x1830881263329536 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.366947:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f145c00 00000100:00100000:3.0:1746065196.366965:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8556 00000100:00100000:3.0:1746065196.366970:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263329536:12345-192.168.202.46@tcp:3:cat.0 00002000:00100000:2.0:1746065196.366972:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f146300 x1830881263329792/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.366981:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f146300 with x1830881263329792 ext(1048576->2097151) 00002000:00010000:2.0:1746065196.366985:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f146300 00000100:00100000:2.0:1746065196.366998:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8557 00000100:00100000:2.0:1746065196.367004:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1958:x1830881263329792:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065196.379260:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1958:x1830881263329792:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12247us (13177us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.379271:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8557 00002000:00100000:2.0:1746065196.379282:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f146300 x1830881263329792/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.379291:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f146300 with x1830881263329792 ext(1048576->2097151) 00002000:00010000:2.0:1746065196.379296:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f146300 00000100:00100000:2.0:1746065196.379770:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260452352:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.379779:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260452480:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.379786:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260452608:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.379829:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2732032->3145727] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 22 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.379843:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52c1800, rc 0) 00000100:00100000:2.0:1746065196.379872:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:32115:x1830881263329280:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 15823us (19198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.379879:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15172 00000100:00100000:3.0:1746065196.380570:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263329536:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13596us (13703us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.380579:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8556 00002000:00100000:3.0:1746065196.380585:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f145c00 x1830881263329536/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.380592:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f145c00 with x1830881263329536 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.380596:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f145c00 00000100:00100000:0.0:1746065196.385470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.385929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.386001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.386020:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330176 00000100:00100000:2.0:1746065196.386020:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263329920 00000100:00100000:3.0:1746065196.386028:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330176 00000100:00100000:2.0:1746065196.386028:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263329920 00010000:00010000:3.0:1746065196.386057:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 9 pid: 8851 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.386057:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 22 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746065196.386086:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330048 00000100:00100000:3.0:1746065196.386088:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330048 00000100:00100000:2.0:1746065196.386093:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7803 00010000:00010000:3.0:1746065196.386096:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 8 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.386100:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263330176:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065196.386107:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7804 00000100:00100000:3.0:1746065196.386111:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7805 00010000:00010000:2.0:1746065196.386112:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065196.386115:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263329920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065196.386116:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263330048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065196.386122:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.386123:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.386131:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 8 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.386131:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 9 pid: 8851 timeout: 895 lvb_type: 1 00010000:00010000:1.0:1746065196.386133:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 22 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.386140:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 9 pid: 8851 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.386153:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 8 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:1.0:1746065196.386170:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 22 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:1.0:1746065196.386189:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9800/0x14b4f8542d4fe7a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6192c expref: 22 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:1.0:1746065196.386206:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065196.386242:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263329920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 128us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065196.386248:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7804 00010000:00010000:2.0:1746065196.386326:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c756000/0x14b4f8542d4fe6ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ed expref: 9 pid: 8851 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.386340:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065196.386366:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263330176:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 267us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.386373:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7803 00010000:00010000:3.0:1746065196.386541:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d9400/0x14b4f8542d4fe804 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6196b expref: 8 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.386554:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.386556:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.386562:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.386569:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.386595:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 20 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.386605:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260452736:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065196.386664:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065196.392718:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260452736:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065196.392738:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.392788:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263330048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6671us (6788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.392798:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7805 00000100:00100000:0.0:1746065196.394463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.394933:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330432 00000100:00100000:3.0:1746065196.394940:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330432 00002000:00100000:3.0:1746065196.394976:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2732032->2736127) req@ffff8800913f9500 x1830881263330432/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.394986:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9500 with x1830881263330432 ext(2732032->2736127) 00002000:00010000:3.0:1746065196.394990:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f9500 00000100:00100000:3.0:1746065196.395021:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8558 00000100:00100000:3.0:1746065196.395028:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263330432:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065196.395223:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263330432:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 194us (763us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065196.395232:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8558 00002000:00100000:3.0:1746065196.395237:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2732032->2736127) req@ffff8800913f9500 x1830881263330432/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/4536 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.395244:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9500 with x1830881263330432 ext(2732032->2736127) 00002000:00010000:3.0:1746065196.395247:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f9500 00000100:00100000:0.0:1746065196.398589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.399391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.399746:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330688 00000100:00100000:2.0:1746065196.399746:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263330944 00000100:00100000:3.0:1746065196.399754:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330688 00000100:00100000:2.0:1746065196.399754:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263330944 00002000:00100000:3.0:1746065196.399787:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff8800913f9880 x1830881263330688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.399787:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2732031) req@ffff8800913f9c00 x1830881263330944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.399795:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9880 with x1830881263330688 ext(2097152->3145727) 00002000:00010000:3.0:1746065196.399799:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9880 00002000:00100000:2.0:1746065196.399800:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9c00 with x1830881263330944 ext(2097152->2732031) 00002000:00010000:2.0:1746065196.399803:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f9c00 00000100:00100000:3.0:1746065196.399849:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8559 00000100:00100000:3.0:1746065196.399856:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1959:x1830881263330688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065196.400595:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8560 00000100:00100000:2.0:1746065196.400602:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263330944:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.402272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.406765:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331072 00000100:00100000:3.0:1746065196.406778:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331072 00000100:00100000:3.0:1746065196.407943:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15173 00000100:00100000:3.0:1746065196.407953:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263331072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.407968:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.407985:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4fe82e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6198e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.408042:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260452864:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065196.412793:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.415307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.415378:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331200 00000100:00100000:2.0:1746065196.415388:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331200 00000100:00100000:2.0:1746065196.415426:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15174 00000100:00100000:2.0:1746065196.415433:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:32118:x1830881263331200:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065196.415449:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.415463:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61995 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.415487:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.415495:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.415502:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 22 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.415507:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.415509:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.415511:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.415540:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 22 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.415550:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 22 pid: 25185 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.415560:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260452992:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.415864:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 10 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.415872:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 10 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.415881:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260453120:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065196.415981:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1959:x1830881263330688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 16124us (17398us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.415991:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8559 00002000:00100000:3.0:1746065196.415999:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff8800913f9880 x1830881263330688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.416006:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9880 with x1830881263330688 ext(2097152->3145727) 00002000:00010000:3.0:1746065196.416010:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9880 00010000:00010000:2.0:1746065196.416109:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.416116:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 7 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.416122:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260453248:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.416136:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.419478:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263330944:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18868us (20080us total) trans 0 rc 634880/634880 00000100:00100000:2.0:1746065196.419492:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8560 00002000:00100000:2.0:1746065196.419501:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->2732031) req@ffff8800913f9c00 x1830881263330944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.419511:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9c00 with x1830881263330944 ext(2097152->2732031) 00002000:00010000:2.0:1746065196.419516:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913f9c00 00002000:00010000:3.0:1746065196.420656:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime: 1746065195 -> 1746065197 00002000:00010000:3.0:1746065196.420661:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065195 -> 1746065197 00002000:00010000:3.0:1746065196.420662:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime: 1746065195 -> 1746065197 00000100:00100000:3.0:1746065196.420680:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260452864:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065196.420808:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4fe82e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6198e expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.420932:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944f2a00/0x14b4f8542d4fe82e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6198e expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.428803:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f2a00, rc 0) 00000100:00100000:3.0:1746065196.428876:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263331072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 20921us (26603us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065196.428883:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15173 00000100:00100000:0.0:1746065196.430133:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.430170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.430189:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331328 00000100:00100000:0.0:1746065196.430198:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331328 00010000:00010000:0.0:1746065196.430236:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065196.430259:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331456 00000100:00100000:0.0:1746065196.430261:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331456 00010000:00010000:0.0:1746065196.430272:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 21 pid: 25185 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065196.431021:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7806 00000100:00100000:0.0:1746065196.431030:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263331328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.431042:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.431066:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065196.431077:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065196.431096:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.431129:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263331328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 101us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.431135:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7806 00000100:00100000:0.0:1746065196.431151:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7807 00000100:00100000:0.0:1746065196.431156:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263331456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.431163:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.431169:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 21 pid: 25185 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065196.431177:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 21 pid: 25185 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065196.431187:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.431207:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263331456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 51us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.431211:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7807 00010000:00010000:2.0:1746065196.431420:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4fe78d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61909 expref: 20 pid: 25185 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.431438:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260452992:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.431450:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8400/0x14b4f8542d4fe7e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6194f expref: 8 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.431457:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260453120:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.434349:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260453248:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.434375:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.434390:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff54800, rc 0) 00000100:00100000:2.0:1746065196.434419:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+7:32118:x1830881263331200:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 18987us (19121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.434426:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15174 00000100:00100000:0.0:1746065196.435212:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.435244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.435266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.435284:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331968 00000100:00100000:0.0:1746065196.435285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.435291:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331968 00000100:00100000:3.0:1746065196.435303:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332096 00000100:00100000:3.0:1746065196.435306:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332096 00000100:00100000:2.0:1746065196.435331:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263331584 00002000:00100000:3.0:1746065196.435334:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800913f9180 x1830881263332096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065196.435334:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263331584 00010000:00010000:2.0:1746065196.435348:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 8 pid: 2463 timeout: 895 lvb_type: 1 00002000:00100000:3.0:1746065196.435349:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9180 with x1830881263332096 ext(3145728->4194303) 00002000:00010000:3.0:1746065196.435353:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800913f9180 00000100:00100000:2.0:1746065196.435364:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7808 00000100:00100000:3.0:1746065196.435365:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332224 00000100:00100000:3.0:1746065196.435367:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332224 00000100:00100000:2.0:1746065196.435369:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263331584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065196.435377:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746065196.435378:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800913fa680 x1830881263332224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.435384:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fa680 with x1830881263332224 ext(3145728->4194303) 00002000:00010000:3.0:1746065196.435387:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913fa680 00010000:00010000:2.0:1746065196.435393:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 8 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.435402:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 8 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.435416:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f66a800/0x14b4f8542d4fe6d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d1 expref: 8 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.435426:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.435428:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.435433:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 6 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.435439:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 6 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.435459:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 6 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.435468:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260453376:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065196.435627:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8561 00000100:00100000:0.0:1746065196.435633:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1958:x1830881263332096:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065196.435780:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8562 00000100:00100000:3.0:1746065196.435788:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263332224:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065196.436210:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065196.439018:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15175 00000100:00100000:3.0:1746065196.439029:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:32115:x1830881263331968:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065196.439044:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.439058:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e6199c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.439087:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.439096:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.439102:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 15 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.439112:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.439113:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.439116:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->3317759] (req 3145728->3317759) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.439140:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 15 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.439149:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 15 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746065196.439159:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260453504:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.439217:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.439225:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 8 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746065196.439231:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260453632:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.439259:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.439266:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 8 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746065196.439277:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260453760:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065196.439291:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065196.442659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.443460:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332480 00000100:00100000:2.0:1746065196.443469:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332480 00002000:00100000:2.0:1746065196.443504:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012b621c00 x1830881263332480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.443513:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b621c00 with x1830881263332480 ext(2097152->3145727) 00010000:00010000:2.0:1746065196.443522:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.443532:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00002000:00010000:2.0:1746065196.443538:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b621c00 00000100:00100000:2.0:1746065196.443556:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2589 00000100:00100000:2.0:1746065196.443561:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263332480:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.452525:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.453116:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332736 00000100:00100000:1.0:1746065196.453126:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332736 00002000:00100000:1.0:1746065196.453163:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1765376->1769471) req@ffff8800913faa00 x1830881263332736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.453172:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913faa00 with x1830881263332736 ext(1765376->1769471) 00002000:00010000:1.0:1746065196.453177:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913faa00 00000100:00100000:1.0:1746065196.453218:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8563 00000100:00100000:1.0:1746065196.453225:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263332736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065196.453373:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263332736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 148us (855us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065196.453379:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8563 00002000:00100000:1.0:1746065196.453384:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1765376->1769471) req@ffff8800913faa00 x1830881263332736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/4536 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.453390:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913faa00 with x1830881263332736 ext(1765376->1769471) 00002000:00010000:1.0:1746065196.453393:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913faa00 00000100:00100000:0.0:1746065196.454215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.454219:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260453376:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065196.454234:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065196.454256:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263331584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 18887us (19936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.454264:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7808 00000100:00100000:2.0:1746065196.454277:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332864 00000100:00100000:2.0:1746065196.454280:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332864 00010000:00010000:2.0:1746065196.454295:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.454311:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7809 00000100:00100000:2.0:1746065196.454316:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263332864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065196.454323:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065196.454337:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.454346:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.454365:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065196.454377:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263332864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.454381:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7809 00000100:00100000:2.0:1746065196.454401:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260453504:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.454408:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260453632:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.454415:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ac00/0x14b4f8542d4fe6e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618e6 expref: 8 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.454426:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260453760:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.454449:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->3317759] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.454457:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f3000, rc 0) 00000100:00100000:2.0:1746065196.454470:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:32115:x1830881263331968:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 15446us (19225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.454475:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15175 00000100:00100000:3.0:1746065196.455443:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263332224:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19652us (20152us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.455451:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8562 00002000:00100000:3.0:1746065196.455458:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff8800913fa680 x1830881263332224/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.455465:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913fa680 with x1830881263332224 ext(3145728->4194303) 00002000:00010000:3.0:1746065196.455469:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800913fa680 00000100:00100000:0.0:1746065196.457089:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1958:x1830881263332096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21449us (21814us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065196.457099:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8561 00002000:00100000:0.0:1746065196.457108:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff8800913f9180 x1830881263332096/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.457116:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9180 with x1830881263332096 ext(3145728->4194303) 00010000:00010000:0.0:1746065196.457124:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 14 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065196.457134:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 14 pid: 2463 timeout: 895 lvb_type: 1 00002000:00010000:0.0:1746065196.457141:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800913f9180 00000100:00100000:3.0:1746065196.457849:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263332480:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14286us (15194us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.457856:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2589 00002000:00100000:3.0:1746065196.457861:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012b621c00 x1830881263332480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.457868:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b621c00 with x1830881263332480 ext(2097152->3145727) 00010000:00010000:3.0:1746065196.457873:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.457880:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00002000:00010000:3.0:1746065196.457886:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b621c00 00000100:00100000:0.0:1746065196.462142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.462531:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263332992 00000100:00100000:2.0:1746065196.462539:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263332992 00000100:00100000:2.0:1746065196.464261:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15176 00000100:00100000:2.0:1746065196.464273:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+7:32118:x1830881263332992:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065196.464289:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.464305:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619a3 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.464329:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 6 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.464336:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.464343:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 19 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.464348:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.464349:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.464352:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1048576->1679359] (req 1048576->1679359) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.464375:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 19 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.464384:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 19 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.464399:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260453888:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.464475:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.464482:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 8 pid: 8429 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.464489:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260454016:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.464512:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 6 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.464519:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 6 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.464526:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260454144:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.464540:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.467929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.468027:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333120 00000100:00100000:2.0:1746065196.468035:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333120 00000100:00100000:2.0:1746065196.468081:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15177 00000100:00100000:2.0:1746065196.468088:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:32121:x1830881263333120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.468104:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.468118:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619aa expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.468147:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.468154:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.468156:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.468158:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.468182:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 19 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.468191:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 19 pid: 25185 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.468200:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260454272:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.468708:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.471285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.471328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.471989:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333376 00000100:00100000:3.0:1746065196.471997:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333376 00000100:00100000:3.0:1746065196.472029:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333248 00000100:00100000:3.0:1746065196.472031:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333248 00000100:00100000:3.0:1746065196.472047:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15178 00000100:00100000:3.0:1746065196.472053:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1959:x1830881263333376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.472068:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.472081:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c394800/0x14b4f8542d4fe851 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619b8 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.472098:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.472107:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c394800/0x14b4f8542d4fe851 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619b8 expref: 15 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065196.472117:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c394800/0x14b4f8542d4fe851 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619b8 expref: 15 pid: 2463 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065196.472647:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15179 00000100:00100000:1.0:1746065196.472657:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263333248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065196.472665:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065196.472674:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0f8c00/0x14b4f8542d4fe858 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619b1 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065196.472724:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260454400:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065196.472795:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305a80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065196.473213:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c394800, rc 0) 00000100:00100000:3.0:1746065196.473238:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1959:x1830881263333376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1185us (1960us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065196.473244:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15178 00000100:00100000:3.0:1746065196.474833:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260454272:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.474857:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.474870:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f3200, rc 0) 00000100:00100000:3.0:1746065196.474895:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:32121:x1830881263333120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6808us (6975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.474906:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15177 00002000:00010000:0.0:1746065196.474975:0:2462:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime: 1746065195 -> 1746065197 00002000:00010000:0.0:1746065196.474979:0:2462:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065195 -> 1746065197 00002000:00010000:0.0:1746065196.474982:0:2462:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime: 1746065195 -> 1746065197 00000100:00100000:0.0:1746065196.474995:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260454400:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065196.475013:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0f8c00/0x14b4f8542d4fe858 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619b1 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.475022:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0f8c00/0x14b4f8542d4fe858 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619b1 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.475034:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0f8c00, rc 0) 00000100:00100000:0.0:1746065196.475049:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263333248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2396us (3721us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065196.475055:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15179 00000100:00100000:2.0:1746065196.475505:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260453888:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.475512:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260454016:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.475518:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260454144:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.475533:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1048576->1679359] (req 1048576->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.475542:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b0000, rc 0) 00000100:00100000:2.0:1746065196.475559:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:32118:x1830881263332992:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 11291us (13425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.475565:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15176 00000100:00100000:0.0:1746065196.476303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.476356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.476970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.477342:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333632 00000100:00100000:2.0:1746065196.477349:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333632 00000100:00100000:0.0:1746065196.477359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065196.477373:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 7 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065196.477373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.477393:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333888 00000100:00100000:2.0:1746065196.477395:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333888 00000100:00100000:0.0:1746065196.477397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065196.477402:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 9 pid: 8429 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.477410:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333504 00000100:00100000:2.0:1746065196.477411:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333504 00010000:00010000:2.0:1746065196.477419:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 20 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.477427:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334016 00000100:00100000:2.0:1746065196.477429:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334016 00010000:00010000:2.0:1746065196.477436:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00000100:00100000:2.0:1746065196.477443:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334144 00000100:00100000:2.0:1746065196.477445:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334144 00010000:00010000:2.0:1746065196.477452:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 14 pid: 2463 timeout: 895 lvb_type: 1 00000100:00100000:3.0:1746065196.477453:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7810 00000100:00100000:3.0:1746065196.477461:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263333632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065196.477461:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7811 00000100:00100000:2.0:1746065196.477464:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263333888:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065196.477471:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065196.477471:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.477486:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 7 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.477486:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 9 pid: 8429 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.477494:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 9 pid: 8429 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.477501:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 7 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.477516:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe13c00/0x14b4f8542d4fe7ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61956 expref: 9 pid: 8429 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.477741:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f66b200/0x14b4f8542d4fe6de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618d8 expref: 7 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.477751:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.477778:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1959:x1830881263333632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 318us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.477784:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7810 00000100:00100000:3.0:1746065196.477798:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7812 00000100:00100000:3.0:1746065196.477802:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263333504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065196.477808:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.477831:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 20 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.477839:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 20 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.477852:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6d8800/0x14b4f8542d4fe79b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61917 expref: 20 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.477860:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.477861:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.477866:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.477873:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.477896:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.477906:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260454528:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065196.477944:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065196.477959:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7813 00000100:00100000:3.0:1746065196.477964:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263334016:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065196.477970:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.477981:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.477989:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.478004:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9a00/0x14b4f8542d4fe7fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61964 expref: 9 pid: 8427 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.478011:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.478025:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263334016:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.478030:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7813 00000100:00100000:3.0:1746065196.478039:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7814 00000100:00100000:3.0:1746065196.478044:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881263334144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065196.478049:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.478056:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 14 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.478062:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 14 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:3.0:1746065196.478071:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8c00/0x14b4f8542d4fe7a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61925 expref: 14 pid: 2463 timeout: 895 lvb_type: 1 00010000:00010000:2.0:1746065196.478077:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065196.478078:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.478079:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.478082:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.478088:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.478092:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:1959:x1830881263333888:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 627us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.478097:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7811 00010000:00010000:3.0:1746065196.478104:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 13 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.478111:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260454656:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065196.478126:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065196.478375:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263333760 00000100:00100000:3.0:1746065196.478379:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263333760 00002000:00100000:3.0:1746065196.478403:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2732032->3145727) req@ffff8800913f9f80 x1830881263333760/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.478412:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9f80 with x1830881263333760 ext(2732032->3145727) 00010000:00010000:3.0:1746065196.478418:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 20 pid: 25185 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.478427:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 20 pid: 25185 timeout: 895 lvb_type: 0 00002000:00010000:3.0:1746065196.478432:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913f9f80 00000100:00100000:3.0:1746065196.478456:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2590 00000100:00100000:3.0:1746065196.478461:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263333760:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065196.479479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.479558:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334272 00000100:00100000:2.0:1746065196.479562:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334272 00000100:00100000:2.0:1746065196.479589:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15180 00000100:00100000:2.0:1746065196.479594:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:32119:x1830881263334272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.479604:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.479616:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619bf expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.479634:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.479640:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.479641:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.479645:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.479663:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.479672:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 15 pid: 8851 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.479681:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260454784:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.480400:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065196.480831:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260454528:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065196.480850:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.480874:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263333504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3071us (3904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.480883:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7812 00000100:00100000:3.0:1746065196.481097:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260454656:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065196.481107:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.481327:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263334144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3281us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.481333:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7814 00000100:00100000:2.0:1746065196.482886:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260454784:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.482911:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.482924:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b1c00, rc 0) 00000100:00100000:2.0:1746065196.482954:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:32119:x1830881263334272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3358us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.482961:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15180 00000100:00100000:0.0:1746065196.485314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.485459:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334528 00000100:00100000:1.0:1746065196.485466:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334528 00002000:00100000:1.0:1746065196.485496:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3313664->3317759) req@ffff88009fcad880 x1830881263334528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.485504:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcad880 with x1830881263334528 ext(3313664->3317759) 00010000:00010000:1.0:1746065196.485512:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 14 pid: 8851 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746065196.485522:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 14 pid: 8851 timeout: 895 lvb_type: 0 00002000:00010000:1.0:1746065196.485528:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fcad880 00000100:00100000:3.0:1746065196.485998:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263333760:12345-192.168.202.46@tcp:4:cat.0 Request processed in 7534us (8636us total) trans 17179873722 rc 0/0 00000100:00100000:3.0:1746065196.486006:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2590 00002000:00100000:3.0:1746065196.486012:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2732032->3145727) req@ffff8800913f9f80 x1830881263333760/t17179873722(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/448 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.486019:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800913f9f80 with x1830881263333760 ext(2732032->3145727) 00010000:00010000:3.0:1746065196.486024:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 21 pid: 25185 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.486033:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 21 pid: 25185 timeout: 895 lvb_type: 0 00002000:00010000:3.0:1746065196.486039:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800913f9f80 00000100:00100000:3.0:1746065196.486052:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2591 00000100:00100000:3.0:1746065196.486058:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881263334528:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065196.486147:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881263334528:12345-192.168.202.46@tcp:3:cat.0 Request processed in 90us (839us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065196.486152:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2591 00002000:00100000:3.0:1746065196.486157:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3313664->3317759) req@ffff88009fcad880 x1830881263334528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/4536 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.486170:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcad880 with x1830881263334528 ext(3313664->3317759) 00010000:00010000:3.0:1746065196.486175:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 14 pid: 8851 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.486183:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 14 pid: 8851 timeout: 895 lvb_type: 0 00002000:00010000:3.0:1746065196.486189:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fcad880 00000100:00100000:0.0:1746065196.488560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.488625:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263334784 00000100:00100000:2.0:1746065196.488632:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263334784 00002000:00100000:2.0:1746065196.488659:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1675264->1679359) req@ffff88009fcad180 x1830881263334784/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.488667:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcad180 with x1830881263334784 ext(1675264->1679359) 00002000:00010000:2.0:1746065196.488672:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcad180 00000100:00100000:2.0:1746065196.488702:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8564 00000100:00100000:2.0:1746065196.488801:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263334784:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065196.489400:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263334784:12345-192.168.202.46@tcp:3:cat.0 Request processed in 688us (843us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065196.489407:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8564 00002000:00100000:2.0:1746065196.489413:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1675264->1679359) req@ffff88009fcad180 x1830881263334784/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/4536 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.489420:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcad180 with x1830881263334784 ext(1675264->1679359) 00002000:00010000:2.0:1746065196.489424:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcad180 00000100:00100000:0.0:1746065196.489596:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.489710:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335040 00000100:00100000:3.0:1746065196.489715:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335040 00002000:00100000:3.0:1746065196.489733:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3317759) req@ffff88009fcad500 x1830881263335040/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.489739:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcad500 with x1830881263335040 ext(3145728->3317759) 00010000:00010000:3.0:1746065196.489745:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 14 pid: 8851 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.489754:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 14 pid: 8851 timeout: 895 lvb_type: 0 00002000:00010000:3.0:1746065196.489759:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fcad500 00000100:00100000:3.0:1746065196.489781:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2592 00000100:00100000:3.0:1746065196.489786:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881263335040:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065196.491135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.491179:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335296 00000100:00100000:2.0:1746065196.491184:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335296 00000100:00100000:2.0:1746065196.491221:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4364 00000100:00100000:2.0:1746065196.491227:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32115:x1830881263335296:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065196.491445:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32115:x1830881263335296:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 217us (312us total) trans 8589944396 rc 0/0 00000100:00100000:2.0:1746065196.491452:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4364 00000100:00100000:2.0:1746065196.492440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.492660:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335424 00000100:00100000:3.0:1746065196.492738:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335424 00010000:00010000:3.0:1746065196.492802:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 21 pid: 25185 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.492849:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7815 00000100:00100000:3.0:1746065196.492856:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263335424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065196.492865:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.492882:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 21 pid: 25185 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.492892:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 21 pid: 25185 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.492910:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b52c1800/0x14b4f8542d4fe827 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2732032->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61987 expref: 21 pid: 25185 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.492926:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.492927:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.492933:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 7 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.492939:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 7 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.492963:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 7 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.493212:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260454912:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065196.493439:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065196.494372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.494439:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335680 00000100:00100000:2.0:1746065196.494444:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335680 00000100:00100000:2.0:1746065196.494470:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4365 00000100:00100000:2.0:1746065196.494476:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b879850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:32118:x1830881263335680:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065196.494595:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b879850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:32118:x1830881263335680:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 118us (223us total) trans 8589944397 rc 0/0 00000100:00100000:2.0:1746065196.494601:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4365 00000100:00100000:2.0:1746065196.496133:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263335040:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6344us (6534us total) trans 21474841012 rc 0/0 00000100:00100000:2.0:1746065196.496142:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2592 00002000:00100000:2.0:1746065196.496150:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->3317759) req@ffff88009fcad500 x1830881263335040/t21474841012(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/448 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.496158:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcad500 with x1830881263335040 ext(3145728->3317759) 00010000:00010000:2.0:1746065196.496165:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 16 pid: 8851 timeout: 895 lvb_type: 0 00010000:00010000:2.0:1746065196.496177:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 16 pid: 8851 timeout: 895 lvb_type: 0 00002000:00010000:2.0:1746065196.496182:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fcad500 00000100:00100000:3.0:1746065196.496835:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260454912:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065196.496851:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.496885:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263335424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4029us (4445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.496892:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7815 00000100:00100000:0.0:1746065196.497203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.497343:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263335936 00000100:00100000:2.0:1746065196.497349:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263335936 00002000:00100000:2.0:1746065196.497374:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fcaca80 x1830881263335936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.497380:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaca80 with x1830881263335936 ext(2097152->3145727) 00002000:00010000:2.0:1746065196.497383:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcaca80 00000100:00100000:2.0:1746065196.497395:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8565 00000100:00100000:2.0:1746065196.497399:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263335936:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.506622:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.507087:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336064 00000100:00100000:3.0:1746065196.507096:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336064 00010000:00010000:3.0:1746065196.507130:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 16 pid: 8851 timeout: 895 lvb_type: 0 00000100:00100000:3.0:1746065196.507828:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7816 00000100:00100000:3.0:1746065196.507837:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263336064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065196.507905:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065196.507919:0:7079:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065195 -> 1746065197 00002000:00010000:3.0:1746065196.507922:0:7079:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065195 -> 1746065197 00010000:00010000:3.0:1746065196.507927:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 16 pid: 8851 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.507937:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 16 pid: 8851 timeout: 895 lvb_type: 0 00010000:00010000:3.0:1746065196.507957:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944f3000/0x14b4f8542d4fe83c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6199c expref: 16 pid: 8851 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.508360:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263335936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10958us (11156us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.508367:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8565 00002000:00100000:2.0:1746065196.508375:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fcaca80 x1830881263335936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.508388:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaca80 with x1830881263335936 ext(2097152->3145727) 00002000:00010000:2.0:1746065196.508392:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcaca80 00010000:00010000:3.0:1746065196.508574:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.508576:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.508583:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.508591:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.508621:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 15 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.508631:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260455040:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065196.509028:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065196.512404:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260455040:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065196.512429:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.512483:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263336064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4646us (5868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.512492:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7816 00000100:00100000:0.0:1746065196.513918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.514040:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336192 00000100:00100000:2.0:1746065196.514047:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336192 00000100:00100000:0.0:1746065196.514098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.514257:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15181 00000100:00100000:2.0:1746065196.514265:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:32121:x1830881263336192:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.514281:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065196.514295:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336448 00010000:00010000:2.0:1746065196.514298:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619c6 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.514299:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336448 00010000:00010000:2.0:1746065196.514319:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.514321:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746065196.514322:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8800a90af800 x1830881263336448/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065196.514327:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065196.514330:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af800 with x1830881263336448 ext(4194304->5013503) 00002000:00010000:3.0:1746065196.514334:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90af800 00010000:00010000:2.0:1746065196.514341:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 9 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.514345:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8566 00000100:00100000:3.0:1746065196.514349:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263336448:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065196.514350:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec46c00, rc 0) 00000100:00100000:2.0:1746065196.514389:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:32121:x1830881263336192:12345-192.168.202.46@tcp:101:cat.0 Request processed in 125us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.514394:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15181 00000100:00100000:0.0:1746065196.520279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.520454:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336704 00000100:00100000:1.0:1746065196.520463:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336704 00000100:00100000:0.0:1746065196.520463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:1.0:1746065196.520538:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f46bb80 x1830881263336704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.520547:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46bb80 with x1830881263336704 ext(3145728->4194303) 00002000:00010000:1.0:1746065196.520552:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46bb80 00000100:00100000:1.0:1746065196.520568:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263336960 00000100:00100000:1.0:1746065196.520570:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263336960 00002000:00100000:1.0:1746065196.520582:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009f46b800 x1830881263336960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.520594:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b800 with x1830881263336960 ext(3145728->4194303) 00002000:00010000:1.0:1746065196.520597:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46b800 00000100:00100000:1.0:1746065196.520621:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8567 00000100:00100000:1.0:1746065196.520628:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263336704:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.520635:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8568 00000100:00100000:0.0:1746065196.520640:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263336960:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065196.522706:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a90af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263336448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8347us (8600us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065196.522718:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8566 00002000:00100000:3.0:1746065196.522726:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff8800a90af800 x1830881263336448/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.522734:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a90af800 with x1830881263336448 ext(4194304->5013503) 00002000:00010000:3.0:1746065196.522738:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a90af800 00000100:00100000:0.0:1746065196.528777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.529306:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337088 00000100:00100000:2.0:1746065196.529314:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337088 00000100:00100000:2.0:1746065196.529438:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15182 00000100:00100000:2.0:1746065196.529446:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263337088:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.529461:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.529474:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d500600/0x14b4f8542d4fe86d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619cd expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.529518:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260455168:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065196.529600:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.531666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.531787:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337216 00000100:00100000:1.0:1746065196.531794:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337216 00000100:00100000:1.0:1746065196.532864:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15183 00000100:00100000:1.0:1746065196.532873:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263337216:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065196.532887:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065196.532899:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4fe874 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619d4 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065196.532941:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260455296:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065196.533013:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.533250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.533351:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260455168:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065196.533368:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d500600/0x14b4f8542d4fe86d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619cd expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.533376:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d500600/0x14b4f8542d4fe86d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619cd expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.533386:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500600, rc 0) 00000100:00100000:2.0:1746065196.533408:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263337088:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3964us (4641us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065196.533409:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263336960:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12769us (12945us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.533414:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15182 00000100:00100000:0.0:1746065196.533416:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8568 00002000:00100000:0.0:1746065196.533422:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009f46b800 x1830881263336960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065196.533428:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337344 00000100:00100000:2.0:1746065196.533431:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337344 00002000:00100000:0.0:1746065196.533432:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46b800 with x1830881263336960 ext(3145728->4194303) 00002000:00010000:0.0:1746065196.533435:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46b800 00000100:00100000:2.0:1746065196.533444:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15184 00000100:00100000:2.0:1746065196.533448:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263337344:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.533454:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.533460:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619db expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.533475:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.533477:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.533483:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.533494:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.533675:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d500400, rc 0) 00000100:00100000:2.0:1746065196.533713:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263337344:12345-192.168.202.46@tcp:101:cat.0 Request processed in 263us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.533718:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15184 00000100:00100000:1.0:1746065196.536616:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263336704:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15979us (16336us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065196.536626:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8567 00002000:00100000:1.0:1746065196.536635:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f46bb80 x1830881263336704/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.536643:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46bb80 with x1830881263336704 ext(3145728->4194303) 00002000:00010000:1.0:1746065196.536647:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46bb80 00002000:00010000:1.0:1746065196.536774:0:2462:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime: 1746065195 -> 1746065197 00002000:00010000:1.0:1746065196.536777:0:2462:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime: 1746065195 -> 1746065197 00002000:00010000:1.0:1746065196.536780:0:2462:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime: 1746065195 -> 1746065197 00000100:00100000:1.0:1746065196.536797:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260455296:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065196.536860:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4fe874 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619d4 expref: 22 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065196.536872:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4fe874 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619d4 expref: 22 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065196.536998:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093486200, rc 0) 00000100:00100000:1.0:1746065196.537023:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263337216:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4151us (5361us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065196.537029:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15183 00000100:00100000:0.0:1746065196.539208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.539272:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337472 00000100:00100000:1.0:1746065196.539279:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337472 00000100:00100000:1.0:1746065196.539326:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15185 00000100:00100000:1.0:1746065196.539333:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263337472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065196.539347:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065196.539360:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093486e00/0x14b4f8542d4fe882 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619e2 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065196.539401:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260455424:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065196.539470:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.539623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.539658:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337600 00000100:00100000:2.0:1746065196.539663:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337600 00000100:00100000:2.0:1746065196.539751:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15186 00000100:00100000:2.0:1746065196.539757:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263337600:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.539763:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.539770:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fe889 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619e9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.539794:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260455552:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065196.540135:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065196.541345:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260455424:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065196.541369:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093486e00/0x14b4f8542d4fe882 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619e2 expref: 24 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065196.541383:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093486e00/0x14b4f8542d4fe882 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619e2 expref: 24 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065196.541392:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093486e00, rc 0) 00000100:00100000:1.0:1746065196.541429:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1958:x1830881263337472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2096us (2228us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065196.541435:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15185 00000100:00100000:2.0:1746065196.541504:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260455552:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065196.541518:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fe889 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619e9 expref: 22 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.541530:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d501e00/0x14b4f8542d4fe889 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619e9 expref: 22 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.541539:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d501e00, rc 0) 00000100:00100000:2.0:1746065196.541555:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263337600:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1799us (1933us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065196.541560:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15186 00000100:00100000:0.0:1746065196.543571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.543617:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263337856 00000100:00100000:1.0:1746065196.543624:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263337856 00002000:00100000:1.0:1746065196.543658:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009f46aa00 x1830881263337856/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.543666:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46aa00 with x1830881263337856 ext(4194304->5013503) 00002000:00010000:1.0:1746065196.543671:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46aa00 00000100:00100000:1.0:1746065196.543703:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8569 00000100:00100000:1.0:1746065196.543710:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263337856:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.544955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.545766:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338112 00000100:00100000:1.0:1746065196.545773:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338112 00000100:00100000:1.0:1746065196.545852:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4366 00000100:00100000:1.0:1746065196.545859:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32119:x1830881263338112:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065196.546016:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32119:x1830881263338112:12345-192.168.202.46@tcp:35:cat.0 Request processed in 157us (1063us total) trans 8589944398 rc 0/0 00000100:00100000:1.0:1746065196.546022:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4366 00000100:00100000:1.0:1746065196.552915:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263337856:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9196us (9340us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065196.552928:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8569 00002000:00100000:1.0:1746065196.552939:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009f46aa00 x1830881263337856/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.552947:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46aa00 with x1830881263337856 ext(4194304->5013503) 00002000:00010000:1.0:1746065196.552952:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f46aa00 00000100:00100000:1.0:1746065196.565471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.565658:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338368 00000100:00100000:2.0:1746065196.565667:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338368 00000100:00100000:2.0:1746065196.565721:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4367 00000100:00100000:2.0:1746065196.565728:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:32121:x1830881263338368:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065196.566586:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:32121:x1830881263338368:12345-192.168.202.46@tcp:35:cat.0 Request processed in 856us (1119us total) trans 8589944399 rc 0/0 00000100:00100000:2.0:1746065196.566592:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4367 00000100:00100000:0.0:1746065196.619754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.620317:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338624 00000100:00100000:3.0:1746065196.620325:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338624 00000100:00100000:3.0:1746065196.620359:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10114 00000100:00100000:3.0:1746065196.620365:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:32128:x1830881263338624:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065196.620383:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.620396:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094a28400/0x14b4f8542d4fe890 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619f0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.620530:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620540:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620548:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620557:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620562:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620566:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620732:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620738:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620743:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065196.620750:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065196.620810:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620842:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620847:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620852:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927db400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065196.620855:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620860:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620868:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065196.620870:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065196.620873:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.620876:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe897 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.622060:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.622068:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.622072:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.622076:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927dac00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065196.622078:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.622083:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.622091:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669100) 00010000:00010000:3.0:1746065196.622093:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065196.622096:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.622099:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dac00/0x14b4f8542d4fe89e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.622139:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094a28400/0x14b4f8542d4fe890 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.622150:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 11 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.622155:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.622158:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065196.622160:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da600, rc 0) 00000100:00100000:3.0:1746065196.622218:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:32128:x1830881263338624:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1852us (2470us total) trans 8589944400 rc 0/0 00000100:00100000:3.0:1746065196.622225:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10114 00000100:00100000:0.0:1746065196.627986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.628237:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263338880 00000100:00100000:3.0:1746065196.628246:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263338880 00000100:00100000:3.0:1746065196.628298:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10115 00000100:00100000:3.0:1746065196.628306:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32129:x1830881263338880:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065196.628325:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.628339:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe8b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619f7 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.628429:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628441:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628450:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628461:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628466:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628471:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628557:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628565:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628571:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065196.628580:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065196.628654:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628660:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628665:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628670:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927dae00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065196.628674:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628679:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628701:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065196.628704:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065196.628708:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628712:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe8ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628722:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628730:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628735:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628739:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927db600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065196.628741:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628745:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628750:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669800) 00010000:00010000:3.0:1746065196.628752:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065196.628755:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628759:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.628792:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe8b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.628803:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.628808:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.628810:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065196.628812:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da000, rc 0) 00000100:00100000:3.0:1746065196.629609:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32129:x1830881263338880:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1301us (1629us total) trans 8589944401 rc 0/0 00000100:00100000:3.0:1746065196.629617:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10115 00000100:00100000:0.0:1746065196.683782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.683934:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339136 00000100:00100000:1.0:1746065196.683942:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339136 00002000:00100000:1.0:1746065196.683979:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (2084864->2088959) req@ffff880095352300 x1830881263339136/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.683988:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352300 with x1830881263339136 ext(2084864->2088959) 00002000:00010000:1.0:1746065196.683993:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352300 00000100:00100000:1.0:1746065196.684297:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8570 00000100:00100000:1.0:1746065196.684305:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+8:1959:x1830881263339136:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065196.684461:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+8:1959:x1830881263339136:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 156us (686us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065196.684467:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8570 00002000:00100000:1.0:1746065196.684472:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (2084864->2088959) req@ffff880095352300 x1830881263339136/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/4536 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.684479:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095352300 with x1830881263339136 ext(2084864->2088959) 00002000:00010000:1.0:1746065196.684482:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095352300 00000100:00100000:0.0:1746065196.688060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.688265:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339392 00000100:00100000:1.0:1746065196.688274:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339392 00000100:00100000:1.0:1746065196.688324:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4368 00000100:00100000:1.0:1746065196.688331:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:32128:x1830881263339392:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065196.688611:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:32128:x1830881263339392:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 279us (558us total) trans 8589944402 rc 0/0 00000100:00100000:1.0:1746065196.688617:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4368 00000100:00100000:0.0:1746065196.696209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.696271:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339520 00000100:00100000:2.0:1746065196.696279:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339520 00000100:00100000:2.0:1746065196.696333:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15187 00000100:00100000:2.0:1746065196.696341:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:32129:x1830881263339520:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065196.696357:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.696370:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e619fe expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.696394:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.696406:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.696407:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.696410:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1351680->2015231] (req 1351680->2015231) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.696434:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 7 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.696444:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 7 pid: 8851 timeout: 895 lvb_type: 0 00000100:00100000:2.0:1746065196.696454:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260455680:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.696531:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.701641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.701732:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260455680:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.701758:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1351680->2015231] (req 1351680->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.701774:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b4c00, rc 0) 00000100:00100000:2.0:1746065196.701808:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:32129:x1830881263339520:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5468us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.701841:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15187 00000100:00100000:1.0:1746065196.701921:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339648 00000100:00100000:1.0:1746065196.701927:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339648 00002000:00100000:1.0:1746065196.701957:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2088959) req@ffff88012ec8ad80 x1830881263339648/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.701965:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8ad80 with x1830881263339648 ext(1048576->2088959) 00010000:00010000:1.0:1746065196.701972:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 8 pid: 8851 timeout: 895 lvb_type: 0 00010000:00010000:1.0:1746065196.701984:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 8 pid: 8851 timeout: 895 lvb_type: 0 00002000:00010000:1.0:1746065196.701989:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ec8ad80 00000100:00100000:1.0:1746065196.702017:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2593 00000100:00100000:1.0:1746065196.702023:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263339648:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065196.742691:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263339648:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 40648us (41038us total) trans 17179873723 rc 0/0 00000100:00100000:0.0:1746065196.742703:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2593 00002000:00100000:0.0:1746065196.742714:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2088959) req@ffff88012ec8ad80 x1830881263339648/t17179873723(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/448 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.742723:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec8ad80 with x1830881263339648 ext(1048576->2088959) 00010000:00010000:0.0:1746065196.742732:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 10 pid: 8851 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065196.742747:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00002000:00010000:0.0:1746065196.742755:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ec8ad80 00000100:00100000:0.0:1746065196.746368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.746428:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263339776 00000100:00100000:3.0:1746065196.746436:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263339776 00010000:00010000:3.0:1746065196.746465:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065196.746499:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7817 00000100:00100000:3.0:1746065196.746505:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263339776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065196.746516:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065196.746532:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065196.746542:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065196.746560:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b0000/0x14b4f8542d4fe843 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1679359) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619a3 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065196.746583:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.746584:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065196.746590:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.746597:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.746620:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065196.746630:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260455808:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065196.748803:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065196.749863:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260455808:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065196.749882:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065196.749925:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263339776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3418us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.749935:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7817 00000100:00100000:0.0:1746065196.752925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.753708:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340032 00000100:00100000:2.0:1746065196.753716:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340032 00002000:00100000:2.0:1746065196.754536:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1351680->1355775) req@ffff88012ec88380 x1830881263340032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.754551:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec88380 with x1830881263340032 ext(1351680->1355775) 00002000:00010000:2.0:1746065196.754556:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec88380 00000100:00100000:2.0:1746065196.754578:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8571 00000100:00100000:2.0:1746065196.754587:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263340032:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065196.754772:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263340032:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 186us (1852us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065196.754779:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8571 00002000:00100000:2.0:1746065196.754785:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1351680->1355775) req@ffff88012ec88380 x1830881263340032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/4536 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.754792:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec88380 with x1830881263340032 ext(1351680->1355775) 00002000:00010000:2.0:1746065196.754795:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec88380 00000100:00100000:0.0:1746065196.765546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.766329:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340288 00000100:00100000:2.0:1746065196.766337:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340288 00002000:00100000:2.0:1746065196.766370:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (2011136->2015231) req@ffff88008ec2d880 x1830881263340288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.766380:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2d880 with x1830881263340288 ext(2011136->2015231) 00002000:00010000:2.0:1746065196.766384:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2d880 00000100:00100000:2.0:1746065196.766403:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8572 00000100:00100000:2.0:1746065196.766409:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263340288:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065196.766562:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263340288:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 152us (1023us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065196.766569:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8572 00002000:00100000:2.0:1746065196.766575:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (2011136->2015231) req@ffff88008ec2d880 x1830881263340288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/4536 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.766582:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2d880 with x1830881263340288 ext(2011136->2015231) 00002000:00010000:2.0:1746065196.766585:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2d880 00000100:00100000:1.0:1746065196.774727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.774895:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340544 00000100:00100000:2.0:1746065196.774903:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340544 00000100:00100000:2.0:1746065196.774953:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4369 00000100:00100000:2.0:1746065196.774960:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32129:x1830881263340544:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065196.775164:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:32129:x1830881263340544:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 205us (447us total) trans 8589944403 rc 0/0 00000100:00100000:2.0:1746065196.775171:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4369 00000100:00100000:0.0:1746065196.780497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.780609:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340800 00000100:00100000:3.0:1746065196.780616:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340800 00000100:00100000:3.0:1746065196.780652:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10116 00000100:00100000:3.0:1746065196.780659:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:32133:x1830881263340800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065196.780676:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.780701:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe8dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a05 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.780782:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.780794:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.780804:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065196.780813:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065196.780933:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe8dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.780971:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 256 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.780978:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.780981:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746065196.780983:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927db600, rc 0) 00000100:00100000:3.0:1746065196.781025:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:32133:x1830881263340800:12345-192.168.202.46@tcp:101:cat.0 Request processed in 366us (536us total) trans 8589944404 rc 0/0 00000100:00100000:3.0:1746065196.781031:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10116 00000100:00100000:0.0:1746065196.791672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.791837:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263340928 00000100:00100000:2.0:1746065196.791845:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263340928 00000100:00100000:2.0:1746065196.791885:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15188 00000100:00100000:2.0:1746065196.791892:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263340928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.791906:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.791920:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7b5800/0x14b4f8542d4fe8f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a0c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.791960:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260455936:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065196.792045:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.796846:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260455936:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065196.796876:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b5800/0x14b4f8542d4fe8f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a0c expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.796893:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b5800/0x14b4f8542d4fe8f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a0c expref: 23 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.796913:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b5800, rc 0) 00000100:00100000:2.0:1746065196.796960:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263340928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5068us (5296us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065196.796967:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15188 00000100:00100000:0.0:1746065196.804780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.804963:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341184 00000100:00100000:1.0:1746065196.804971:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341184 00002000:00100000:1.0:1746065196.805008:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009fa76300 x1830881263341184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.805018:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa76300 with x1830881263341184 ext(0->1048575) 00002000:00010000:1.0:1746065196.805024:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa76300 00000100:00100000:1.0:1746065196.805056:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8573 00000100:00100000:1.0:1746065196.805063:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263341184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.805261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.807262:0:24350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341440 00000100:00100000:2.0:1746065196.807270:0:24350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341440 00000100:00100000:2.0:1746065196.807310:0:24350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10117 00000100:00100000:2.0:1746065196.807316:0:24350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:32137:x1830881263341440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.807334:0:24350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.807348:0:24350:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4fe8f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a13 expref: -99 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.807422:0:24350:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.807433:0:24350:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24350 initiator: MDT0 00010000:00010000:2.0:1746065196.807442:0:24350:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24350 initiator: MDT0 00000004:00200000:2.0:1746065196.807450:0:24350:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065196.808434:0:24350:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b5200/0x14b4f8542d4fe8f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 15 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.808460:0:24350:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.808467:0:24350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065196.808470:0:24350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065196.808473:0:24350:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b4800, rc 0) 00000100:00100000:2.0:1746065196.808519:0:24350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:26bbd020-9fba-464a-bebc-8395a287959e+14:32137:x1830881263341440:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1203us (3258us total) trans 8589944405 rc 0/0 00000100:00100000:2.0:1746065196.808525:0:24350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10117 00000100:00100000:0.0:1746065196.814915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.815067:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341568 00000100:00100000:2.0:1746065196.815074:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341568 00000100:00100000:2.0:1746065196.815109:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15189 00000100:00100000:2.0:1746065196.815117:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263341568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.815132:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.815147:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7b5000/0x14b4f8542d4fe90e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a1a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065196.815194:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260456064:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065196.815246:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.826277:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260456064:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065196.826303:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b5000/0x14b4f8542d4fe90e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a1a expref: 10 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.826315:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b5000/0x14b4f8542d4fe90e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a1a expref: 10 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065196.826346:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b5000, rc 0) 00000100:00100000:2.0:1746065196.826385:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263341568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11268us (11476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065196.826393:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15189 00000100:00100000:1.0:1746065196.830516:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263341184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25447us (25737us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065196.830527:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8573 00002000:00100000:1.0:1746065196.830536:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009fa76300 x1830881263341184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.830544:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa76300 with x1830881263341184 ext(0->1048575) 00002000:00010000:1.0:1746065196.830550:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa76300 00000100:00100000:0.0:1746065196.831799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.832312:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341824 00000100:00100000:3.0:1746065196.832320:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341824 00000100:00100000:3.0:1746065196.837163:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10118 00000100:00100000:3.0:1746065196.837179:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:32139:x1830881263341824:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065196.837201:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.837217:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a21 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.837298:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.837309:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.837315:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 255 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.837321:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065196.837348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065196.837349:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 255 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.837359:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 255 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065196.837368:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260456192:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.837444:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.837451:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 15 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065196.837457:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260456320:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065196.837469:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.838912:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263341952 00000100:00100000:2.0:1746065196.838919:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263341952 00000100:00100000:2.0:1746065196.838964:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15190 00000100:00100000:2.0:1746065196.838971:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:32133:x1830881263341952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.838987:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.838998:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a28 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.839016:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.839022:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.839023:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.839026:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.839044:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 8 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.839051:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 8 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065196.839064:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260456448:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.839117:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065196.841490:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260456192:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065196.843526:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.843573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.843591:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342208 00000100:00100000:2.0:1746065196.843598:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342208 00010000:00010000:2.0:1746065196.843626:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 16 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065196.843643:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260456320:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.843645:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342080 00000100:00100000:2.0:1746065196.843647:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342080 00010000:00010000:2.0:1746065196.843656:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 256 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065196.843666:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065196.843679:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7818 00000100:00100000:2.0:1746065196.843694:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263342208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065196.843705:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065196.843710:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 16 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065196.843718:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 16 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065196.843731:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7819 00010000:00010000:2.0:1746065196.843736:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe8a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f0 expref: 16 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065196.843738:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1960:x1830881263342080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.843746:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.843750:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 256 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065196.843751:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065196.843754:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065196.843761:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065196.843766:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065196.843768:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 256 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065196.843779:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe8c8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619f7 expref: 256 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065196.843790:0:7080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065196.843793:0:7080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065196.843796:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263342208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (277us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065196.843799:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065196.843802:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7818 00010000:00010000:0.0:1746065196.843805:0:7080:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065196.843834:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065196.844000:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.844005:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065196.844021:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065196.844180:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.844206:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.844213:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.844215:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065196.844217:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927dae00, rc 0) 00000100:00100000:0.0:1746065196.844725:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1960:x1830881263342080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 985us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.844731:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7819 00000100:00100000:3.0:1746065196.845386:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:32139:x1830881263341824:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8212us (13589us total) trans 8589944406 rc 0/0 00000100:00100000:3.0:1746065196.845393:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10118 00000100:00100000:2.0:1746065196.847521:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260456448:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065196.847549:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.847566:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7b4000, rc 0) 00000100:00100000:2.0:1746065196.847614:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:32133:x1830881263341952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8642us (10266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.847621:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15190 00000100:00100000:1.0:1746065196.851049:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.851152:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342464 00000100:00100000:2.0:1746065196.851160:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342464 00002000:00100000:2.0:1746065196.851195:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1765376->2097151) req@ffff88012b623480 x1830881263342464/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.851202:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b623480 with x1830881263342464 ext(1765376->2097151) 00010000:00010000:2.0:1746065196.851210:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 9 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065196.851221:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 9 pid: 8851 timeout: 896 lvb_type: 0 00002000:00010000:2.0:1746065196.851232:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b623480 00000100:00100000:2.0:1746065196.851257:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2594 00000100:00100000:2.0:1746065196.851263:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263342464:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065196.851980:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260456960:0@lo:400:kworker.0 00000100:00100000:3.0:1746065196.852017:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065196.852039:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065196.852043:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3297:1830881260456576:0@lo:400:kworker.0 00000100:00100000:3.0:1746065196.852062:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065196.852090:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260457088:0@lo:400:kworker.0 00000100:00100000:3.0:1746065196.852105:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065196.852124:0:14642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260456576 00000100:00100000:3.0:1746065196.852127:0:14642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260456576 00000100:00100000:3.0:1746065196.852147:0:14642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1746065196.852152:0:14642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3297:x1830881260456576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065196.852179:0:14642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3297:x1830881260456576:12345-0@lo:400:kworker.0 Request processed in 27us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.852184:0:14642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1746065196.852214:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3297:1830881260456576:0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.852341:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1830881260456704:0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.852366:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.852380:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830881260457216:0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.852393:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.852405:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065196.852409:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830881260456832:0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.852422:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.852444:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260456704 00000100:00100000:0.0:1746065196.852447:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260456704 00000100:00100000:0.0:1746065196.852470:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457216 00000100:00100000:0.0:1746065196.852472:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457216 00000100:00100000:0.0:1746065196.852480:0:16767:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260456832 00000100:00100000:0.0:1746065196.852481:0:16767:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260456832 00000100:00100000:0.0:1746065196.852492:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1746065196.852497:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830881260456704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.852522:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830881260456704:12345-0@lo:400:kworker.0 Request processed in 25us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.852526:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1746065196.852540:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1746065196.852543:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830881260457216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.852560:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830881260457216:12345-0@lo:400:kworker.0 Request processed in 17us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.852564:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1746065196.852572:0:16767:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1746065196.852576:0:16767:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830881260456832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065196.852583:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260456960 00000100:00100000:2.0:1746065196.852587:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260456960 00000100:00100000:0.0:1746065196.852593:0:16767:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830881260456832:12345-0@lo:400:kworker.0 Request processed in 16us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.852597:0:16767:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1746065196.852604:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457088 00000100:00100000:2.0:1746065196.852606:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457088 00000100:00080000:0.0:1746065196.852608:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065196.852621:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1746065196.852622:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830881260456832:0@lo:400:kworker.0 00000100:00100000:2.0:1746065196.852626:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881260456960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.852629:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1830881260456704:0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.852634:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830881260457216:0@lo:400:kworker.0 00000100:00100000:2.0:1746065196.852652:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3297:x1830881260456960:12345-0@lo:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.852657:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1746065196.852667:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1746065196.852671:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260457088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065196.855985:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260457088:12345-0@lo:400:kworker.0 Request processed in 3306us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.855995:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1746065196.856002:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260456960:0@lo:400:kworker.0 00000100:00100000:3.0:1746065196.856025:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260457088:0@lo:400:kworker.0 00000100:00100000:0.0:1746065196.856091:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.856135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.856537:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342592 00000100:00100000:3.0:1746065196.856544:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342592 00002000:00100000:3.0:1746065196.856574:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880094a96a00 x1830881263342592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.856583:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96a00 with x1830881263342592 ext(0->1048575) 00002000:00010000:3.0:1746065196.856588:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a96a00 00000100:00100000:3.0:1746065196.856610:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342848 00000100:00100000:3.0:1746065196.856614:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342848 00002000:00100000:3.0:1746065196.856626:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1765375) req@ffff880094a94000 x1830881263342848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.856632:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94000 with x1830881263342848 ext(1048576->1765375) 00010000:00010000:3.0:1746065196.856639:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065196.856651:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065196.856657:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a94000 00000100:00100000:3.0:1746065196.856669:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2595 00000100:00100000:3.0:1746065196.856674:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263342848:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065196.858922:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8574 00000100:00100000:3.0:1746065196.858934:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263342592:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.868753:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260457344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065196.868808:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065196.869890:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457344 00000100:00100000:0.0:1746065196.869898:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457344 00000100:00100000:0.0:1746065196.869946:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1746065196.869957:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260457344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065196.869977:0:8430:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 623706112 pending 1703936 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746065196.870013:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260457344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.870018:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1746065196.870056:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260457344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065196.877573:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263342848:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20886us (21424us total) trans 0 rc 716800/716800 00000100:00100000:0.0:1746065196.877587:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2595 00002000:00100000:0.0:1746065196.877599:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1765375) req@ffff880094a94000 x1830881263342848/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 716800/716800 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.877608:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94000 with x1830881263342848 ext(1048576->1765375) 00010000:00010000:0.0:1746065196.877620:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065196.877634:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00002000:00010000:0.0:1746065196.877641:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a94000 00000100:00100000:2.0:1746065196.879897:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263342464:12345-192.168.202.46@tcp:4:cat.0 Request processed in 28625us (28846us total) trans 17179873724 rc 0/0 00000100:00100000:2.0:1746065196.879909:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2594 00002000:00100000:2.0:1746065196.879918:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1765376->2097151) req@ffff88012b623480 x1830881263342464/t17179873724(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/448 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.879927:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b623480 with x1830881263342464 ext(1765376->2097151) 00010000:00010000:2.0:1746065196.879935:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065196.879950:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00002000:00010000:2.0:1746065196.879956:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b623480 00000100:00100000:3.0:1746065196.882522:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263342592:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23582us (26424us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.882532:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8574 00002000:00100000:3.0:1746065196.882541:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880094a96a00 x1830881263342592/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.882549:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96a00 with x1830881263342592 ext(0->1048575) 00002000:00010000:3.0:1746065196.882553:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a96a00 00000100:00100000:2.0:1746065196.882777:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.882797:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263342976 00000100:00100000:1.0:1746065196.882804:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263342976 00010000:00010000:1.0:1746065196.882854:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065196.882877:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7820 00000100:00100000:1.0:1746065196.882884:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263342976:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065196.882895:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065196.882911:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065196.882921:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065196.882943:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff54800/0x14b4f8542d4fe835 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61995 expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065196.882972:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065196.882974:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065196.882980:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.882988:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065196.883018:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 22 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065196.883029:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260457472:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065196.883090:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.890256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.890481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.890530:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260457472:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065196.890543:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343104 00000100:00100000:2.0:1746065196.890548:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343104 00010000:00010000:1.0:1746065196.890550:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065196.890579:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15191 00000100:00100000:2.0:1746065196.890584:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:32137:x1830881263343104:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065196.890586:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263342976:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7702us (7808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065196.890595:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7820 00010000:00010000:2.0:1746065196.890598:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.890609:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a2f expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.890629:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.890630:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065196.890636:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.890648:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.890657:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c8f800, rc 0) 00000100:00100000:0.0:1746065196.890859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.891111:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:32137:x1830881263343104:12345-192.168.202.46@tcp:101:cat.0 Request processed in 524us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065196.891120:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15191 00000100:00100000:3.0:1746065196.891351:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343360 00000100:00100000:3.0:1746065196.891355:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343360 00002000:00100000:3.0:1746065196.891380:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880094a96d80 x1830881263343360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.891389:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96d80 with x1830881263343360 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.891393:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a96d80 00000100:00100000:3.0:1746065196.891414:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343616 00000100:00100000:3.0:1746065196.891417:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343616 00002000:00100000:3.0:1746065196.891428:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008fd04e00 x1830881263343616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 504/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.891434:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04e00 with x1830881263343616 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.891437:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04e00 00000100:00100000:1.0:1746065196.891445:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8575 00000100:00100000:3.0:1746065196.891451:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8576 00000100:00100000:1.0:1746065196.891452:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263343360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065196.891456:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263343616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065196.899603:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263343616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8136us (8736us total) trans 0 rc 385024/385024 00000100:00100000:3.0:1746065196.899615:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8576 00002000:00100000:3.0:1746065196.899625:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008fd04e00 x1830881263343616/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 504/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 385024/385024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.899634:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd04e00 with x1830881263343616 ext(1048576->2097151) 00002000:00010000:3.0:1746065196.899640:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd04e00 00000100:00100000:0.0:1746065196.900441:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263343360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8988us (9959us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065196.900448:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8575 00002000:00100000:0.0:1746065196.900453:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880094a96d80 x1830881263343360/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.900461:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a96d80 with x1830881263343360 ext(1048576->2097151) 00002000:00010000:0.0:1746065196.900464:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a96d80 00000100:00100000:0.0:1746065196.915603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.915720:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263343872 00000100:00100000:2.0:1746065196.915729:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263343872 00002000:00100000:2.0:1746065196.915767:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012d134000 x1830881263343872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.915776:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134000 with x1830881263343872 ext(1048576->2097151) 00002000:00010000:2.0:1746065196.915781:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d134000 00000100:00100000:2.0:1746065196.915809:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8577 00000100:00100000:2.0:1746065196.915835:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263343872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065196.916917:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065196.916932:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260457600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065196.916970:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065196.917062:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260457600 00000100:00100000:3.0:1746065196.917066:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260457600 00000100:00100000:3.0:1746065196.917089:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1746065196.917094:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881260457600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746065196.917108:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 604831744 pending 5111808 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746065196.917137:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881260457600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.917142:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1746065196.917219:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260457600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065196.933299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.934174:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263343872:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18354us (18573us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065196.934184:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8577 00002000:00100000:1.0:1746065196.934195:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012d134000 x1830881263343872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065196.934203:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134000 with x1830881263343872 ext(1048576->2097151) 00002000:00010000:1.0:1746065196.934208:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d134000 00000100:00100000:3.0:1746065196.934694:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344128 00000100:00100000:3.0:1746065196.934702:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344128 00000100:00100000:1.0:1746065196.937051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065196.937074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.937168:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10119 00000100:00100000:3.0:1746065196.937182:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:32141:x1830881263344128:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065196.937207:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065196.937223:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a36 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.937328:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937339:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937349:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937363:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937367:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937371:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937448:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937453:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937459:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065196.937466:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065196.937533:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937539:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937544:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937549:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927da400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065196.937553:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937558:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937567:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065196.937569:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065196.937573:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937577:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe93f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00000100:00100000:1.0:1746065196.937661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065196.937707:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937712:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937716:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937720:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927da000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065196.937722:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937727:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937735:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669400) 00010000:00010000:3.0:1746065196.937736:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065196.937738:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937742:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da000/0x14b4f8542d4fe946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065196.937778:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.937789:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.937795:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065196.937797:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065196.937798:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da600, rc 0) 00000100:00100000:3.0:1746065196.937853:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:32141:x1830881263344128:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 676us (4561us total) trans 8589944407 rc 0/0 00000100:00100000:3.0:1746065196.937859:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10119 00000100:00100000:1.0:1746065196.938122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065196.938135:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344384 00000100:00100000:0.0:1746065196.938142:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344384 00002000:00100000:0.0:1746065196.938182:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012bd3f480 x1830881263344384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.938191:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f480 with x1830881263344384 ext(2097152->3145727) 00002000:00010000:0.0:1746065196.938195:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3f480 00000100:00100000:0.0:1746065196.938209:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344640 00000100:00100000:0.0:1746065196.938211:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344640 00002000:00100000:0.0:1746065196.938221:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012bd3e680 x1830881263344640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.938227:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e680 with x1830881263344640 ext(3145728->4194303) 00002000:00010000:0.0:1746065196.938230:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3e680 00000100:00100000:0.0:1746065196.938243:0:21483:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263344896 00000100:00100000:0.0:1746065196.938245:0:21483:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263344896 00002000:00100000:0.0:1746065196.938258:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012bd3d500 x1830881263344896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.938264:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d500 with x1830881263344896 ext(2097152->3145727) 00002000:00010000:0.0:1746065196.938267:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3d500 00000100:00100000:0.0:1746065196.938276:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8578 00000100:00100000:0.0:1746065196.938280:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263344384:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.939806:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8579 00000100:00100000:0.0:1746065196.939838:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263344640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065196.942447:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8580 00000100:00100000:0.0:1746065196.942460:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263344896:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065196.948585:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345152 00000100:00100000:2.0:1746065196.948597:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345152 00002000:00100000:2.0:1746065196.948635:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012bd3f100 x1830881263345152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.948644:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f100 with x1830881263345152 ext(3145728->4194303) 00002000:00010000:2.0:1746065196.948649:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3f100 00000100:00100000:2.0:1746065196.948667:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8581 00000100:00100000:2.0:1746065196.948674:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263345152:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065196.955426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065196.955515:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345280 00000100:00100000:2.0:1746065196.955524:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345280 00000100:00100000:2.0:1746065196.955567:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15192 00000100:00100000:2.0:1746065196.955574:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:32137:x1830881263345280:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065196.955591:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065196.955607:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a3d expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.955632:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.955638:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.955640:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065196.955643:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.955667:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 26 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065196.955676:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 26 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065196.955696:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260457728:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065196.955771:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065196.976433:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263344384:12345-192.168.202.46@tcp:3:cat.0 Request processed in 38140us (39380us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.976445:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8578 00002000:00100000:2.0:1746065196.976458:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012bd3f480 x1830881263344384/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.976467:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f480 with x1830881263344384 ext(2097152->3145727) 00002000:00010000:2.0:1746065196.976473:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3f480 00000100:00100000:3.0:1746065196.976874:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260457728:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065196.976899:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 12 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065196.976913:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a0d200, rc 0) 00000100:00100000:3.0:1746065196.976950:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:32137:x1830881263345280:12345-192.168.202.46@tcp:101:cat.0 Request processed in 21376us (21532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065196.976956:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15192 00000100:00100000:3.0:1746065196.980249:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263344640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 40428us (43165us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065196.980258:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8579 00002000:00100000:3.0:1746065196.980266:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012bd3e680 x1830881263344640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.980274:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3e680 with x1830881263344640 ext(3145728->4194303) 00002000:00010000:3.0:1746065196.980279:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3e680 00000100:00100000:0.0:1746065196.982398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065196.982462:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345408 00000100:00100000:3.0:1746065196.982470:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345408 00002000:00100000:3.0:1746065196.982505:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1351680->2015231) req@ffff88012d134380 x1830881263345408/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065196.982514:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134380 with x1830881263345408 ext(1351680->2015231) 00010000:00010000:3.0:1746065196.982524:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 27 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065196.982537:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 27 pid: 8851 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065196.982543:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d134380 00000100:00100000:3.0:1746065196.982573:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2596 00000100:00100000:3.0:1746065196.982580:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263345408:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065196.985299:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263344896:12345-192.168.202.46@tcp:3:cat.0 Request processed in 42835us (47630us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.985309:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8580 00002000:00100000:2.0:1746065196.985318:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012bd3d500 x1830881263344896/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.985327:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3d500 with x1830881263344896 ext(2097152->3145727) 00002000:00010000:2.0:1746065196.985331:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3d500 00000100:00100000:2.0:1746065196.989757:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263345152:12345-192.168.202.46@tcp:3:cat.0 Request processed in 41075us (51626us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065196.989767:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8581 00002000:00100000:2.0:1746065196.989778:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012bd3f100 x1830881263345152/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065196.989786:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f100 with x1830881263345152 ext(3145728->4194303) 00002000:00010000:2.0:1746065196.989791:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bd3f100 00000100:00100000:0.0:1746065197.005229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.005554:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263345408:12345-192.168.202.46@tcp:4:cat.0 Request processed in 22971us (23159us total) trans 17179873725 rc 0/0 00000100:00100000:3.0:1746065197.005564:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2596 00002000:00100000:3.0:1746065197.005576:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1351680->2015231) req@ffff88012d134380 x1830881263345408/t17179873725(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:112/0 lens 488/448 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.005585:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134380 with x1830881263345408 ext(1351680->2015231) 00010000:00010000:3.0:1746065197.005593:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.005605:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065197.005617:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d134380 00000100:00100000:3.0:1746065197.005642:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345536 00000100:00100000:3.0:1746065197.005647:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345536 00000100:00100000:3.0:1746065197.006578:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15193 00000100:00100000:3.0:1746065197.006587:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263345536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.006601:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.006615:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3efc00/0x14b4f8542d4fe962 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a44 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.006656:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260457856:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065197.007339:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.007416:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.007470:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345664 00000100:00100000:1.0:1746065197.007475:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345664 00000100:00100000:1.0:1746065197.007499:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15194 00000100:00100000:1.0:1746065197.007504:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+9:32139:x1830881263345664:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065197.007511:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.007522:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a4b expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.007538:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.007546:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.007551:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.007553:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.007555:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 10 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.007572:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 10 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.007581:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.007589:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260457984:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.008298:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.008308:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 14 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.008315:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260458112:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.008336:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.009131:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260457856:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065197.009156:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3efc00/0x14b4f8542d4fe962 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a44 expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.009167:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3efc00/0x14b4f8542d4fe962 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a44 expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.009312:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3efc00, rc 0) 00000100:00100000:3.0:1746065197.009336:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263345536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2751us (4114us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065197.009342:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15193 00000100:00100000:0.0:1746065197.013132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.013419:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345792 00000100:00100000:1.0:1746065197.013426:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345792 00010000:00010000:1.0:1746065197.013455:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.013514:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7821 00000100:00100000:1.0:1746065197.013520:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881263345792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.013531:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.013550:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.013560:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.013580:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4c00/0x14b4f8542d4fe8d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->2015231) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619fe expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.013596:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.013598:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.013604:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.013611:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.013639:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.013650:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260458240:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065197.013718:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.013784:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260457984:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.013791:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260458112:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.014928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.015129:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346048 00000100:00100000:1.0:1746065197.015134:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346048 00000100:00100000:1.0:1746065197.015162:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15195 00000100:00100000:1.0:1746065197.015168:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:32141:x1830881263346048:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065197.015182:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.015197:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a52 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.015216:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.015222:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.015227:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.015228:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.015231:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3624960->4194303] (req 3624960->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 26 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.015248:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 26 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.015256:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 26 pid: 8851 timeout: 896 lvb_type: 1 00000100:00100000:1.0:1746065197.015263:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260458368:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.015310:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.015318:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 11 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.015325:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260458496:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.015342:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065197.015460:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 10 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.015471:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a3200, rc 0) 00000100:00100000:2.0:1746065197.015493:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:26bbd020-9fba-464a-bebc-8395a287959e+10:32139:x1830881263345664:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7989us (8077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.015498:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15194 00000100:00100000:0.0:1746065197.018053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.018087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.018119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.018165:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346304 00000100:00100000:1.0:1746065197.018173:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346304 00000100:00100000:2.0:1746065197.018174:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346176 00000100:00100000:2.0:1746065197.018178:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346176 00000100:00100000:3.0:1746065197.018231:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263345920 00000100:00100000:3.0:1746065197.018236:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263345920 00010000:00010000:3.0:1746065197.018253:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.018271:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7822 00000100:00100000:3.0:1746065197.018277:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263345920:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.018286:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.018303:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.018311:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.018329:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec46c00/0x14b4f8542d4fe866 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619c6 expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.018420:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.018447:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263345920:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 170us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.018452:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7822 00000100:00100000:2.0:1746065197.018506:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15196 00000100:00100000:2.0:1746065197.018512:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263346304:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:1.0:1746065197.018512:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15197 00000100:00100000:1.0:1746065197.018520:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263346176:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.018523:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.018528:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.018531:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe977 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a60 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.018536:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a59 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.018545:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.018549:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.018551:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe977 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a60 expref: 16 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.018551:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.018557:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 28 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.018559:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927da400/0x14b4f8542d4fe977 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a60 expref: 16 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.018569:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 28 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.018575:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f5d800, rc 0) 00010000:00010000:2.0:1746065197.018577:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da400, rc 0) 00000100:00100000:1.0:1746065197.018594:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881263346176:12345-192.168.202.46@tcp:101:cat.0 Request processed in 76us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.018598:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263346304:12345-192.168.202.46@tcp:101:cat.0 Request processed in 86us (510us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065197.018599:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15197 00000100:00100000:2.0:1746065197.018602:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15196 00000100:00100000:0.0:1746065197.021467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.021489:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346560 00000100:00100000:0.0:1746065197.021496:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346560 00002000:00100000:0.0:1746065197.021528:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012d137800 x1830881263346560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.021536:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137800 with x1830881263346560 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.021541:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d137800 00000100:00100000:0.0:1746065197.021573:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8582 00000100:00100000:0.0:1746065197.021580:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263346560:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065197.022014:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260458368:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.022025:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260458496:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.022051:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3624960->4194303] (req 3624960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.022069:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f08d800, rc 0) 00000100:00100000:1.0:1746065197.022109:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:32141:x1830881263346048:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6941us (7182us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.022115:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15195 00000100:00100000:1.0:1746065197.022213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.022230:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346688 00000100:00100000:1.0:1746065197.022233:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346688 00000100:00100000:1.0:1746065197.022250:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15198 00000100:00100000:1.0:1746065197.022254:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:32133:x1830881263346688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065197.022263:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.022275:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a67 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.022288:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.022289:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.022295:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.022305:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.022311:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f5d200, rc 0) 00000100:00100000:1.0:1746065197.022325:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:32133:x1830881263346688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 71us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.022329:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15198 00000100:00100000:2.0:1746065197.022585:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7080:1830881260458240:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065197.022599:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.022621:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263345792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9100us (9495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.022628:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7821 00010000:00010000:0.0:1746065197.028219:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065197.032266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.032692:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346944 00000100:00100000:1.0:1746065197.032700:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346944 00000100:00100000:1.0:1746065197.033312:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15199 00000100:00100000:1.0:1746065197.033321:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881263346944:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065197.033337:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.033352:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fe98c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a6e expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.033372:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.033383:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fe98c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a6e expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.033393:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a7600/0x14b4f8542d4fe98c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a6e expref: 17 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.033409:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a7600, rc 0) 00000100:00100000:0.0:1746065197.033567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.033841:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347072 00000100:00100000:2.0:1746065197.033847:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347072 00000100:00100000:2.0:1746065197.033871:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15200 00000100:00100000:2.0:1746065197.033876:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263347072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.033888:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.033898:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4fe993 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a75 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.033909:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.033915:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4fe993 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a75 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.033922:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927da000/0x14b4f8542d4fe993 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a75 expref: 27 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065197.034893:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881263346944:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1568us (2630us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065197.034900:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15199 00010000:00010000:2.0:1746065197.035069:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da000, rc 0) 00000100:00100000:2.0:1746065197.035104:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263347072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1228us (1537us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065197.035114:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15200 00000100:00100000:3.0:1746065197.036741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.037060:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263346560:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 15479us (15598us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065197.037069:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8582 00002000:00100000:0.0:1746065197.037079:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012d137800 x1830881263346560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.037087:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d137800 with x1830881263346560 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.037092:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d137800 00000100:00100000:3.0:1746065197.037435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.037450:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347200 00000100:00100000:3.0:1746065197.037455:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347200 00010000:00010000:3.0:1746065197.037478:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 16 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.037496:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263346816 00000100:00100000:3.0:1746065197.037499:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263346816 00010000:00010000:3.0:1746065197.037509:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 26 pid: 8851 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.038325:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7823 00000100:00100000:3.0:1746065197.038335:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263347200:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.038347:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.038366:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 16 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.038377:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 16 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.038396:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fe85f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619bf expref: 16 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.038411:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.038413:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.038419:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 8 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.038426:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 8 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.038451:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 8 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.038461:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260458624:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065197.038509:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065197.038936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.040080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.040260:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347328 00000100:00100000:2.0:1746065197.040267:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347328 00000100:00100000:2.0:1746065197.040283:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7824 00000100:00100000:2.0:1746065197.040291:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263346816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.040302:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.040321:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 26 pid: 8851 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.040327:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347584 00010000:00010000:2.0:1746065197.040331:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 26 pid: 8851 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.040331:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347584 00010000:00010000:2.0:1746065197.040346:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d500400/0x14b4f8542d4fe87b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619db expref: 26 pid: 8851 timeout: 896 lvb_type: 1 00002000:00100000:0.0:1746065197.040355:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88012bd3f800 x1830881263347584/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065197.040357:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746065197.040362:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f800 with x1830881263347584 ext(5009408->5013503) 00002000:00010000:0.0:1746065197.040365:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3f800 00000100:00100000:0.0:1746065197.040379:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8583 00000100:00100000:0.0:1746065197.040384:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263347584:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.040393:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263346816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 104us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.040398:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7824 00010000:00010000:2.0:1746065197.040424:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 12 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.040439:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7825 00000100:00100000:2.0:1746065197.040443:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263347328:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.040448:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.040454:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 12 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.040461:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 12 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.040471:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944f3200/0x14b4f8542d4fe84a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e619aa expref: 12 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.040478:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.040480:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.040484:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.040491:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.040494:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263347584:12345-192.168.202.46@tcp:3:cat.0 Request processed in 110us (416us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065197.040500:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8583 00002000:00100000:0.0:1746065197.040504:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88012bd3f800 x1830881263347584/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.040510:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bd3f800 with x1830881263347584 ext(5009408->5013503) 00010000:00010000:2.0:1746065197.040511:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.040512:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bd3f800 00000100:00100000:2.0:1746065197.040520:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260458752:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065197.040566:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.041552:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260458624:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065197.041566:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.041631:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263347200:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3297us (4893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.041637:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7823 00000100:00100000:0.0:1746065197.045534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.045574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.045605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.045705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.045730:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347840 00000100:00100000:0.0:1746065197.045737:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347840 00002000:00100000:0.0:1746065197.045771:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (2224128->2228223) req@ffff88012d135c00 x1830881263347840/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.045780:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135c00 with x1830881263347840 ext(2224128->2228223) 00002000:00010000:0.0:1746065197.045784:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d135c00 00000100:00100000:0.0:1746065197.045797:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348352 00000100:00100000:0.0:1746065197.045799:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348352 00002000:00100000:0.0:1746065197.045809:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3624960->3629055) req@ffff880129b0ea00 x1830881263348352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.045836:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ea00 with x1830881263348352 ext(3624960->3629055) 00002000:00010000:0.0:1746065197.045839:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0ea00 00000100:00100000:0.0:1746065197.045857:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8584 00000100:00100000:0.0:1746065197.045863:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263347840:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065197.046001:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263347840:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 137us (474us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065197.046006:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8584 00002000:00100000:0.0:1746065197.046011:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x383:0x0] (2224128->2228223) req@ffff88012d135c00 x1830881263347840/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.046018:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d135c00 with x1830881263347840 ext(2224128->2228223) 00002000:00010000:0.0:1746065197.046020:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d135c00 00000100:00100000:0.0:1746065197.046035:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8585 00000100:00100000:0.0:1746065197.046040:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881263348352:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065197.046106:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881263348352:12345-192.168.202.46@tcp:3:cat.0 Request processed in 62us (399us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065197.046111:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8585 00002000:00100000:0.0:1746065197.046115:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x389:0x0] (3624960->3629055) req@ffff880129b0ea00 x1830881263348352/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.046121:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0ea00 with x1830881263348352 ext(3624960->3629055) 00002000:00010000:0.0:1746065197.046124:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129b0ea00 00000100:00100000:2.0:1746065197.046288:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260458752:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065197.046303:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.046321:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263347328:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5877us (7386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.046327:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7825 00000100:00100000:2.0:1746065197.046347:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263347968 00000100:00100000:2.0:1746065197.046350:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263347968 00000100:00100000:2.0:1746065197.046360:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348096 00000100:00100000:2.0:1746065197.046362:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348096 00000100:00100000:2.0:1746065197.046370:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15201 00000100:00100000:2.0:1746065197.046374:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263347968:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.046381:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.046392:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe99a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a7c expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.046416:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe99a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a7c expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.046425:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe99a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a7c expref: 10 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.046442:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927db200, rc 0) 00000100:00100000:2.0:1746065197.046457:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263347968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 82us (883us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065197.046462:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15201 00000100:00100000:2.0:1746065197.046471:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15202 00000100:00100000:2.0:1746065197.046476:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263348096:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.046482:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.046488:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4fe9a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a83 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065197.046518:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260458880:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065197.046558:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.049212:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260458880:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065197.049239:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4fe9a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a83 expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.049251:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927da400/0x14b4f8542d4fe9a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a83 expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.049262:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927da400, rc 0) 00000100:00100000:2.0:1746065197.049295:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263348096:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2818us (3689us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065197.049301:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15202 00000100:00100000:0.0:1746065197.053867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.053985:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348480 00000100:00100000:2.0:1746065197.053992:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348480 00000100:00100000:2.0:1746065197.054027:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15203 00000100:00100000:2.0:1746065197.054033:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:32141:x1830881263348480:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065197.054049:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.054064:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a8a expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.054090:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.054097:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065197.054098:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065197.054101:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4263935] (req 4194304->4263935) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.054124:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.054134:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.054145:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260459008:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.054211:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.060289:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260459008:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.060314:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4263935] (req 4194304->4263935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.060334:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927db400, rc 0) 00000100:00100000:2.0:1746065197.060385:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:32141:x1830881263348480:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6350us (6525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.060392:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15203 00000100:00100000:1.0:1746065197.061063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.061109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.061164:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348864 00000100:00100000:3.0:1746065197.061170:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348864 00010000:00010000:3.0:1746065197.061195:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.061214:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7826 00000100:00100000:3.0:1746065197.061220:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263348864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.061229:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.061247:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.061257:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.061278:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f5d200/0x14b4f8542d4fe985 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2957312->18446744073709551615] (req 5009408->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a67 expref: 16 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.061303:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.061305:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.061311:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.061322:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.061345:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.061355:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260459136:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065197.061405:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.061568:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263348736 00000100:00100000:2.0:1746065197.061572:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263348736 00002000:00100000:2.0:1746065197.061596:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2953216->2957311) req@ffff8800a5883800 x1830881263348736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.061604:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883800 with x1830881263348736 ext(2953216->2957311) 00002000:00010000:2.0:1746065197.061608:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5883800 00000100:00100000:2.0:1746065197.061621:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8586 00000100:00100000:2.0:1746065197.061626:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263348736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.061745:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263348736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 118us (682us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065197.061749:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8586 00002000:00100000:2.0:1746065197.061753:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2953216->2957311) req@ffff8800a5883800 x1830881263348736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.061759:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5883800 with x1830881263348736 ext(2953216->2957311) 00002000:00010000:2.0:1746065197.061761:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5883800 00000100:00100000:0.0:1746065197.064606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.064697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.064768:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349248 00000100:00100000:2.0:1746065197.064777:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349248 00000100:00100000:2.0:1746065197.064811:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15204 00000100:00100000:2.0:1746065197.064841:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:32137:x1830881263349248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.064856:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.064870:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a91 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.064893:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 10 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.064900:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065197.064901:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065197.064904:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.064926:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 10 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.064939:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 10 pid: 2463 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.064949:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260459264:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.065022:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.065038:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349120 00000100:00100000:2.0:1746065197.065041:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349120 00002000:00100000:2.0:1746065197.065064:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (4259840->4263935) req@ffff88009f9cea00 x1830881263349120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.065071:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cea00 with x1830881263349120 ext(4259840->4263935) 00000100:00100000:3.0:1746065197.065664:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260459136:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065197.065691:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.065713:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263348864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4493us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.065721:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7826 00002000:00010000:2.0:1746065197.066106:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cea00 00000100:00100000:3.0:1746065197.066550:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8587 00000100:00100000:3.0:1746065197.066558:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263349120:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.066872:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263349120:12345-192.168.202.46@tcp:3:cat.0 Request processed in 315us (2274us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065197.066878:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8587 00002000:00100000:3.0:1746065197.066883:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (4259840->4263935) req@ffff88009f9cea00 x1830881263349120/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.066890:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9cea00 with x1830881263349120 ext(4259840->4263935) 00002000:00010000:3.0:1746065197.066894:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9cea00 00000100:00100000:0.0:1746065197.071928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.073401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.073670:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349632 00000100:00100000:2.0:1746065197.073691:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349632 00000100:00100000:2.0:1746065197.073954:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4370 00000100:00100000:2.0:1746065197.073961:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:32141:x1830881263349632:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:3.0:1746065197.074127:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349376 00000100:00100000:3.0:1746065197.074132:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349376 00002000:00100000:3.0:1746065197.074155:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2224128->2957311) req@ffff88012d7fdf80 x1830881263349376/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.074165:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fdf80 with x1830881263349376 ext(2224128->2957311) 00010000:00010000:3.0:1746065197.074172:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 11 pid: 2463 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.074173:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:32141:x1830881263349632:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 211us (774us total) trans 8589944408 rc 0/0 00000100:00100000:2.0:1746065197.074180:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4370 00010000:00010000:3.0:1746065197.074184:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 11 pid: 2463 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065197.074191:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d7fdf80 00000100:00100000:3.0:1746065197.074204:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2597 00000100:00100000:3.0:1746065197.074209:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263349376:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:2.0:1746065197.074216:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260459264:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.074234:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.074247:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927db200, rc 0) 00000100:00100000:2.0:1746065197.074265:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:32137:x1830881263349248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9426us (9569us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.074271:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15204 00000100:00100000:3.0:1746065197.100119:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263349376:12345-192.168.202.46@tcp:4:cat.0 Request processed in 25899us (28188us total) trans 21474841013 rc 0/0 00000100:00100000:3.0:1746065197.100131:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2597 00002000:00100000:3.0:1746065197.100144:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2224128->2957311) req@ffff88012d7fdf80 x1830881263349376/t21474841013(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/448 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.100153:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fdf80 with x1830881263349376 ext(2224128->2957311) 00010000:00010000:3.0:1746065197.100162:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 12 pid: 2463 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.100176:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 12 pid: 2463 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065197.100186:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d7fdf80 00000100:00100000:0.0:1746065197.103455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.103546:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263349760 00000100:00100000:3.0:1746065197.103554:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263349760 00010000:00010000:3.0:1746065197.103582:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 12 pid: 2463 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.103888:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7827 00000100:00100000:3.0:1746065197.103895:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263349760:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.103906:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065197.103922:0:8444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065197 -> 1746065198 00002000:00010000:3.0:1746065197.103924:0:8444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065197 -> 1746065198 00010000:00010000:3.0:1746065197.103929:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 12 pid: 2463 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.103939:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 12 pid: 2463 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.103958:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4fe969 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2224128->2957311] (req 2224128->2957311) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a4b expref: 12 pid: 2463 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.103993:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.103995:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.104001:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.104008:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.104033:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.104044:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260459392:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065197.104246:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.109987:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260459392:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065197.110006:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.110039:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263349760:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6144us (6592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.110048:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7827 00000100:00100000:0.0:1746065197.112952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.113038:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350016 00000100:00100000:3.0:1746065197.113046:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350016 00002000:00100000:3.0:1746065197.113081:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012d7fed80 x1830881263350016/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.113090:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fed80 with x1830881263350016 ext(2097152->3145727) 00002000:00010000:3.0:1746065197.113095:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fed80 00000100:00100000:3.0:1746065197.113120:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8588 00000100:00100000:3.0:1746065197.113125:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263350016:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.120651:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263350016:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7518us (7697us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.120660:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8588 00002000:00100000:3.0:1746065197.120669:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012d7fed80 x1830881263350016/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.120692:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fed80 with x1830881263350016 ext(2097152->3145727) 00002000:00010000:3.0:1746065197.120696:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fed80 00000100:00100000:0.0:1746065197.123927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.124038:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350144 00000100:00100000:2.0:1746065197.124045:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350144 00000100:00100000:2.0:1746065197.124082:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15205 00000100:00100000:2.0:1746065197.124089:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:32137:x1830881263350144:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.124103:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.124117:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a98 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.124142:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.124153:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065197.124155:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065197.124159:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.124184:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.124195:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 24 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.124206:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260459520:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.124421:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d3000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.125587:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260459520:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.125606:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.125617:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3efe00, rc 0) 00000100:00100000:3.0:1746065197.125643:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:32137:x1830881263350144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1555us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.125650:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15205 00000100:00100000:0.0:1746065197.128052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.128116:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350272 00000100:00100000:3.0:1746065197.128124:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350272 00002000:00100000:3.0:1746065197.128160:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3624960->4194303) req@ffff88009f210380 x1830881263350272/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.128168:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f210380 with x1830881263350272 ext(3624960->4194303) 00010000:00010000:3.0:1746065197.128176:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 25 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.128189:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 25 pid: 25185 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065197.128195:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f210380 00000100:00100000:3.0:1746065197.128889:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2598 00000100:00100000:3.0:1746065197.128897:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263350272:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065197.137931:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263350272:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9027us (9878us total) trans 17179873726 rc 0/0 00000100:00100000:3.0:1746065197.137941:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2598 00002000:00100000:3.0:1746065197.137950:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3624960->4194303) req@ffff88009f210380 x1830881263350272/t17179873726(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/448 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.137958:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f210380 with x1830881263350272 ext(3624960->4194303) 00010000:00010000:3.0:1746065197.137966:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 27 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.137980:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 27 pid: 25185 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065197.137987:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f210380 00000100:00100000:0.0:1746065197.141457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.141538:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350400 00000100:00100000:3.0:1746065197.141546:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350400 00010000:00010000:3.0:1746065197.141572:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 27 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.142891:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7828 00000100:00100000:0.0:1746065197.142902:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263350400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.142917:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065197.142935:0:7079:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065197 -> 1746065198 00002000:00010000:0.0:1746065197.142938:0:7079:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065197 -> 1746065198 00010000:00010000:0.0:1746065197.142944:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 27 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.142956:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 27 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.142975:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f08d800/0x14b4f8542d4fe970 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3624960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a52 expref: 27 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.143006:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.143008:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.143014:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.143021:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.143048:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.143058:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f210700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260459648:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065197.143133:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.147695:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f210700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260459648:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065197.147719:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.147754:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263350400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4854us (6304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.147763:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7828 00000100:00100000:0.0:1746065197.158118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.158442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.159140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.159236:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350656 00000100:00100000:3.0:1746065197.159244:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350656 00002000:00100000:3.0:1746065197.159280:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009f210a80 x1830881263350656/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.159288:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f210a80 with x1830881263350656 ext(2097152->3145727) 00002000:00010000:3.0:1746065197.159293:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f210a80 00000100:00100000:3.0:1746065197.159310:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263350912 00000100:00100000:3.0:1746065197.159312:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263350912 00002000:00100000:3.0:1746065197.159320:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009f210e00 x1830881263350912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.159326:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f210e00 with x1830881263350912 ext(3145728->4194303) 00002000:00010000:3.0:1746065197.159329:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f210e00 00000100:00100000:3.0:1746065197.159335:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351168 00000100:00100000:3.0:1746065197.159337:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351168 00002000:00100000:3.0:1746065197.159345:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f211180 x1830881263351168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.159351:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f211180 with x1830881263351168 ext(3145728->4194303) 00002000:00010000:3.0:1746065197.159353:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f211180 00000100:00100000:3.0:1746065197.159369:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8589 00000100:00100000:3.0:1746065197.159375:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263350656:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.160418:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8590 00000100:00100000:3.0:1746065197.160424:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263350912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.162596:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8591 00000100:00100000:3.0:1746065197.162608:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263351168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.179341:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263350656:12345-192.168.202.46@tcp:3:cat.0 Request processed in 19957us (21223us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.179352:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8589 00002000:00100000:3.0:1746065197.179361:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009f210a80 x1830881263350656/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.179368:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f210a80 with x1830881263350656 ext(2097152->3145727) 00002000:00010000:3.0:1746065197.179373:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f210a80 00000100:00100000:2.0:1746065197.182179:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263350912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21746us (23728us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065197.182189:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8590 00002000:00100000:2.0:1746065197.182199:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009f210e00 x1830881263350912/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.182207:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f210e00 with x1830881263350912 ext(3145728->4194303) 00002000:00010000:2.0:1746065197.182212:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f210e00 00000100:00100000:3.0:1746065197.185599:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263351168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22985us (26449us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.185609:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8591 00002000:00100000:3.0:1746065197.185619:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f211180 x1830881263351168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.185627:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f211180 with x1830881263351168 ext(3145728->4194303) 00002000:00010000:3.0:1746065197.185631:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f211180 00000100:00100000:0.0:1746065197.190986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.191135:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351296 00000100:00100000:3.0:1746065197.191143:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351296 00000100:00100000:3.0:1746065197.191714:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15206 00000100:00100000:3.0:1746065197.191722:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263351296:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.191737:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.191750:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe9bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61a9f expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.191791:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260459776:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065197.193119:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00002000:00010000:3.0:1746065197.194560:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065195 -> 1746065197 00000100:00100000:3.0:1746065197.194581:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260459776:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065197.194605:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe9bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a9f expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.194616:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d9c00/0x14b4f8542d4fe9bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a9f expref: 12 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.194883:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d9c00, rc 0) 00000100:00100000:3.0:1746065197.194950:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263351296:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3228us (3968us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065197.194957:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15206 00000100:00100000:0.0:1746065197.196765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.196930:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351424 00000100:00100000:3.0:1746065197.196936:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351424 00000100:00100000:3.0:1746065197.196965:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15207 00000100:00100000:3.0:1746065197.196971:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:32137:x1830881263351424:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.196984:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.196997:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61aa6 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.197019:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 14 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.197026:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.197028:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.197031:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.197054:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 14 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.197064:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 14 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.197079:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260459904:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.197450:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.198956:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260459904:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.198979:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->5013503] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.198993:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6d8200, rc 0) 00000100:00100000:3.0:1746065197.199021:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:32137:x1830881263351424:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2049us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.199028:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15207 00000100:00100000:0.0:1746065197.200371:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.200439:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351552 00000100:00100000:3.0:1746065197.200444:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351552 00002000:00100000:3.0:1746065197.200475:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4263935) req@ffff88009f211c00 x1830881263351552/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.200482:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f211c00 with x1830881263351552 ext(4194304->4263935) 00010000:00010000:3.0:1746065197.200488:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 15 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.200498:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 15 pid: 25185 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065197.200504:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f211c00 00000100:00100000:3.0:1746065197.200592:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2599 00000100:00100000:3.0:1746065197.200598:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263351552:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065197.202640:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263351552:12345-192.168.202.46@tcp:4:cat.0 Request processed in 2036us (2267us total) trans 21474841014 rc 0/0 00000100:00100000:3.0:1746065197.202648:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2599 00002000:00100000:3.0:1746065197.202656:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4263935) req@ffff88009f211c00 x1830881263351552/t21474841014(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/448 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.202663:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f211c00 with x1830881263351552 ext(4194304->4263935) 00010000:00010000:3.0:1746065197.202670:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 17 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.202694:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 17 pid: 25185 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065197.202700:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f211c00 00000100:00100000:0.0:1746065197.204548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.204727:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351680 00000100:00100000:2.0:1746065197.204734:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351680 00010000:00010000:2.0:1746065197.204762:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 17 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.204799:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7829 00000100:00100000:2.0:1746065197.204805:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263351680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.204846:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.204865:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 17 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.204876:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 17 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.204894:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927db400/0x14b4f8542d4fe9a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a8a expref: 17 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.204914:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.204916:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.204923:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.204930:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.204957:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065197.204968:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260460032:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065197.205040:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.207088:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7079:1830881260460032:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065197.207101:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.207127:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263351680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2322us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.207135:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7829 00000100:00100000:0.0:1746065197.209896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.209953:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263351936 00000100:00100000:3.0:1746065197.209959:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263351936 00002000:00100000:3.0:1746065197.209992:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009f212300 x1830881263351936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.210000:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f212300 with x1830881263351936 ext(4194304->5013503) 00002000:00010000:3.0:1746065197.210004:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f212300 00000100:00100000:3.0:1746065197.210032:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8592 00000100:00100000:3.0:1746065197.210038:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263351936:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.217380:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263351936:12345-192.168.202.46@tcp:3:cat.0 Request processed in 7332us (7480us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065197.217389:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8592 00002000:00100000:3.0:1746065197.217398:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009f212300 x1830881263351936/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.217406:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f212300 with x1830881263351936 ext(4194304->5013503) 00002000:00010000:3.0:1746065197.217411:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f212300 00000100:00100000:0.0:1746065197.236965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.237109:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352064 00000100:00100000:3.0:1746065197.237115:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352064 00000100:00100000:3.0:1746065197.237160:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10120 00000100:00100000:3.0:1746065197.237167:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:32147:x1830881263352064:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065197.237186:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.237200:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe9cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61aad expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.237246:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.237255:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.237263:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.237275:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.237280:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.237284:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.237365:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.237374:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.237381:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.237404:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.237414:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 14 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.237424:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260460160:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.237508:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.238999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.239073:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260460160:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.239088:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065197.239210:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352320 00000100:00100000:2.0:1746065197.239215:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352320 00000100:00100000:2.0:1746065197.239243:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4371 00000100:00100000:2.0:1746065197.239249:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b878450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:7711:x1830881263352320:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065197.239391:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b878450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:7711:x1830881263352320:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 142us (395us total) trans 8589944409 rc 0/0 00000100:00100000:2.0:1746065197.239397:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4371 00000100:00100000:0.0:1746065197.243226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.243294:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352448 00000100:00100000:2.0:1746065197.243301:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352448 00010000:00010000:2.0:1746065197.243329:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 16 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.243754:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7830 00000100:00100000:2.0:1746065197.243761:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881263352448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.243772:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.243777:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 16 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.243788:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 16 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.243809:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fe91c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a21 expref: 16 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.243951:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.243955:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.243963:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.243969:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.244078:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065197.244157:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244164:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065197.244197:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065197.244201:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065197.244213:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244221:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244229:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244234:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244239:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244243:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6d9e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065197.244247:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244252:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244259:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065197.244261:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065197.244264:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244268:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9e00/0x14b4f8542d4fe9d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244292:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244297:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244302:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244305:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c509e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065197.244308:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244312:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244319:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093669400) 00010000:00010000:3.0:1746065197.244321:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065197.244323:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244327:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c509e00/0x14b4f8542d4fe9d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.244353:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fe9cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.244363:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.244369:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065197.244371:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065197.244372:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c508e00, rc 0) 00000100:00100000:2.0:1746065197.244408:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263352448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 647us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.244414:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7830 00000100:00100000:3.0:1746065197.245215:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32147:x1830881263352064:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 8045us (8253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.245221:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10120 00000100:00100000:0.0:1746065197.251670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.251706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.251724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.251743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.251769:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352576 00000100:00100000:0.0:1746065197.251775:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352576 00000100:00100000:0.0:1746065197.251801:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352704 00000100:00100000:0.0:1746065197.251803:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352704 00000100:00100000:0.0:1746065197.251812:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352832 00000100:00100000:0.0:1746065197.251828:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352832 00000100:00100000:0.0:1746065197.251839:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263352960 00000100:00100000:0.0:1746065197.251841:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263352960 00000100:00100000:0.0:1746065197.251862:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15208 00000100:00100000:0.0:1746065197.251869:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263352576:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065197.251885:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.251898:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ab4 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.251915:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.251916:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.251924:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.251937:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.251946:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b2200, rc 0) 00000100:00100000:0.0:1746065197.251981:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263352576:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 113us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.251987:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15208 00000100:00100000:0.0:1746065197.252005:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15209 00000100:00100000:0.0:1746065197.252009:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263352704:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065197.252015:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.252020:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61abb expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.252029:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.252031:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.252034:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.252042:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.252049:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b2400, rc 0) 00000100:00100000:0.0:1746065197.252061:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263352704:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 52us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.252069:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15209 00000100:00100000:0.0:1746065197.252078:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15210 00000100:00100000:0.0:1746065197.252083:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263352832:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065197.252089:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.252096:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ac2 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.252105:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.252106:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.252110:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.252118:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.252123:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b3200, rc 0) 00000100:00100000:0.0:1746065197.252136:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263352832:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 53us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.252140:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15210 00000100:00100000:0.0:1746065197.252150:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15211 00000100:00100000:0.0:1746065197.252154:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263352960:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065197.252159:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.252164:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ac9 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.252172:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.252173:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.252176:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.252183:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.252189:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938b2e00, rc 0) 00000100:00100000:0.0:1746065197.252203:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263352960:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 48us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.252207:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15211 00000100:00100000:0.0:1746065197.254934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.258982:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353216 00000100:00100000:3.0:1746065197.258992:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353216 00000100:00100000:3.0:1746065197.259040:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10121 00000100:00100000:3.0:1746065197.259047:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32147:x1830881263353216:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065197.259065:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.259079:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a800/0x14b4f8542d4fea03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ad0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.259150:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.259162:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.259167:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.259191:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.259201:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 8 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.259210:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260460288:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.259286:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.260706:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260460288:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.260722:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065197.261996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.262072:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353344 00000100:00100000:2.0:1746065197.262078:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353344 00010000:00010000:2.0:1746065197.262103:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 9 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.262135:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7831 00000100:00100000:2.0:1746065197.262141:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263353344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.262151:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.262155:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 9 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.262169:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 9 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.262186:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c508e00/0x14b4f8542d4fe9e0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aad expref: 9 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.262211:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.262215:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.262222:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.262228:0:7079:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.262242:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.262269:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263353344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 129us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.262276:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7831 00010000:00010000:3.0:1746065197.262411:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.262418:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:3.0:1746065197.262435:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065197.262537:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a800/0x14b4f8542d4fea03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ad0 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.263395:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ad0 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.263403:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065197.263406:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065197.263408:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66be00, rc 0) 00000100:00100000:2.0:1746065197.263564:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32147:x1830881263353216:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 4516us (8635us total) trans 8589944410 rc 0/0 00000100:00100000:2.0:1746065197.263571:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10121 00000100:00100000:0.0:1746065197.267578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.267844:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353600 00000100:00100000:2.0:1746065197.267851:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353600 00000100:00100000:2.0:1746065197.268048:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10122 00000100:00100000:2.0:1746065197.268056:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32147:x1830881263353600:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065197.268074:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.268077:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065197.268099:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fea0a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ad0 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.268215:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.268219:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065197.268229:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fea18 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ad7 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.268296:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fea1f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.268306:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fea1f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.268312:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fea1f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065197.268320:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065197.268408:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da400/0x14b4f8542d4fea18 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ad7 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.268418:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fea1f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ad7 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.268424:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.268426:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065197.268428:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927dae00, rc 0) 00000100:00100000:2.0:1746065197.268729:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32147:x1830881263353600:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 673us (1156us total) trans 8589944411 rc 0/0 00000100:00100000:2.0:1746065197.268735:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10122 00000100:00100000:0.0:1746065197.270393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.270495:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353728 00000100:00100000:2.0:1746065197.270501:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353728 00000100:00100000:2.0:1746065197.270540:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10123 00000100:00100000:2.0:1746065197.270546:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32147:x1830881263353728:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065197.270563:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.270574:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fea2d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ade expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.270611:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fea2d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ade expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.270620:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fea2d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ade expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.270634:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.270636:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065197.270639:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927db400, rc 0) 00000100:00100000:2.0:1746065197.270666:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32147:x1830881263353728:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 120us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.270671:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10123 00000100:00100000:3.0:1746065197.272834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.272884:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.273032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.273536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.273603:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353856 00000100:00100000:0.0:1746065197.273610:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353856 00000100:00100000:0.0:1746065197.273644:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263353984 00000100:00100000:0.0:1746065197.273646:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263353984 00000100:00100000:0.0:1746065197.273657:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354112 00000100:00100000:0.0:1746065197.273659:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354112 00000100:00100000:0.0:1746065197.273670:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15212 00000100:00100000:0.0:1746065197.273685:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263353856:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065197.273718:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.273733:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.273744:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.273751:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.273756:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.273758:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.273760:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.273784:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.273795:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 15 pid: 25185 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.273804:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260460416:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.273874:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.273882:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 11 pid: 8427 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.273890:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260460544:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.273913:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 9 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.273919:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 9 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.273925:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260460672:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.273937:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.273955:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15213 00000100:00100000:0.0:1746065197.273959:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263353984:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065197.273976:0:2462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.273986:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.273991:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.273997:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.274002:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.274004:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.274005:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.274023:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.274030:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.274037:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260460800:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.274060:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.274066:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 10 pid: 21235 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.274072:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260460928:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.274090:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 25 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.274097:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.274103:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260461056:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.274115:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.274129:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15214 00000100:00100000:0.0:1746065197.274133:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263354112:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065197.274149:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.274157:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.274162:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.274168:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 25 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.274173:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.274174:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.274175:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.274188:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 25 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.274194:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 25 pid: 2462 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.274200:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260461184:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.274221:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 10 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.274232:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 10 pid: 21235 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.274239:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260461312:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.274256:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 11 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.274262:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 11 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.274268:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260461440:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.274276:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.274944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.274967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.274991:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354240 00000100:00100000:3.0:1746065197.274995:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354240 00000100:00100000:3.0:1746065197.275012:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354368 00000100:00100000:3.0:1746065197.275014:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354368 00000100:00100000:3.0:1746065197.275021:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354496 00000100:00100000:3.0:1746065197.275023:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354496 00000100:00100000:3.0:1746065197.275032:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15215 00000100:00100000:3.0:1746065197.275037:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881263354240:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065197.275054:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275063:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275070:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275077:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275082:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.275083:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.275085:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275097:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 15 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275104:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 15 pid: 25185 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.275113:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260461568:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.275145:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 11 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275153:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 11 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.275160:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260461696:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.275177:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275183:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 11 pid: 2463 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.275190:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260461824:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.275201:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.275214:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15216 00000100:00100000:3.0:1746065197.275219:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881263354368:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065197.275233:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275241:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275247:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275253:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275257:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.275259:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.275261:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275276:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275283:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 11 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.275290:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260461952:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.275311:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275318:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 11 pid: 21235 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.275325:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260462080:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.275340:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275347:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 11 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.275354:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260462208:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.275366:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92add80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.275384:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15217 00000100:00100000:3.0:1746065197.275389:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881263354496:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065197.275403:0:8427:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275411:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275418:0:8427:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275423:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.275424:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.275426:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275438:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.275445:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 11 pid: 21235 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.275452:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260462336:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.275473:0:8427:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.275480:0:8427:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 11 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.275492:0:8427:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260462464:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.275505:0:8427:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.293657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.293687:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.293767:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354624 00000100:00100000:3.0:1746065197.293774:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354624 00010000:00010000:3.0:1746065197.293803:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 16 pid: 25185 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.293837:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354752 00000100:00100000:3.0:1746065197.293839:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354752 00010000:00010000:3.0:1746065197.293848:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 12 pid: 8427 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.293861:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7832 00000100:00100000:3.0:1746065197.293866:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881263354624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.293877:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.293896:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 16 pid: 25185 timeout: 896 lvb_type: 1 00010000:00010000:3.0:1746065197.293906:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 16 pid: 25185 timeout: 896 lvb_type: 1 00010000:00010000:3.0:1746065197.293925:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.293958:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881263354624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 91us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.293964:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7832 00000100:00100000:3.0:1746065197.293976:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7833 00000100:00100000:3.0:1746065197.293980:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263354752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.293986:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.293993:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 12 pid: 8427 timeout: 896 lvb_type: 1 00010000:00010000:3.0:1746065197.294000:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 12 pid: 8427 timeout: 896 lvb_type: 1 00010000:00010000:3.0:1746065197.294009:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.294020:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263354752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 40us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.294024:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7833 00010000:00010000:2.0:1746065197.294383:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f88400/0x14b4f8542d4fe778 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61902 expref: 15 pid: 25185 timeout: 896 lvb_type: 1 00000100:00100000:2.0:1746065197.294398:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260460416:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.294408:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8a00/0x14b4f8542d4fe7e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61948 expref: 11 pid: 8427 timeout: 896 lvb_type: 1 00000100:00100000:2.0:1746065197.294420:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260460544:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.294427:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260460672:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.294448:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.294516:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260460800:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.294631:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260461184:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.294650:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260461312:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.294665:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260461440:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.294687:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.294779:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260462336:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.294785:0:8427:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1830881260462464:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.294797:0:8427:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.294833:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260461952:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.294840:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260462080:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.294845:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260462208:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.294857:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.294903:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260461568:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.294909:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260461696:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.294915:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260461824:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.294926:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.294972:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260460928:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.294979:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260461056:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.294996:0:2462:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.303511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.303602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.304621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.306201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.306228:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263354880 00000100:00100000:2.0:1746065197.306236:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263354880 00010000:00010000:2.0:1746065197.306268:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 12 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:2.0:1746065197.306296:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355136 00000100:00100000:2.0:1746065197.306298:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355136 00010000:00010000:2.0:1746065197.306310:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 12 pid: 21235 timeout: 896 lvb_type: 1 00000100:00100000:2.0:1746065197.306322:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355392 00000100:00100000:2.0:1746065197.306324:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355392 00010000:00010000:2.0:1746065197.306334:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 26 pid: 2462 timeout: 896 lvb_type: 1 00000100:00100000:2.0:1746065197.306347:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7834 00000100:00100000:2.0:1746065197.306353:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1959:x1830881263354880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.306363:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.306382:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 12 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306397:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 12 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306416:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fe6d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618ca expref: 12 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306433:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.306435:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.306439:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306447:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306463:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.306496:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263354880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 143us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.306502:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7834 00000100:00100000:2.0:1746065197.306515:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7835 00000100:00100000:2.0:1746065197.306519:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1959:x1830881263355136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.306526:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.306538:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 12 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306545:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 12 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306560:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b2200/0x14b4f8542d4fe9e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ab4 expref: 12 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306571:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.306583:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263355136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.306587:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7835 00000100:00100000:2.0:1746065197.306623:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7836 00000100:00100000:2.0:1746065197.306627:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263355392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.306633:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.306642:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 26 pid: 2462 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306649:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 26 pid: 2462 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306659:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f5d800/0x14b4f8542d4fe97e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a59 expref: 26 pid: 2462 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.306666:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.306688:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881263355392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.306693:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7836 00010000:00010000:2.0:1746065197.306718:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306728:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306743:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306749:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306755:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306761:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938b3000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065197.306764:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306770:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306778:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.306783:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3000/0x14b4f8542d4fea34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065197.306832:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263353856:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 33155us (34017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.306839:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15212 00000100:00100000:0.0:1746065197.308857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.309249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.310513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.310607:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355648 00000100:00100000:1.0:1746065197.310614:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355648 00010000:00010000:1.0:1746065197.310640:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 12 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.310667:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355904 00000100:00100000:1.0:1746065197.310669:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355904 00010000:00010000:1.0:1746065197.310689:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 11 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:1.0:1746065197.310708:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356160 00000100:00100000:1.0:1746065197.310710:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356160 00010000:00010000:1.0:1746065197.310720:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 12 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.310731:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7837 00000100:00100000:1.0:1746065197.310737:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263355648:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.310747:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.310763:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 12 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.310777:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 12 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.310795:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a0d200/0x14b4f8542d4fe95b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a3d expref: 12 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.310811:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.310861:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263355648:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 124us (4662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.310866:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7837 00000100:00100000:1.0:1746065197.310880:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7838 00000100:00100000:1.0:1746065197.310883:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263355904:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.310890:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.310900:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 12 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065197.310907:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 12 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065197.310918:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe13000/0x14b4f8542d4fe7f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6195d expref: 12 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065197.310926:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.310938:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263355904:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 54us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.310943:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7838 00000100:00100000:1.0:1746065197.310952:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7839 00000100:00100000:1.0:1746065197.310956:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263356160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.310962:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.310970:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 10 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.310977:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 10 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.310986:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927db200/0x14b4f8542d4fe9af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a91 expref: 10 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.310994:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.311005:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263356160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.311010:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7839 00000100:00100000:0.0:1746065197.311100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.311121:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.311362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.311374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.311383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.311392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.311402:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.311424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.311448:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356416 00000100:00100000:0.0:1746065197.311451:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356416 00010000:00010000:0.0:1746065197.311463:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 9 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.311473:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356672 00000100:00100000:0.0:1746065197.311475:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356672 00010000:00010000:0.0:1746065197.311483:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 11 pid: 25185 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.311491:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355008 00000100:00100000:0.0:1746065197.311492:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355008 00010000:00010000:0.0:1746065197.311499:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 12 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.311507:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355264 00000100:00100000:0.0:1746065197.311508:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355264 00010000:00010000:0.0:1746065197.311515:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.311522:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355520 00000100:00100000:0.0:1746065197.311524:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355520 00010000:00010000:0.0:1746065197.311530:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 11 pid: 21235 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.311536:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263355776 00000100:00100000:0.0:1746065197.311538:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263355776 00010000:00010000:0.0:1746065197.311544:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 15 pid: 25185 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.311550:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356032 00000100:00100000:0.0:1746065197.311552:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356032 00010000:00010000:0.0:1746065197.311558:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 10 pid: 2463 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.311564:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356288 00000100:00100000:0.0:1746065197.311566:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356288 00010000:00010000:0.0:1746065197.311572:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 11 pid: 21235 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.311578:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356544 00000100:00100000:0.0:1746065197.311580:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356544 00010000:00010000:0.0:1746065197.311585:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 12 pid: 21235 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.311594:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7840 00000100:00100000:0.0:1746065197.311598:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263356416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.311603:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.311611:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 9 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311618:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 9 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311628:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6d8200/0x14b4f8542d4fe9c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5013503) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aa6 expref: 9 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311639:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.311655:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:1959:x1830881263356416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.311663:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7840 00000100:00100000:0.0:1746065197.311687:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7841 00000100:00100000:0.0:1746065197.311692:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263356672:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.311699:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.311707:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 12 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311714:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 12 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311724:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3efe00/0x14b4f8542d4fe9b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a98 expref: 12 pid: 25185 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311732:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.311745:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263356672:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.311750:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7841 00000100:00100000:0.0:1746065197.311759:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7842 00000100:00100000:0.0:1746065197.311764:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263355008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.311769:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.311776:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311784:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311799:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c8f800/0x14b4f8542d4fe931 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a2f expref: 10 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311808:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.311838:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263355008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.311843:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7842 00000100:00100000:0.0:1746065197.311866:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7843 00000100:00100000:0.0:1746065197.311871:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881263355264:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.311876:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.311883:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311890:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311900:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7b4000/0x14b4f8542d4fe923 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a28 expref: 25 pid: 8851 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.311908:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.311910:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.311914:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.311921:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.311940:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.311953:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263355264:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.311958:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7843 00000100:00100000:0.0:1746065197.311968:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7844 00000100:00100000:0.0:1746065197.311972:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1959:x1830881263355520:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.311977:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.311984:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 12 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.311990:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 12 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312000:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b2400/0x14b4f8542d4fe9ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61abb expref: 12 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312008:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.312009:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.312011:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312016:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312027:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.312040:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263355520:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 67us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312045:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7844 00000100:00100000:0.0:1746065197.312054:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7845 00000100:00100000:0.0:1746065197.312058:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263355776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.312064:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.312071:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 15 pid: 25185 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312078:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 15 pid: 25185 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312088:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec2ae00/0x14b4f8542d4fe794 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e6191e expref: 15 pid: 25185 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312095:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.312106:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1959:x1830881263355776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 48us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312111:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7845 00000100:00100000:0.0:1746065197.312119:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7846 00000100:00100000:0.0:1746065197.312124:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263356032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.312129:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.312135:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 11 pid: 2463 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312142:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 11 pid: 2463 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312155:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66b400/0x14b4f8542d4fe6f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e618df expref: 11 pid: 2463 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312162:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.312163:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.312166:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312171:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312183:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.312196:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881263356032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 72us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312201:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7846 00000100:00100000:0.0:1746065197.312210:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7847 00000100:00100000:0.0:1746065197.312215:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263356288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.312220:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.312227:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 9 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312234:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 9 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312244:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938b3200/0x14b4f8542d4fe9f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac2 expref: 9 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312256:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.312257:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.312259:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312264:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312277:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065197.312288:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312295:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312311:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312318:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312323:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312328:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f66b200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065197.312331:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312340:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312348:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312352:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fea50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.312384:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263354368:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 37164us (37441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312390:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15216 00010000:00010000:0.0:1746065197.312407:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312413:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312425:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312430:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312436:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312444:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db59800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065197.312446:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312451:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312459:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312463:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db59800/0x14b4f8542d4fea42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.312490:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263354112:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 38356us (39458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312495:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15214 00010000:00010000:0.0:1746065197.312513:0:2462:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312519:0:2462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312530:0:2462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312535:0:2462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312542:0:2462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312546:0:2462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e8fe00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065197.312548:0:2462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312553:0:2462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312559:0:2462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312564:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e8fe00/0x14b4f8542d4fea3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.312582:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263353984:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 38622us (39698us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312586:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15213 00000100:00100000:0.0:1746065197.312600:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263356288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 386us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312604:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7847 00000100:00100000:0.0:1746065197.312611:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7848 00000100:00100000:0.0:1746065197.312615:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263356544:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.312619:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.312625:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 8 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312632:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 8 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312640:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938b2e00/0x14b4f8542d4fe9fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ac9 expref: 8 pid: 21235 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.312647:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.312648:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.312650:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312656:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312668:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065197.312689:0:8427:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312696:0:8427:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312707:0:8427:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312713:0:8427:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312722:0:8427:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312726:0:8427:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5f89800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065197.312729:0:8427:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312734:0:8427:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312743:0:8427:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312749:0:8427:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5f89800/0x14b4f8542d4fea57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.312771:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263354496:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 37381us (37802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312776:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15217 00000100:00100000:0.0:1746065197.312792:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1959:x1830881263356544:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 177us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312796:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7848 00010000:00010000:0.0:1746065197.312840:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312847:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312859:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312865:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312871:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312875:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f66ba00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065197.312877:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312882:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312890:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.312895:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fea49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.312915:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881263354240:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 37877us (39379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.312919:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15215 00000100:00100000:0.0:1746065197.324794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.332624:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263356928 00000100:00100000:1.0:1746065197.332640:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263356928 00000100:00100000:1.0:1746065197.332729:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10124 00000100:00100000:1.0:1746065197.332738:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32147:x1830881263356928:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:1.0:1746065197.332793:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.332858:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db400/0x14b4f8542d4fea2d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ade expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.332890:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.332894:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065197.332925:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.332944:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.332951:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 257 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.332957:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.332963:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.332969:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.332974:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.332980:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 9/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.333013:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.333025:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 257 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.333038:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260462592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.333152:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 14 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.333159:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 14 pid: 24350 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.333171:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260462720:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.333193:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.333200:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 257 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.333206:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260462848:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.333226:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 14 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.333232:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 14 pid: 16767 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.333239:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260462976:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.333262:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 257 pid: 24350 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.333269:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 257 pid: 24350 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.333276:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260463104:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.333297:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.333307:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 257 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.333314:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260463232:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.333342:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065197.341760:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260462592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.341777:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260462720:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.342008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.342070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.342114:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260462848:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.342288:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5883100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260462976:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.343491:0:14646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357312 00000100:00100000:2.0:1746065197.343501:0:14646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357312 00000100:00100000:0.0:1746065197.343528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.343903:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357696 00000100:00100000:1.0:1746065197.343910:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357696 00010000:00010000:1.0:1746065197.343938:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 16 pid: 16767 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.343965:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7849 00000100:00100000:1.0:1746065197.343971:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263357696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.343983:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.343988:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 16 pid: 16767 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.343998:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 16 pid: 16767 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.344014:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd600/0x14b4f8542d4fe820 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61980 expref: 16 pid: 16767 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.344038:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.344042:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.344049:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.344084:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263357696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 113us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.344090:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7849 00000100:00100000:0.0:1746065197.344297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.345663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.345700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.345746:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260463104:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.345754:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b9fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260463232:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.345792:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065197.345829:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357056 00000100:00100000:0.0:1746065197.345834:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357056 00000100:00100000:3.0:1746065197.346229:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357568 00000100:00100000:3.0:1746065197.346236:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357568 00000100:00100000:3.0:1746065197.346272:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4372 00000100:00100000:3.0:1746065197.346278:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:7710:x1830881263357312:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065197.346285:0:14646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4373 00000100:00100000:2.0:1746065197.346298:0:14646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:31256:x1830881263357568:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065197.346497:0:14646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:31256:x1830881263357568:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 203us (4427us total) trans 8589944412 rc 0/0 00000100:00100000:2.0:1746065197.346502:0:14646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4373 00000100:00100000:1.0:1746065197.347041:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357952 00000100:00100000:1.0:1746065197.347045:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357952 00010000:00010000:1.0:1746065197.347060:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 259 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.347083:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263357824 00000100:00100000:1.0:1746065197.347085:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263357824 00010000:00010000:1.0:1746065197.347093:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 260 pid: 24350 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.347110:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7850 00000100:00100000:1.0:1746065197.347115:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1961:x1830881263357952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065197.347117:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7851 00010000:00010000:1.0:1746065197.347122:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065197.347124:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:1961:x1830881263357824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.347126:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 260 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.347134:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.347134:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 260 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.347141:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 260 pid: 24350 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.347463:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:7710:x1830881263357312:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 1184us (5462us total) trans 8589944413 rc 0/0 00000100:00100000:3.0:1746065197.347473:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4372 00010000:00010000:0.0:1746065197.347664:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 261 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.347691:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7852 00000100:00100000:0.0:1746065197.347696:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1959:x1830881263357056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.347703:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.347707:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 261 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.347733:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395400/0x14b4f8542d4fe812 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61972 expref: 261 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.347738:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 261 pid: 24350 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.347756:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdfd200/0x14b4f8542d4fe819 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61979 expref: 260 pid: 24350 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.347769:0:15963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.347774:0:15963:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.347784:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.347811:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:1961:x1830881263357824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 688us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.347839:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7851 00010000:00010000:1.0:1746065197.348007:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.348013:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.348020:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.348037:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1961:x1830881263357952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 922us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.348043:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7850 00010000:00010000:0.0:1746065197.348168:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 257 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.348179:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927da600/0x14b4f8542d4fe94d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a36 expref: 257 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065197.348202:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065197.348204:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065197.348208:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.348234:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1959:x1830881263357056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 538us (3938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.348238:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7852 00000100:00100000:0.0:1746065197.360357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.360403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.360618:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358080 00000100:00100000:2.0:1746065197.360625:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358080 00010000:00010000:2.0:1746065197.360655:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 15 pid: 24350 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.361583:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358208 00000100:00100000:1.0:1746065197.361588:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358208 00010000:00010000:1.0:1746065197.361605:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 256 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.362008:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7853 00000100:00100000:2.0:1746065197.362017:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263358080:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.362028:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.362034:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 15 pid: 24350 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.362043:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 15 pid: 24350 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.362059:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7b4800/0x14b4f8542d4fe900 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a13 expref: 15 pid: 24350 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.362082:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.362086:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.362092:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.362129:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263358080:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 114us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.362135:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7853 00000100:00100000:2.0:1746065197.362147:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7854 00000100:00100000:2.0:1746065197.362153:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1961:x1830881263358208:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.362159:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.362162:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 256 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.362170:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 256 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.362179:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927db600/0x14b4f8542d4fe8e4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61a05 expref: 256 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.362188:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.362191:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.362197:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.362202:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.364546:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.364588:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1961:x1830881263358208:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2430us (4179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.364596:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7854 00010000:00010000:1.0:1746065197.366413:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.366424:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000040:00080000:1.0:1746065197.368321:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3156, 88 off267160 00000004:00080000:1.0:1746065197.368329:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796659513715ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370613:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3174, 88 off268920 00000004:00080000:1.0:1746065197.370624:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796661807889ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065197.370647:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3175, 88 off269008 00000004:00080000:1.0:1746065197.370649:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796661834148ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065197.370663:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3157, 88 off267248 00000004:00080000:1.0:1746065197.370666:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796661850777ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370672:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3158, 88 off267336 00000004:00080000:1.0:1746065197.370675:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796661859398ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370691:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3176, 88 off269096 00000004:00080000:1.0:1746065197.370693:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796661877937ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065197.370700:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3177, 88 off269184 00000004:00080000:1.0:1746065197.370702:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796661887123ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065197.370708:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3178, 88 off269272 00000004:00080000:1.0:1746065197.370711:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796661895478ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065197.370717:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3159, 88 off267424 00000004:00080000:1.0:1746065197.370719:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796661903881ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370725:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3179, 88 off269360 00000004:00080000:1.0:1746065197.370727:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796661912049ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065197.370733:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3160, 88 off267512 00000004:00080000:1.0:1746065197.370735:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796661920247ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370742:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3180, 88 off269448 00000004:00080000:1.0:1746065197.370744:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796661928803ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065197.370750:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3161, 88 off267600 00000004:00080000:1.0:1746065197.370753:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796661937398ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370759:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3162, 88 off267688 00000004:00080000:1.0:1746065197.370761:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796661945923ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370767:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3163, 88 off267776 00000004:00080000:1.0:1746065197.370769:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796661954019ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370775:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3164, 88 off267864 00000004:00080000:1.0:1746065197.370778:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796661962546ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065197.370784:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3181, 88 off269536 00000004:00080000:1.0:1746065197.370786:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796661970949ns, next at 737095943431ns, rc = 0 00000001:00080000:0.0:1746065197.397123:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944414 is committed 00000004:00080000:0.0:1746065197.397131:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2462 committed 00000004:00080000:0.0:1746065197.397137:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2444 committed 00000004:00080000:0.0:1746065197.397142:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2443 committed 00000004:00080000:0.0:1746065197.397143:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2442 committed 00000004:00080000:0.0:1746065197.397144:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2441 committed 00000004:00080000:0.0:1746065197.397146:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2461 committed 00000004:00080000:0.0:1746065197.397147:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2440 committed 00000004:00080000:0.0:1746065197.397149:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2460 committed 00000004:00080000:0.0:1746065197.397150:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2439 committed 00000004:00080000:0.0:1746065197.397152:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2459 committed 00000004:00080000:0.0:1746065197.397153:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2458 committed 00000004:00080000:0.0:1746065197.397154:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2457 committed 00000004:00080000:0.0:1746065197.397156:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2438 committed 00000004:00080000:0.0:1746065197.397157:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2437 committed 00000004:00080000:0.0:1746065197.397159:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2456 committed 00000004:00080000:0.0:1746065197.397160:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2455 committed 00000004:00080000:0.0:1746065197.397162:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2436 committed 00000001:00080000:0.0:1746065197.397168:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944402 is committed 00000001:00080000:0.0:1746065197.397172:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944398 is committed 00000001:00080000:0.0:1746065197.397178:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944412 is committed 00000001:00080000:0.0:1746065197.397183:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944409 is committed 00000001:00080000:0.0:1746065197.397195:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944413 is committed 00000100:00100000:2.0:1746065197.397391:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260463360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065197.397434:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065197.397466:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260463872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065197.397482:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065197.397499:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065197.397503:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260463744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065197.397516:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065197.397526:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260464256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065197.397537:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065197.397558:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260463360 00000100:00100000:3.0:1746065197.397808:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260464768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.397841:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.397856:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260465280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.397865:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.397874:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065197.397877:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260464384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.397886:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.397894:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260464896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.397903:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.397931:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260463488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.397952:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260463616:0@lo:2:osp-syn-1-0.0 00000004:00010000:1.0:1746065197.398020:0:14643:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f9e9f80 reply state ffff880135631c00 transno 8589944414 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:1.0:1746065197.398029:0:14643:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746065197.398091:0:14643:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065197.398101:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32147:x1830881263356928:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 65363us (73319us total) trans 8589944414 rc 0/0 00000100:00100000:1.0:1746065197.398108:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10124 00000100:00100000:0.0:1746065197.398443:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260463872 00000100:00100000:0.0:1746065197.398446:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260463872 00000100:00100000:0.0:1746065197.398469:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260463744 00000100:00100000:0.0:1746065197.398472:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260463744 00000100:00100000:0.0:1746065197.398480:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260464256 00000100:00100000:0.0:1746065197.398482:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260464256 00000100:00100000:0.0:1746065197.398489:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260464768 00000100:00100000:0.0:1746065197.398491:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260464768 00000100:00100000:0.0:1746065197.398499:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260465280 00000100:00100000:0.0:1746065197.398501:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260465280 00000100:00100000:0.0:1746065197.398506:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260464384 00000100:00100000:0.0:1746065197.398507:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260464384 00000100:00100000:0.0:1746065197.398512:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260464896 00000100:00100000:0.0:1746065197.398513:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260464896 00000100:00100000:0.0:1746065197.398521:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15218 00000100:00100000:0.0:1746065197.398526:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881260463872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065197.398659:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398661:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398662:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398664:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398665:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065197.398697:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3298:x1830881260463872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (1214us total) trans 17179873727 rc 0/0 00000100:00100000:0.0:1746065197.398705:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15218 00000100:00100000:0.0:1746065197.398718:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15219 00000100:00100000:0.0:1746065197.398722:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881260463744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065197.398778:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398781:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065197.398782:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065197.398784:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065197.398785:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065197.398801:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3298:x1830881260463744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1284us total) trans 17179873728 rc 0/0 00000100:00100000:0.0:1746065197.398806:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15219 00000100:00100000:0.0:1746065197.398831:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15220 00000100:00100000:0.0:1746065197.398836:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3298:x1830881260464256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.398901:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3298:x1830881260464256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1362us total) trans 17179873729 rc 0/0 00000100:00100000:0.0:1746065197.398905:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15220 00000100:00100000:0.0:1746065197.398914:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15221 00000100:00100000:0.0:1746065197.398918:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260464768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065197.398989:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398991:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398992:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398994:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.398995:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065197.399014:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3297:x1830881260464768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1173us total) trans 21474841015 rc 0/0 00000100:00100000:0.0:1746065197.399022:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15221 00000100:00100000:0.0:1746065197.399031:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15222 00000100:00100000:0.0:1746065197.399035:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260465280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399097:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3297:x1830881260465280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (1231us total) trans 21474841016 rc 0/0 00000100:00100000:0.0:1746065197.399102:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15222 00000100:00100000:0.0:1746065197.399111:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15223 00000100:00100000:0.0:1746065197.399115:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260464384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399187:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3297:x1830881260464384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1299us total) trans 21474841017 rc 0/0 00000100:00100000:0.0:1746065197.399192:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15223 00000100:00100000:0.0:1746065197.399200:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15224 00000100:00100000:0.0:1746065197.399205:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260464896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399267:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3297:x1830881260464896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (1363us total) trans 21474841018 rc 0/0 00000100:00100000:0.0:1746065197.399271:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15224 00000100:00100000:0.0:1746065197.399290:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.399304:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260464128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.399321:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.399330:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260464640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399342:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.399349:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260465152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399359:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.399374:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260463616 00000100:00100000:0.0:1746065197.399377:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260463616 00000100:00100000:0.0:1746065197.399386:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260464128 00000100:00100000:0.0:1746065197.399387:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260464128 00000100:00100000:0.0:1746065197.399392:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260464640 00000100:00100000:0.0:1746065197.399393:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260464640 00000100:00100000:0.0:1746065197.399398:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260465152 00000100:00100000:0.0:1746065197.399399:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260465152 00000100:00100000:0.0:1746065197.399404:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15225 00000100:00100000:0.0:1746065197.399408:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3296:x1830881260463616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.399487:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881260463616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (196us total) trans 17179873730 rc 0/0 00000100:00100000:0.0:1746065197.399492:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15225 00000100:00100000:0.0:1746065197.399501:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15226 00000100:00100000:0.0:1746065197.399505:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3296:x1830881260464128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.399569:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3296:x1830881260464128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (247us total) trans 17179873731 rc 0/0 00000100:00100000:0.0:1746065197.399574:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15226 00000100:00100000:0.0:1746065197.399582:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15227 00000100:00100000:0.0:1746065197.399585:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881260464640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399651:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260464640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (308us total) trans 21474841019 rc 0/0 00000100:00100000:0.0:1746065197.399656:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15227 00000100:00100000:0.0:1746065197.399664:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15228 00000100:00100000:0.0:1746065197.399667:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3296:x1830881260465152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065197.399745:0:8428:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065197.399746:0:8428:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.399748:0:8428:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.399750:0:8428:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.399751:0:8428:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065197.399766:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830881260465152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (405us total) trans 21474841020 rc 0/0 00000100:00100000:0.0:1746065197.399769:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15228 00000004:00080000:0.0:1746065197.399793:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f144380/2, rc 0, transno 17179873730 00000100:00100000:0.0:1746065197.399797:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260463616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065197.399801:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f146d80/2, rc 0, transno 17179873731 00000100:00100000:0.0:1746065197.399803:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260464128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065197.399809:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f8000/2, rc 0, transno 21474841019 00000100:00100000:0.0:1746065197.399831:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260464640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065197.399838:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f8700/2, rc 0, transno 21474841020 00000100:00100000:0.0:1746065197.399840:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260465152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399851:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.399863:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260464000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.399876:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.399885:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260464512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399897:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.399903:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260465024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.399913:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.399927:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260463488 00000100:00100000:0.0:1746065197.399929:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260463488 00000100:00100000:0.0:1746065197.399937:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260464000 00000100:00100000:0.0:1746065197.399939:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260464000 00000100:00100000:0.0:1746065197.399943:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260464512 00000100:00100000:0.0:1746065197.399944:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260464512 00000100:00100000:0.0:1746065197.399949:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260465024 00000100:00100000:0.0:1746065197.399950:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260465024 00000100:00100000:0.0:1746065197.399955:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15229 00000100:00100000:0.0:1746065197.399958:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1830881260463488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.400033:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881260463488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (180us total) trans 17179873732 rc 0/0 00000100:00100000:0.0:1746065197.400037:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15229 00000100:00100000:0.0:1746065197.400045:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15230 00000100:00100000:0.0:1746065197.400048:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1830881260464000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.400105:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830881260464000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (227us total) trans 17179873733 rc 0/0 00000100:00100000:0.0:1746065197.400109:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15230 00000100:00100000:0.0:1746065197.400116:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15231 00000100:00100000:0.0:1746065197.400119:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830881260464512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065197.400568:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260463360 00000100:00100000:2.0:1746065197.400589:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15232 00000100:00100000:2.0:1746065197.400593:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3295:x1830881260465024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065197.400673:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881260465024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (758us total) trans 21474841022 rc 0/0 00000100:00100000:2.0:1746065197.400689:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15232 00000100:00100000:2.0:1746065197.400699:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15233 00000100:00100000:2.0:1746065197.400703:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3298:x1830881260463360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065197.400776:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830881260463360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (3342us total) trans 17179873734 rc 0/0 00000100:00100000:2.0:1746065197.400781:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15233 00010000:00010000:2.0:1746065197.400916:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.400924:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.400929:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.400934:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a60a6000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.400938:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.400948:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.400958:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.400961:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065197.400964:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.400967:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a6000/0x14b4f8542d4fea5e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00000004:00080000:2.0:1746065197.401001:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f144a80/2, rc 0, transno 17179873728 00000100:00100000:2.0:1746065197.401005:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260463744:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065197.401011:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f144e00/2, rc 0, transno 17179873729 00000100:00100000:2.0:1746065197.401014:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260464256:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065197.401019:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f145f80/2, rc 0, transno 17179873734 00000100:00100000:2.0:1746065197.401021:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260463360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065197.401027:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f145180/2, rc 0, transno 17179873727 00000100:00100000:2.0:1746065197.401029:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260463872:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065197.402863:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f8e00/2, rc 0, transno 21474841017 00000100:00100000:3.0:1746065197.402872:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260464384:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065197.402880:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f8380/2, rc 0, transno 21474841018 00000100:00100000:3.0:1746065197.402883:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260464896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065197.402890:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fa300/2, rc 0, transno 21474841015 00000100:00100000:3.0:1746065197.402892:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260464768:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065197.402898:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd71880/2, rc 0, transno 21474841016 00000100:00100000:3.0:1746065197.402901:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260465280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.406122:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830881260464512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5995us (6217us total) trans 21474841021 rc 0/0 00000100:00100000:0.0:1746065197.406134:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15231 00000100:00100000:2.0:1746065197.406923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:0.0:1746065197.408259:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f147480/2, rc 0, transno 17179873732 00000100:00100000:0.0:1746065197.408267:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260463488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065197.408276:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f144700/2, rc 0, transno 17179873733 00000100:00100000:0.0:1746065197.408278:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260464000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065197.408287:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fad80/2, rc 0, transno 21474841021 00000100:00100000:0.0:1746065197.408289:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260464512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065197.408296:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913f8a80/2, rc 0, transno 21474841022 00000100:00100000:0.0:1746065197.408298:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260465024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.408733:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260465408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.408778:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.409069:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260465408 00000100:00100000:0.0:1746065197.409075:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260465408 00000100:00100000:0.0:1746065197.409106:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15234 00000100:00100000:0.0:1746065197.409112:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3298:x1830881260465408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.409280:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3298:x1830881260465408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (501us total) trans 21474841023 rc 0/0 00000100:00100000:0.0:1746065197.409286:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15234 00000004:00080000:3.0:1746065197.409384:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5880a80/2, rc 0, transno 21474841023 00000100:00100000:3.0:1746065197.409388:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260465408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065197.409503:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358336 00000100:00100000:1.0:1746065197.409507:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358336 00000100:00100000:1.0:1746065197.409546:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10125 00000100:00100000:1.0:1746065197.409551:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32147:x1830881263358336:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065197.409564:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.409578:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ae5 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.409616:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.409625:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.409639:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.409642:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065197.409644:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801302d2e00, rc 0) 00000100:00100000:1.0:1746065197.409688:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32147:x1830881263358336:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 136us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.409693:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10125 00000100:00100000:0.0:1746065197.415210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.415346:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358464 00000100:00100000:2.0:1746065197.415353:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358464 00000100:00100000:2.0:1746065197.415394:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 798 00000100:00100000:2.0:1746065197.415401:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32147:x1830881263358464:12345-192.168.202.46@tcp:103:mirror_io.0 00010000:00010000:2.0:1746065197.415412:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.415433:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927dae00/0x14b4f8542d4fea1f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ad7 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.415446:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.415449:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.415492:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32147:x1830881263358464:12345-192.168.202.46@tcp:103:mirror_io.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.415498:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 798 00000100:00100000:0.0:1746065197.418414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.418500:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358720 00000100:00100000:3.0:1746065197.418508:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358720 00000100:00100000:3.0:1746065197.418563:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4374 00000100:00100000:3.0:1746065197.418571:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32147:x1830881263358720:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065197.418791:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32147:x1830881263358720:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 220us (383us total) trans 8589944415 rc 0/0 00000100:00100000:3.0:1746065197.418797:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4374 00000100:00100000:0.0:1746065197.420739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.423008:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263358976 00000100:00100000:2.0:1746065197.423017:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263358976 00000100:00100000:2.0:1746065197.423489:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4375 00000100:00100000:2.0:1746065197.423497:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32147:x1830881263358976:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065197.423672:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32147:x1830881263358976:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 176us (2936us total) trans 8589944416 rc 0/0 00000100:00100000:2.0:1746065197.423695:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4375 00000100:00100000:0.0:1746065197.447890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.447983:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263359232 00000100:00100000:2.0:1746065197.447991:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263359232 00000100:00100000:2.0:1746065197.448037:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10126 00000100:00100000:2.0:1746065197.448044:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+6:32153:x1830881263359232:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065197.448064:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.448079:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fea6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61aec expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.448179:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448190:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448198:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448210:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448215:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448219:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448305:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448311:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448315:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065197.448322:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065197.448386:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448392:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448397:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448401:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0087a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.448404:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448409:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448418:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065197.448420:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065197.448424:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448428:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4fea73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448455:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448459:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448463:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448467:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53cea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.448469:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448474:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448480:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6fe00) 00010000:00010000:2.0:1746065197.448481:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065197.448483:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448487:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4fea7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.448519:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6d9200/0x14b4f8542d4fea6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.448529:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.448534:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.448536:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065197.448538:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944f2800, rc 0) 00000100:00100000:2.0:1746065197.448577:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:32153:x1830881263359232:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 533us (695us total) trans 8589944417 rc 0/0 00000100:00100000:2.0:1746065197.448583:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10126 00000100:00100000:0.0:1746065197.449139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.449229:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263359488 00000100:00100000:1.0:1746065197.449234:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263359488 00000100:00100000:1.0:1746065197.449263:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10127 00000100:00100000:1.0:1746065197.449267:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:32156:x1830881263359488:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065197.449277:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.449284:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4fea8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61af3 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.449323:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449330:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449335:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449344:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449348:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449352:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449394:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449398:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449403:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065197.449411:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065197.449448:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449452:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449456:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449460:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801302d3000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065197.449461:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449465:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449470:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065197.449472:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065197.449474:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449478:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3000/0x14b4f8542d4fea96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449488:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449491:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449495:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449503:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801302d2200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065197.449504:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449508:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449514:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205d00) 00010000:00010000:1.0:1746065197.449515:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065197.449517:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449521:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2200/0x14b4f8542d4fea9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.449543:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2600/0x14b4f8542d4fea8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.449551:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.449557:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.449558:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065197.449560:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801302d2000, rc 0) 00000100:00100000:1.0:1746065197.449581:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32156:x1830881263359488:12345-192.168.202.46@tcp:101:cat.0 Request processed in 313us (443us total) trans 8589944418 rc 0/0 00000100:00100000:1.0:1746065197.449586:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10127 00000100:00100000:0.0:1746065197.468924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.468966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.468993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.469017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.469037:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263359872 00000100:00100000:0.0:1746065197.469044:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263359872 00000100:00100000:0.0:1746065197.469071:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360000 00000100:00100000:0.0:1746065197.469072:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360000 00000100:00100000:0.0:1746065197.469082:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360128 00000100:00100000:0.0:1746065197.469083:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360128 00000100:00100000:0.0:1746065197.469094:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15235 00000100:00100000:0.0:1746065197.469099:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1959:x1830881263359872:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.469114:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.469128:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b01 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.469152:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x7b1 00010000:00010000:0.0:1746065197.469166:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.469167:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.469174:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 15 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.469185:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 15 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.469194:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66ae00, rc 0) 00000100:00100000:0.0:1746065197.469231:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263359872:12345-192.168.202.46@tcp:101:cat.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.469237:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15235 00000100:00100000:0.0:1746065197.469253:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15236 00000100:00100000:0.0:1746065197.469257:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1958:x1830881263360000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.469262:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.469271:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b08 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.469283:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d72d, atime: 0x6812d72b, ctime: 0x6812d72d, blocks: 0x821 00010000:00010000:0.0:1746065197.469289:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.469290:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.469294:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.469301:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.469307:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66ac00, rc 0) 00000100:00100000:0.0:1746065197.469320:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1958:x1830881263360000:12345-192.168.202.46@tcp:101:cat.0 Request processed in 63us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.469331:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15236 00000100:00100000:0.0:1746065197.469340:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15237 00000100:00100000:0.0:1746065197.469343:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1959:x1830881263360128:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.469348:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.469356:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b0f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.469365:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d72d, atime: 0x6812d72d, ctime: 0x6812d72d, blocks: 0x821 00010000:00010000:0.0:1746065197.469371:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.469372:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.469375:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.469383:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 26 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.469389:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66a400, rc 0) 00000100:00100000:0.0:1746065197.469402:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263360128:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.469406:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15237 00000100:00100000:3.0:1746065197.469538:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263359744 00000100:00100000:3.0:1746065197.469542:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263359744 00000100:00100000:3.0:1746065197.469565:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10128 00000100:00100000:3.0:1746065197.469569:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32155:x1830881263359744:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065197.469580:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.469588:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4feac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61afa expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.469650:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.469661:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.469667:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.469672:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065197.469708:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.469722:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 250 pid: 14643 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.469732:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260465536:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.469792:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.469799:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 7 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.469805:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260465664:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.469854:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.470787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.470833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.470864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.470881:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360256 00000100:00100000:0.0:1746065197.470884:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360256 00000100:00100000:0.0:1746065197.470902:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360384 00000100:00100000:0.0:1746065197.470903:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360384 00000100:00100000:0.0:1746065197.470911:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360512 00000100:00100000:0.0:1746065197.470912:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360512 00000100:00100000:0.0:1746065197.470922:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15238 00000100:00100000:0.0:1746065197.470927:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881263360256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.470936:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.470946:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b16 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.470961:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x821 00010000:00010000:0.0:1746065197.470972:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.470973:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.470979:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.470989:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.470996:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66ba00, rc 0) 00000100:00100000:0.0:1746065197.471031:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263360256:12345-192.168.202.46@tcp:101:cat.0 Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.471036:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15238 00000100:00100000:0.0:1746065197.471049:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15239 00000100:00100000:0.0:1746065197.471053:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881263360384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.471058:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.471065:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b1d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.471074:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d72e, atime: 0x6812d72b, ctime: 0x6812d72e, blocks: 0x1689 00010000:00010000:0.0:1746065197.471080:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.471082:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.471085:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.471093:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 17 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.471099:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66a600, rc 0) 00000100:00100000:0.0:1746065197.471112:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263360384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.471116:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15239 00000100:00100000:0.0:1746065197.471125:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15240 00000100:00100000:0.0:1746065197.471128:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263360512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.471134:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.471141:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b24 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.471152:0:8429:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d72e, atime: 0x6812d72d, ctime: 0x6812d72e, blocks: 0x1029 00010000:00010000:0.0:1746065197.471160:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.471161:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.471165:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.471173:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 27 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.471179:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66be00, rc 0) 00000100:00100000:0.0:1746065197.471191:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263360512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.471195:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15240 00000100:00100000:3.0:1746065197.472103:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260465536:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.472113:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260465664:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.472131:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065197.474973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.475027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.475109:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360768 00000100:00100000:2.0:1746065197.475116:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360768 00000100:00100000:2.0:1746065197.475149:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10129 00000100:00100000:2.0:1746065197.475154:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32156:x1830881263360768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.475168:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.475182:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4feaea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b2b expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.475222:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4feaea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b2b expref: 252 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.475231:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4feaea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b2b expref: 252 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.475243:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.475246:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065197.475248:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cdc00, rc 0) 00000100:00100000:2.0:1746065197.475290:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32156:x1830881263360768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 135us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.475294:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10129 00000100:00100000:1.0:1746065197.475416:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360640 00000100:00100000:1.0:1746065197.475419:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360640 00010000:00010000:1.0:1746065197.475433:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 252 pid: 14643 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.475446:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7855 00000100:00100000:1.0:1746065197.475450:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:1960:x1830881263360640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.475456:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.475460:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 252 pid: 14643 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.475467:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 252 pid: 14643 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.475478:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2000/0x14b4f8542d4feaa4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61af3 expref: 252 pid: 14643 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.475497:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.475500:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065197.475505:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065197.475509:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.475525:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881263360640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 74us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.475529:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7855 00000100:00100000:0.0:1746065197.476389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.476427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.476482:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263360896 00000100:00100000:2.0:1746065197.476486:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263360896 00010000:00010000:2.0:1746065197.476500:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 8 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.476516:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7856 00000100:00100000:2.0:1746065197.476520:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:1960:x1830881263360896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.476526:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.476529:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 8 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.476537:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 8 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.476546:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944f2800/0x14b4f8542d4fea81 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61aec expref: 8 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.476556:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.476559:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476564:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476569:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476586:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.476602:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263360896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.476607:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7856 00010000:00010000:2.0:1746065197.476619:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476624:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065197.476636:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065197.476734:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53cea00/0x14b4f8542d4feac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 252 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.476743:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.476748:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.476751:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065197.476752:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0087a00, rc 0) 00000100:00100000:2.0:1746065197.476767:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32155:x1830881263359744:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7198us (7800us total) trans 8589944419 rc 0/0 00000100:00100000:2.0:1746065197.476771:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10128 00000100:00100000:2.0:1746065197.476782:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361152 00000100:00100000:2.0:1746065197.476783:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361152 00000100:00100000:2.0:1746065197.476794:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10130 00000100:00100000:2.0:1746065197.476797:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+7:32160:x1830881263361152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.476807:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.476833:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc200/0x14b4f8542d4feaf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b32 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.476887:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476893:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476898:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476906:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476910:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476915:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476974:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476979:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.476983:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065197.476987:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065197.477015:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477020:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477026:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477030:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800930cc000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.477033:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477039:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477045:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065197.477047:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065197.477049:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477053:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc000/0x14b4f8542d4feaff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477059:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477063:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477067:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477070:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800930cd200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.477071:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477075:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477082:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090d6fa00) 00010000:00010000:2.0:1746065197.477084:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065197.477086:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477089:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd200/0x14b4f8542d4feb06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065197.477109:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cc200/0x14b4f8542d4feaf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.477115:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.477120:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.477122:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065197.477123:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cd000, rc 0) 00000100:00100000:2.0:1746065197.477136:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+9:32160:x1830881263361152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 339us (710us total) trans 8589944420 rc 0/0 00000100:00100000:2.0:1746065197.477141:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10130 00000100:00100000:0.0:1746065197.483351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.483390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.483421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.483515:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361280 00000100:00100000:3.0:1746065197.483523:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361280 00000100:00100000:3.0:1746065197.483559:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4376 00000100:00100000:3.0:1746065197.483566:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32155:x1830881263361280:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:3.0:1746065197.483664:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32155:x1830881263361280:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.483670:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4376 00000100:00100000:2.0:1746065197.483749:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361408 00000100:00100000:2.0:1746065197.483753:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361408 00000100:00100000:2.0:1746065197.483769:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361536 00000100:00100000:2.0:1746065197.483771:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361536 00000100:00100000:2.0:1746065197.483783:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15241 00000100:00100000:2.0:1746065197.483788:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+8:1959:x1830881263361408:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.483797:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.483811:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b39 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.483854:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.483857:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.483864:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.483877:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.483887:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cc400, rc 0) 00000100:00100000:2.0:1746065197.483920:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263361408:12345-192.168.202.46@tcp:101:cat.0 Request processed in 131us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.483925:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15241 00000100:00100000:2.0:1746065197.483936:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15242 00000100:00100000:2.0:1746065197.483941:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+9:1959:x1830881263361536:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.483947:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.483955:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b40 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.483965:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.483966:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.483970:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.483978:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.483990:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cda00, rc 0) 00000100:00100000:2.0:1746065197.484005:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263361536:12345-192.168.202.46@tcp:101:cat.0 Request processed in 65us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.484010:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15242 00000100:00100000:2.0:1746065197.496390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.496412:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.497731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.497977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.498008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.498021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.498040:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362304 00000100:00100000:2.0:1746065197.498046:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362304 00002000:00100000:2.0:1746065197.498084:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f213480 x1830881263362304/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.498092:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f213480 with x1830881263362304 ext(0->1048575) 00002000:00010000:2.0:1746065197.498097:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f213480 00000100:00100000:2.0:1746065197.498109:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362560 00000100:00100000:2.0:1746065197.498111:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362560 00002000:00100000:2.0:1746065197.498120:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f213800 x1830881263362560/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.498126:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f213800 with x1830881263362560 ext(1048576->2097151) 00002000:00010000:2.0:1746065197.498128:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f213800 00000100:00100000:2.0:1746065197.498137:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8593 00000100:00100000:2.0:1746065197.498142:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263362304:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.499873:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8594 00000100:00100000:2.0:1746065197.499886:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263362560:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.500872:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361664 00000100:00100000:3.0:1746065197.500880:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361664 00000100:00100000:3.0:1746065197.500923:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361792 00000100:00100000:3.0:1746065197.500926:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361792 00000100:00100000:3.0:1746065197.500936:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263361920 00000100:00100000:3.0:1746065197.500938:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263361920 00000100:00100000:3.0:1746065197.500946:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362048 00000100:00100000:3.0:1746065197.500948:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362048 00000100:00100000:3.0:1746065197.500960:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15243 00000100:00100000:3.0:1746065197.500964:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263361664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.500974:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.500987:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b47 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.501004:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.501006:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.501012:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.501024:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.501032:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf7000, rc 0) 00000100:00100000:3.0:1746065197.501065:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263361664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 100us (4683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.501070:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15243 00000100:00100000:3.0:1746065197.501085:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15244 00000100:00100000:3.0:1746065197.501090:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263361792:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.501101:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.501111:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b4e expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.501123:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.501124:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.501128:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.501139:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.501146:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf6a00, rc 0) 00000100:00100000:3.0:1746065197.501170:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263361792:12345-192.168.202.46@tcp:101:cat.0 Request processed in 78us (4755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.501175:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15244 00000100:00100000:3.0:1746065197.501188:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15245 00000100:00100000:3.0:1746065197.501194:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+10:1959:x1830881263361920:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.501201:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.501208:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b55 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.501220:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.501221:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.501225:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.501239:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.501246:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf6c00, rc 0) 00000100:00100000:3.0:1746065197.501267:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263361920:12345-192.168.202.46@tcp:101:cat.0 Request processed in 73us (3539us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.501272:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15245 00000100:00100000:3.0:1746065197.501285:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15246 00000100:00100000:3.0:1746065197.501291:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263362048:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.501298:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.501306:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b5c expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.501316:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.501317:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.501322:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.501331:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.501338:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cf7200, rc 0) 00000100:00100000:3.0:1746065197.501358:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263362048:12345-192.168.202.46@tcp:101:cat.0 Request processed in 67us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.501363:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15246 00000100:00100000:3.0:1746065197.501430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.502553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.502627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.507197:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363328 00000100:00100000:0.0:1746065197.507211:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363328 00000100:00100000:0.0:1746065197.507266:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10131 00000100:00100000:0.0:1746065197.507273:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32155:x1830881263363328:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065197.507290:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.507293:0:20754:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065197.507322:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4feaea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b2b expref: 251 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.507342:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065197.507347:0:20754:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065197.507358:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b400/0x14b4f8542d4feb45 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b63 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.507398:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.507408:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.507415:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.507420:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 5/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.507446:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.507456:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 8 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.507465:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260465792:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.507536:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.507543:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 8 pid: 14643 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.507550:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260465920:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.507569:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.507618:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263362816 00000100:00100000:0.0:1746065197.507621:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263362816 00002000:00100000:0.0:1746065197.507641:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009a4ea300 x1830881263362816/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.507649:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ea300 with x1830881263362816 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.507653:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ea300 00000100:00100000:0.0:1746065197.507662:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363072 00000100:00100000:0.0:1746065197.507665:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363072 00002000:00100000:0.0:1746065197.507687:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009a4e9500 x1830881263363072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.507694:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9500 with x1830881263363072 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.507696:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e9500 00000100:00100000:0.0:1746065197.507707:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8595 00000100:00100000:0.0:1746065197.507712:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263362816:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065197.508808:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8596 00000100:00100000:0.0:1746065197.508828:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263363072:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065197.511628:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881263362304:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13478us (13611us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065197.511639:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8593 00002000:00100000:1.0:1746065197.511648:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f213480 x1830881263362304/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.511657:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f213480 with x1830881263362304 ext(0->1048575) 00002000:00010000:1.0:1746065197.511662:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f213480 00000100:00100000:1.0:1746065197.530860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.530911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.531153:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363456 00000100:00100000:3.0:1746065197.531161:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363456 00010000:00010000:3.0:1746065197.531197:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 9 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.531226:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363584 00000100:00100000:3.0:1746065197.531230:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363584 00010000:00010000:3.0:1746065197.531246:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 9 pid: 14643 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.531290:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7857 00000100:00100000:3.0:1746065197.531299:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263363456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.531315:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.531323:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 9 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.531333:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 9 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.531353:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065197.531358:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.531365:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.531369:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.531416:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263363456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 116us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.531422:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7857 00000100:00100000:3.0:1746065197.531441:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7858 00000100:00100000:3.0:1746065197.531447:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263363584:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.531455:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.531459:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 9 pid: 14643 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.531468:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 9 pid: 14643 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.531479:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065197.531481:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.531488:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.531494:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.531511:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.531531:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263363584:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.531537:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7858 00010000:00010000:0.0:1746065197.532568:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd000/0x14b4f8542d4feb0d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b32 expref: 8 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.532591:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260465792:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.532605:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d2e00/0x14b4f8542d4fea65 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ae5 expref: 8 pid: 14643 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065197.532614:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f469500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260465920:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.532638:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.532645:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.532650:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000040:00080000:0.0:1746065197.533369:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3165, 88 off267952 00000004:00080000:0.0:1746065197.533377:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824561286ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533424:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3182, 88 off269624 00000004:00080000:0.0:1746065197.533429:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796824614027ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065197.533475:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3183, 88 off269712 00000004:00080000:0.0:1746065197.533481:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796824665804ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065197.533492:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3166, 88 off268040 00000004:00080000:0.0:1746065197.533496:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824680516ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533504:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3167, 88 off268128 00000004:00080000:0.0:1746065197.533507:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824692036ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533516:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3184, 88 off269800 00000004:00080000:0.0:1746065197.533520:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796824704556ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065197.533528:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3185, 88 off269888 00000004:00080000:0.0:1746065197.533531:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796824715875ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065197.533539:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3186, 88 off269976 00000004:00080000:0.0:1746065197.533542:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796824726784ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065197.533550:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3168, 88 off268216 00000004:00080000:0.0:1746065197.533553:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824737985ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533561:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3187, 88 off270064 00000004:00080000:0.0:1746065197.533566:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796824750540ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065197.533576:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3169, 88 off268304 00000004:00080000:0.0:1746065197.533578:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824763099ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533586:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3188, 88 off270152 00000004:00080000:0.0:1746065197.533589:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796824773980ns, next at 737095943431ns, rc = 0 00000040:00080000:0.0:1746065197.533597:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3170, 88 off268392 00000004:00080000:0.0:1746065197.533600:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824784721ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533608:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3171, 88 off268480 00000004:00080000:0.0:1746065197.533611:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824795471ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533618:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3172, 88 off268568 00000004:00080000:0.0:1746065197.533621:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824805587ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533628:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3173, 88 off268656 00000004:00080000:0.0:1746065197.533631:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796824815399ns, next at 737048221954ns, rc = 0 00000040:00080000:0.0:1746065197.533639:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3189, 88 off270240 00000004:00080000:0.0:1746065197.533641:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796824825657ns, next at 737095943431ns, rc = 0 00000100:00100000:0.0:1746065197.548229:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263362816:12345-192.168.202.46@tcp:3:cat.0 Request processed in 40508us (46791us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065197.548238:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8595 00002000:00100000:0.0:1746065197.548248:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009a4ea300 x1830881263362816/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.548256:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ea300 with x1830881263362816 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.548262:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ea300 00000100:00100000:3.0:1746065197.548367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.548474:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363712 00000100:00100000:0.0:1746065197.548480:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363712 00000100:00100000:0.0:1746065197.548516:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10132 00000100:00100000:0.0:1746065197.548522:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32156:x1830881263363712:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.548534:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.548549:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b6a expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.548597:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.548605:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.548617:0:14643:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.548626:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.548635:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065197.548638:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065197.548641:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.548646:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c733800, rc 0) 00000100:00100000:0.0:1746065197.548663:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:32156:x1830881263363712:12345-192.168.202.46@tcp:101:cat.0 Request processed in 142us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.548667:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10132 00000100:00100000:3.0:1746065197.548990:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263362560:12345-192.168.202.46@tcp:3:cat.0 Request processed in 49104us (50963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.549001:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8594 00002000:00100000:3.0:1746065197.549009:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f213800 x1830881263362560/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.549015:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f213800 with x1830881263362560 ext(1048576->2097151) 00002000:00010000:3.0:1746065197.549018:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f213800 00000100:00100000:0.0:1746065197.559782:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.559808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.559839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.559851:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.559886:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263363968 00000100:00100000:0.0:1746065197.559893:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263363968 00000100:00100000:2.0:1746065197.559923:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364224 00000100:00100000:2.0:1746065197.559926:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364224 00002000:00100000:0.0:1746065197.559926:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f469500 x1830881263363968/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.559935:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469500 with x1830881263363968 ext(0->1048575) 00002000:00100000:2.0:1746065197.559939:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f469180 x1830881263364224/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746065197.559939:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f469500 00002000:00100000:2.0:1746065197.559945:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469180 with x1830881263364224 ext(1048576->2097151) 00002000:00010000:2.0:1746065197.559947:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469180 00000100:00100000:0.0:1746065197.559951:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364480 00000100:00100000:0.0:1746065197.559953:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364480 00000100:00100000:2.0:1746065197.559954:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364736 00000100:00100000:2.0:1746065197.559955:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364736 00002000:00100000:0.0:1746065197.559960:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009f46ad80 x1830881263364480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.559961:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f469880 x1830881263364736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.559967:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46ad80 with x1830881263364480 ext(1048576->2097151) 00002000:00100000:2.0:1746065197.559968:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469880 with x1830881263364736 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.559969:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46ad80 00002000:00010000:2.0:1746065197.559970:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f469880 00000100:00100000:0.0:1746065197.559979:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8597 00000100:00100000:0.0:1746065197.559985:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263363968:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.560189:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8598 00000100:00100000:2.0:1746065197.560194:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263364224:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065197.560938:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8599 00000100:00100000:1.0:1746065197.560948:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8600 00000100:00100000:1.0:1746065197.560953:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263364736:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065197.561379:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263364480:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065197.565900:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263363072:12345-192.168.202.46@tcp:3:cat.0 Request processed in 57079us (63344us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065197.566102:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8596 00002000:00100000:1.0:1746065197.566114:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009a4e9500 x1830881263363072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.566123:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4e9500 with x1830881263363072 ext(1048576->2097151) 00002000:00010000:1.0:1746065197.566128:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4e9500 00000100:00100000:3.0:1746065197.574729:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263364224:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14528us (14914us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.574741:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8598 00002000:00100000:3.0:1746065197.574752:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009f469180 x1830881263364224/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.574761:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469180 with x1830881263364224 ext(1048576->2097151) 00002000:00010000:3.0:1746065197.574766:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f469180 00010000:00010000:1.0:1746065197.579603:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 254 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.579615:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.579617:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065197.579621:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.579633:0:20754:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.579638:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.579670:0:20754:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 254 pid: 14643 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.579694:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260466048:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065197.579771:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb6c0 going to sleep for 11 seconds 00000001:00080000:0.0:1746065197.580874:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944421 is committed 00000004:00080000:0.0:1746065197.580880:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2470 committed 00000004:00080000:0.0:1746065197.580890:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2453 committed 00000004:00080000:0.0:1746065197.580895:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2452 committed 00000004:00080000:0.0:1746065197.580896:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2451 committed 00000004:00080000:0.0:1746065197.580898:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2450 committed 00000004:00080000:0.0:1746065197.580899:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2469 committed 00000004:00080000:0.0:1746065197.580900:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2449 committed 00000004:00080000:0.0:1746065197.580901:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2468 committed 00000004:00080000:0.0:1746065197.580903:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2448 committed 00000004:00080000:0.0:1746065197.580904:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2467 committed 00000004:00080000:0.0:1746065197.580905:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2466 committed 00000004:00080000:0.0:1746065197.580907:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2465 committed 00000004:00080000:0.0:1746065197.580908:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2447 committed 00000004:00080000:0.0:1746065197.580909:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2446 committed 00000004:00080000:0.0:1746065197.580911:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2464 committed 00000004:00080000:0.0:1746065197.580912:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2463 committed 00000004:00080000:0.0:1746065197.580914:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2445 committed 00000001:00080000:0.0:1746065197.580925:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944420 is committed 00000001:00080000:0.0:1746065197.580931:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944416 is committed 00000100:00100000:0.0:1746065197.581001:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260466176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.581033:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.581050:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260466688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.581059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.581074:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065197.581077:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260466304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.581089:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.581098:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260466816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.581109:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.581120:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260467200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.581133:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.581143:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260467712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.581155:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.581171:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065197.581175:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260467328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065197.581179:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260466176 00000100:00100000:2.0:1746065197.581185:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260466176 00000100:00100000:0.0:1746065197.581185:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.581195:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260467840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.581205:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065197.581211:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260466688 00000100:00100000:2.0:1746065197.581213:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260466688 00000100:00100000:2.0:1746065197.581221:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260466304 00000100:00100000:2.0:1746065197.581223:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260466304 00000100:00100000:0.0:1746065197.581225:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260466816 00000100:00100000:0.0:1746065197.581227:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260466816 00000100:00100000:2.0:1746065197.581231:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467200 00000100:00100000:2.0:1746065197.581233:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467200 00000100:00100000:0.0:1746065197.581238:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467712 00000100:00100000:2.0:1746065197.581240:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467328 00000100:00100000:0.0:1746065197.581240:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467712 00000100:00100000:2.0:1746065197.581241:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467328 00000100:00100000:0.0:1746065197.581246:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467840 00000100:00100000:0.0:1746065197.581247:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467840 00000100:00100000:2.0:1746065197.581251:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15247 00000100:00100000:2.0:1746065197.581261:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3295:x1830881260466176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065197.581422:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065197.581425:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065197.581427:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065197.581429:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065197.581431:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:2.0:1746065197.581461:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3295:x1830881260466176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (426us total) trans 21474841024 rc 0/0 00000100:00100000:2.0:1746065197.581963:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15247 00000100:00100000:0.0:1746065197.581967:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15248 00000100:00100000:0.0:1746065197.581973:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3295:x1830881260466688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065197.581976:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15249 00000100:00100000:2.0:1746065197.581980:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3295:x1830881260466304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.582002:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15250 00000100:00100000:0.0:1746065197.582006:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3295:x1830881260466816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065197.582051:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065197.582054:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065197.582055:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065197.582057:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065197.582059:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065197.582075:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260466304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (985us total) trans 21474841025 rc 0/0 00000100:00100000:0.0:1746065197.582075:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260466816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (965us total) trans 21474841026 rc 0/0 00000100:00100000:0.0:1746065197.582080:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15250 00000100:00100000:2.0:1746065197.582082:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15249 00000100:00100000:2.0:1746065197.582091:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15251 00000100:00100000:2.0:1746065197.582095:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881260467200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.582217:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15252 00000100:00100000:0.0:1746065197.582223:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881260467712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065197.582294:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065197.582296:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.582298:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.582299:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065197.582300:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065197.582316:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3295:x1830881260467712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (1160us total) trans 17179873735 rc 0/0 00000100:00100000:0.0:1746065197.582320:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15252 00000100:00100000:0.0:1746065197.582329:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15253 00000100:00100000:0.0:1746065197.582332:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881260467328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065197.582380:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065197.582382:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065197 -> 1746065197 00002000:00010000:0.0:1746065197.582384:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065197 -> 1746065197 00002000:00010000:0.0:1746065197.582385:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065197 -> 1746065197 00002000:00010000:0.0:1746065197.582387:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065197.582401:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3295:x1830881260467328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1214us total) trans 17179873736 rc 0/0 00000100:00100000:0.0:1746065197.582405:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15253 00000100:00100000:0.0:1746065197.582411:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15254 00000100:00100000:0.0:1746065197.582414:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881260467840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065197.582464:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3295:x1830881260467840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (1258us total) trans 17179873737 rc 0/0 00000100:00100000:0.0:1746065197.582468:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15254 00000004:00080000:0.0:1746065197.582497:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f210700/2, rc 0, transno 17179873736 00000100:00100000:0.0:1746065197.582501:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260467328:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065197.582507:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fb100/2, rc 0, transno 17179873737 00000100:00100000:0.0:1746065197.582509:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260467840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065197.582514:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fbb80/2, rc 0, transno 17179873735 00000100:00100000:0.0:1746065197.582515:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260467712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065197.582521:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba1ca80/2, rc 0, transno 21474841025 00000100:00100000:0.0:1746065197.582526:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260466304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065197.582531:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d136a00/2, rc 0, transno 21474841026 00000100:00100000:0.0:1746065197.582533:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260466816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065197.582538:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f468e00/2, rc 0, transno 21474841024 00000100:00100000:0.0:1746065197.582540:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260466176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.582565:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065197.582571:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260468224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.582587:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065197.582602:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260468224 00000100:00100000:0.0:1746065197.582605:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260468224 00000100:00100000:0.0:1746065197.582618:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15255 00000100:00100000:0.0:1746065197.582621:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3296:x1830881260468224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.582697:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3296:x1830881260468224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (109us total) trans 21474841027 rc 0/0 00000100:00100000:0.0:1746065197.582702:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15255 00000004:00080000:0.0:1746065197.582719:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fcace00/2, rc 0, transno 21474841027 00000100:00100000:0.0:1746065197.582722:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260468224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065197.582789:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1830881260466688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 817us (1728us total) trans 21474841028 rc 0/0 00000100:00100000:0.0:1746065197.582794:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15248 00000004:00080000:0.0:1746065197.582808:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d134700/2, rc 0, transno 21474841028 00000100:00100000:0.0:1746065197.582810:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260466688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065197.582973:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f46ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+12:1959:x1830881263364480:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22026us (23131us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065197.582980:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8599 00002000:00100000:1.0:1746065197.582987:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009f46ad80 x1830881263364480/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.582995:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f46ad80 with x1830881263364480 ext(1048576->2097151) 00002000:00010000:1.0:1746065197.582999:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f46ad80 00000100:00100000:3.0:1746065197.583072:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260466432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.583092:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.583114:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260466944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.583126:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.583133:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260467456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065197.583144:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.583152:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260467968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065197.583161:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.583171:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746065197.583174:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260466560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.583185:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.583191:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260467072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.583200:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.583205:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800913fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260467584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065197.583215:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.583220:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260468096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065197.583229:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065197.583244:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260466432 00000100:00100000:3.0:1746065197.583247:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260466432 00000100:00100000:3.0:1746065197.583258:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260466944 00000100:00100000:3.0:1746065197.583259:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260466944 00000100:00100000:3.0:1746065197.583264:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467456 00000100:00100000:3.0:1746065197.583265:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467456 00000100:00100000:3.0:1746065197.583270:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467968 00000100:00100000:3.0:1746065197.583271:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467968 00000100:00100000:3.0:1746065197.583276:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260466560 00000100:00100000:3.0:1746065197.583277:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260466560 00000100:00100000:3.0:1746065197.583282:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467072 00000100:00100000:3.0:1746065197.583283:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467072 00000100:00100000:3.0:1746065197.583289:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260467584 00000100:00100000:3.0:1746065197.583290:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260467584 00000100:00100000:3.0:1746065197.583295:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260468096 00000100:00100000:3.0:1746065197.583296:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260468096 00000100:00100000:3.0:1746065197.583304:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15256 00000100:00100000:3.0:1746065197.583307:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830881260466432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065197.583377:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:3.0:1746065197.583379:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065197.583380:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:3.0:1746065197.583382:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065197.583383:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5769 -> 5769 00000100:00100000:3.0:1746065197.583404:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881260466432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (311us total) trans 21474841029 rc 0/0 00000100:00100000:3.0:1746065197.583409:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15256 00000100:00100000:3.0:1746065197.583418:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15257 00000100:00100000:3.0:1746065197.583422:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830881260466944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065197.583477:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583479:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583481:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583482:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583483:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065197.583500:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881260466944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (373us total) trans 21474841030 rc 0/0 00000100:00100000:3.0:1746065197.583505:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15257 00000100:00100000:3.0:1746065197.583514:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15258 00000100:00100000:3.0:1746065197.583517:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881260467456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065197.583578:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065197.583580:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065197.583582:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065197 -> 1746065197 00002000:00010000:3.0:1746065197.583583:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065197.583584:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746065197.583599:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881260467456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (454us total) trans 17179873738 rc 0/0 00000100:00100000:3.0:1746065197.583603:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15258 00000100:00100000:3.0:1746065197.583611:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15259 00000100:00100000:3.0:1746065197.583615:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881260467968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065197.583690:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881260467968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (527us total) trans 17179873739 rc 0/0 00000100:00100000:3.0:1746065197.583695:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15259 00000100:00100000:3.0:1746065197.583703:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15260 00000100:00100000:3.0:1746065197.583707:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830881260466560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065197.583761:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583763:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583764:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583766:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583767:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065197.583783:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881260466560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (597us total) trans 21474841031 rc 0/0 00000100:00100000:3.0:1746065197.583787:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15260 00000100:00100000:3.0:1746065197.583795:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15261 00000100:00100000:3.0:1746065197.583799:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830881260467072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065197.583881:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3297:x1830881260467072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (679us total) trans 21474841032 rc 0/0 00000100:00100000:3.0:1746065197.583886:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15261 00000100:00100000:3.0:1746065197.583894:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15262 00000100:00100000:3.0:1746065197.583897:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881260467584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065197.583953:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065197.583955:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065197.583957:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065197.583958:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065197.583959:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065197.583974:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881260467584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (759us total) trans 17179873740 rc 0/0 00000100:00100000:3.0:1746065197.583982:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15262 00000100:00100000:3.0:1746065197.583994:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15263 00000100:00100000:3.0:1746065197.583998:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830881260468096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065197.584063:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830881260468096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (832us total) trans 17179873741 rc 0/0 00000100:00100000:3.0:1746065197.584067:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15263 00000004:00080000:3.0:1746065197.584126:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095350a80/2, rc 0, transno 21474841031 00000100:00100000:3.0:1746065197.584129:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260466560:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065197.584134:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d135500/2, rc 0, transno 21474841032 00000100:00100000:3.0:1746065197.584136:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260467072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065197.584142:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fb480/2, rc 0, transno 17179873740 00000100:00100000:3.0:1746065197.584145:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260467584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065197.584151:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa77b80/2, rc 0, transno 17179873741 00000100:00100000:3.0:1746065197.584153:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260468096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065197.584158:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095351c00/2, rc 0, transno 21474841029 00000100:00100000:3.0:1746065197.584161:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260466432:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065197.584165:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d136d80/2, rc 0, transno 21474841030 00000100:00100000:3.0:1746065197.584168:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260466944:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065197.584174:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800913fb800/2, rc 0, transno 17179873738 00000100:00100000:3.0:1746065197.584176:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800913fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260467456:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065197.584181:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb10e00/2, rc 0, transno 17179873739 00000100:00100000:3.0:1746065197.584183:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260467968:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065197.584374:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065197.584377:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065197 -> 1746065197 00002000:00010000:2.0:1746065197.584378:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:2.0:1746065197.584380:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065197 -> 1746065197 00002000:00010000:2.0:1746065197.584382:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065197.584420:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3295:x1830881260467200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2324us (3285us total) trans 17179873742 rc 0/0 00000100:00100000:2.0:1746065197.584425:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15251 00000004:00080000:1.0:1746065197.584588:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f212a00/2, rc 0, transno 17179873742 00000100:00100000:1.0:1746065197.584591:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260467200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065197.587360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.587389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.587399:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364864 00000100:00100000:3.0:1746065197.587406:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364864 00000100:00100000:2.0:1746065197.587430:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263364992 00000100:00100000:2.0:1746065197.587433:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263364992 00000100:00100000:3.0:1746065197.587438:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4377 00000100:00100000:3.0:1746065197.587443:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b879c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32156:x1830881263364864:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:2.0:1746065197.587450:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10133 00000100:00100000:2.0:1746065197.587453:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+6:32153:x1830881263364992:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065197.587463:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.587476:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b71 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.587506:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.587516:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.587524:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b879c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32156:x1830881263364864:12345-192.168.202.46@tcp:49:cat.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.587529:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4377 00010000:00010000:2.0:1746065197.587529:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.587532:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065197.587535:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f6000, rc 0) 00000100:00100000:2.0:1746065197.587546:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+7:32153:x1830881263364992:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 92us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.587550:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10133 00000100:00100000:0.0:1746065197.587764:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260466048:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065197.587784:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b400/0x14b4f8542d4feb45 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 251 pid: 20754 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065197.587795:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 250 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.587806:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66b600, rc 0) 00000100:00100000:0.0:1746065197.587848:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32155:x1830881263363328:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 80575us (85222us total) trans 8589944421 rc 0/0 00000100:00100000:0.0:1746065197.587853:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10131 00000100:00100000:0.0:1746065197.588423:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263364736:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27468us (28569us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065197.588433:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8600 00002000:00100000:0.0:1746065197.588440:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f469880 x1830881263364736/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.588447:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469880 with x1830881263364736 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.588452:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f469880 00000100:00100000:2.0:1746065197.588476:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263363968:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28491us (28700us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065197.588482:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8597 00002000:00100000:2.0:1746065197.588486:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009f469500 x1830881263363968/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.588491:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f469500 with x1830881263363968 ext(0->1048575) 00002000:00010000:2.0:1746065197.588494:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f469500 00000100:00100000:0.0:1746065197.595896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.595940:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365120 00000100:00100000:3.0:1746065197.595951:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365120 00000100:00100000:3.0:1746065197.595997:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15264 00000100:00100000:3.0:1746065197.596004:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:32155:x1830881263365120:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065197.596018:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.596032:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b78 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.596056:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.596064:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.596070:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.596072:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.596075:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1536000->1662975] (req 1536000->1662975) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.596100:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.596111:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 11 pid: 21998 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.596121:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260468352:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.596198:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.596205:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 28 pid: 8428 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.596212:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260468480:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.596227:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.596256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.596347:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365376 00000100:00100000:3.0:1746065197.596350:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365376 00002000:00100000:3.0:1746065197.596373:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fcaf800 x1830881263365376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.596381:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaf800 with x1830881263365376 ext(1048576->2097151) 00002000:00010000:3.0:1746065197.596384:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcaf800 00000100:00100000:3.0:1746065197.596396:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8601 00000100:00100000:3.0:1746065197.596401:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263365376:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065197.597972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.598012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.598031:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365504 00000100:00100000:0.0:1746065197.598036:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365504 00010000:00010000:0.0:1746065197.598058:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.598295:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365632 00000100:00100000:0.0:1746065197.598298:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365632 00010000:00010000:0.0:1746065197.598308:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 31 pid: 8428 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.598320:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260468352:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.598322:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7859 00000100:00100000:0.0:1746065197.598327:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263365504:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065197.598329:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260468480:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.598336:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.598351:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [1536000->1662975] (req 1536000->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 31 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.598351:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.598359:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00000100:00100000:2.0:1746065197.598398:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7860 00000100:00100000:2.0:1746065197.598406:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263365632:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.598412:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.598462:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cf7000/0x14b4f8542d4feb29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b47 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.598475:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.598497:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263365504:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 168us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.598502:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7859 00010000:00010000:2.0:1746065197.598548:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 31 pid: 8428 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.598557:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 31 pid: 8428 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.598568:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f66a400/0x14b4f8542d4feac0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b0f expref: 31 pid: 8428 timeout: 896 lvb_type: 1 00010000:00010000:2.0:1746065197.598581:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.598583:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.598588:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.598595:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.598621:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065197.598630:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260468608:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065197.598662:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832480 going to sleep for 11 seconds 00010000:00010000:3.0:1746065197.598861:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cd9e00, rc 0) 00000100:00100000:3.0:1746065197.598883:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:32155:x1830881263365120:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2879us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.598888:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15264 00000100:00100000:0.0:1746065197.602494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.602712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.602837:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263365760 00000100:00100000:3.0:1746065197.602844:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263365760 00000100:00100000:1.0:1746065197.603137:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366016 00000100:00100000:1.0:1746065197.603141:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366016 00002000:00100000:1.0:1746065197.603171:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012ec89180 x1830881263366016/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.603185:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec89180 with x1830881263366016 ext(1048576->2097151) 00002000:00010000:1.0:1746065197.603190:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec89180 00000100:00100000:1.0:1746065197.603206:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8602 00000100:00100000:1.0:1746065197.603212:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263366016:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.603877:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15265 00000100:00100000:3.0:1746065197.603884:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:32153:x1830881263365760:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065197.603892:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.603906:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b7f expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.603927:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 29 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.603934:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 13 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.603939:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.603941:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.603943:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [4046848->4194303] (req 4046848->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.603966:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 13 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.603977:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 13 pid: 21998 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.603987:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260468736:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.604049:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 29 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.604057:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 29 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.604065:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260468864:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.604082:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.604579:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260468608:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065197.604593:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.604624:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263365632:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6219us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.604632:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7860 00000100:00100000:3.0:1746065197.604710:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263365376:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 8307us (8453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.604716:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8601 00002000:00100000:3.0:1746065197.604722:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009fcaf800 x1830881263365376/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.604729:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaf800 with x1830881263365376 ext(1048576->2097151) 00002000:00010000:3.0:1746065197.604732:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fcaf800 00000100:00100000:0.0:1746065197.606352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.608514:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366272 00000100:00100000:3.0:1746065197.608525:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366272 00002000:00100000:3.0:1746065197.608563:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1536000->1540095) req@ffff880094d97b80 x1830881263366272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.608580:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97b80 with x1830881263366272 ext(1536000->1540095) 00002000:00010000:3.0:1746065197.608585:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d97b80 00000100:00100000:3.0:1746065197.608659:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8603 00000100:00100000:3.0:1746065197.608667:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263366272:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065197.609386:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263366272:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 718us (3036us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065197.609394:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8603 00002000:00100000:3.0:1746065197.609400:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1536000->1540095) req@ffff880094d97b80 x1830881263366272/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.609408:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97b80 with x1830881263366272 ext(1536000->1540095) 00002000:00010000:3.0:1746065197.609411:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d97b80 00000100:00100000:3.0:1746065197.609449:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260468736:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.611737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.612325:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260468864:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.612355:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [4046848->4194303] (req 4046848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 14 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.612371:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c8ea00, rc 0) 00000100:00100000:3.0:1746065197.612409:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:32153:x1830881263365760:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8526us (9923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.612416:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15265 00000100:00100000:0.0:1746065197.612833:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.612974:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366528 00000100:00100000:3.0:1746065197.612979:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366528 00010000:00010000:3.0:1746065197.613001:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 27 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.613236:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366400 00000100:00100000:3.0:1746065197.613239:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366400 00010000:00010000:3.0:1746065197.613250:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 14 pid: 21998 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.613276:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7861 00000100:00100000:3.0:1746065197.613282:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263366528:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.613291:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065197.613303:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7862 00010000:00010000:3.0:1746065197.613309:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 27 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:1.0:1746065197.613311:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263366400:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.613317:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 27 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065197.613320:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.613336:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f66be00/0x14b4f8542d4feae3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b24 expref: 27 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065197.613337:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 14 pid: 21998 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065197.613348:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 14 pid: 21998 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065197.613360:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cf7200/0x14b4f8542d4feb3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b5c expref: 14 pid: 21998 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065197.613373:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.613375:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.613380:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.613388:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.613413:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.613424:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260468992:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065197.613485:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb300 going to sleep for 11 seconds 00010000:00010000:3.0:1746065197.613585:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.613605:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263366528:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 323us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.613610:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7861 00000100:00100000:1.0:1746065197.614542:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263366016:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11327us (11827us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065197.614550:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8602 00002000:00100000:1.0:1746065197.614557:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012ec89180 x1830881263366016/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.614566:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ec89180 with x1830881263366016 ext(1048576->2097151) 00002000:00010000:1.0:1746065197.614571:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ec89180 00000100:00100000:0.0:1746065197.615874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.616084:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366784 00000100:00100000:1.0:1746065197.616091:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366784 00002000:00100000:1.0:1746065197.616120:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094d95c00 x1830881263366784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 504/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.616128:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95c00 with x1830881263366784 ext(1048576->2097151) 00002000:00010000:1.0:1746065197.616133:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95c00 00000100:00100000:1.0:1746065197.616165:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8604 00000100:00100000:1.0:1746065197.616172:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263366784:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065197.620071:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260468992:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065197.620089:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.620120:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263366400:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6809us (7287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.620129:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7862 00000100:00100000:0.0:1746065197.621773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.621872:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263366912 00000100:00100000:3.0:1746065197.621878:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263366912 00000100:00100000:3.0:1746065197.621920:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15266 00000100:00100000:3.0:1746065197.621926:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:32160:x1830881263366912:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.621943:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.621960:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b86 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.621986:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.621992:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.621994:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.621997:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.622020:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 27 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.622030:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 27 pid: 8429 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.622040:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260469120:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.622090:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.623618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.624591:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367168 00000100:00100000:3.0:1746065197.624600:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367168 00002000:00100000:3.0:1746065197.624635:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (4046848->4050943) req@ffff880094d97480 x1830881263367168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.624645:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97480 with x1830881263367168 ext(4046848->4050943) 00002000:00010000:3.0:1746065197.624649:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d97480 00000100:00100000:3.0:1746065197.625169:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8605 00000100:00100000:3.0:1746065197.625178:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263367168:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.626207:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263367168:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1027us (2590us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065197.626214:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8605 00002000:00100000:3.0:1746065197.626221:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (4046848->4050943) req@ffff880094d97480 x1830881263367168/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.626229:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97480 with x1830881263367168 ext(4046848->4050943) 00002000:00010000:3.0:1746065197.626233:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d97480 00000100:00100000:3.0:1746065197.626654:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260469120:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.626686:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.626703:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1d5e00, rc 0) 00000100:00100000:3.0:1746065197.626738:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:32160:x1830881263366912:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4812us (4973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.626743:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15266 00000100:00100000:1.0:1746065197.626927:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1960:x1830881263366784:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 10755us (11058us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746065197.626934:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8604 00002000:00100000:1.0:1746065197.626940:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff880094d95c00 x1830881263366784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 504/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.626953:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95c00 with x1830881263366784 ext(1048576->2097151) 00010000:00010000:1.0:1746065197.626959:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 26 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.626970:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 26 pid: 8429 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746065197.626976:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d95c00 00000100:00100000:0.0:1746065197.630393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.630527:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367296 00000100:00100000:3.0:1746065197.630535:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367296 00000100:00100000:3.0:1746065197.630569:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15267 00000100:00100000:3.0:1746065197.630576:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:32153:x1830881263367296:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065197.630590:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.630603:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b8d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.630629:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.630637:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.630642:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.630643:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.630646:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4902911] (req 4194304->4902911) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.632456:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.632471:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.632484:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260469248:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.632584:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.632591:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 16 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:3.0:1746065197.632597:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260469376:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.632611:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.634248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.634311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.634485:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367808 00000100:00100000:1.0:1746065197.634485:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367552 00000100:00100000:3.0:1746065197.634492:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367808 00000100:00100000:1.0:1746065197.634492:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367552 00002000:00100000:3.0:1746065197.634528:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009b9fc700 x1830881263367808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.634528:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x388:0x0] (1536000->1662975) req@ffff88009b9fed80 x1830881263367552/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.634536:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fc700 with x1830881263367808 ext(1048576->2097151) 00002000:00100000:1.0:1746065197.634536:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fed80 with x1830881263367552 ext(1536000->1662975) 00002000:00010000:3.0:1746065197.634541:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fc700 00010000:00010000:1.0:1746065197.634543:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 26 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.634555:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 26 pid: 8429 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.634557:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8606 00002000:00010000:1.0:1746065197.634560:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b9fed80 00000100:00100000:3.0:1746065197.634564:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263367808:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065197.634571:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2600 00000100:00100000:1.0:1746065197.634575:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263367552:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:0.0:1746065197.637236:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.637439:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260469248:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.637449:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260469376:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.637473:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4194304->4902911] (req 4194304->4902911) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.637487:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1d4000, rc 0) 00000100:00100000:3.0:1746065197.637508:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:32153:x1830881263367296:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6932us (7120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.637514:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15267 00000100:00100000:0.0:1746065197.638207:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263367936 00000100:00100000:0.0:1746065197.638213:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263367936 00010000:00010000:0.0:1746065197.638237:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.638271:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7863 00000100:00100000:0.0:1746065197.638277:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263367936:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.638289:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.638308:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.638318:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.638339:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6c00/0x14b4f8542d4feb37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b55 expref: 12 pid: 21998 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.638351:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.638368:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1958:x1830881263367936:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 92us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.638373:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7863 00000100:00100000:0.0:1746065197.638426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.638437:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368064 00000100:00100000:0.0:1746065197.638440:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368064 00010000:00010000:0.0:1746065197.638451:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 19 pid: 8429 timeout: 896 lvb_type: 1 00000100:00100000:0.0:1746065197.638473:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7864 00000100:00100000:0.0:1746065197.638478:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263368064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.638484:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.638491:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 19 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.638499:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 19 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.638510:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66a600/0x14b4f8542d4feadc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b1d expref: 19 pid: 8429 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065197.638518:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.638520:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.638525:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.638533:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.638556:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 10 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.638567:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b622d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260469504:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065197.639144:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065197.639793:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1959:x1830881263367552:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 5215us (5548us total) trans 17179873743 rc 0/0 00000100:00100000:1.0:1746065197.639804:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2600 00002000:00100000:1.0:1746065197.639812:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x388:0x0] (1536000->1662975) req@ffff88009b9fed80 x1830881263367552/t17179873743(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/448 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.639993:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fed80 with x1830881263367552 ext(1536000->1662975) 00010000:00010000:1.0:1746065197.640002:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 28 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.640156:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 28 pid: 8429 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746065197.640162:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b9fed80 00000100:00100000:0.0:1746065197.645795:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b622d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260469504:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065197.645947:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.647793:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881263368064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 9307us (9360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.647803:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7864 00000100:00100000:3.0:1746065197.650471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.650735:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263367808:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 16170us (16422us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065197.650746:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8606 00002000:00100000:0.0:1746065197.650756:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009b9fc700 x1830881263367808/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.650764:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b9fc700 with x1830881263367808 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.650769:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b9fc700 00000100:00100000:1.0:1746065197.651085:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368192 00000100:00100000:1.0:1746065197.651092:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368192 00010000:00010000:1.0:1746065197.651118:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 28 pid: 8429 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.651137:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7865 00000100:00100000:1.0:1746065197.651143:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1961:x1830881263368192:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.651152:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065197.651165:0:10991:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065197 -> 1746065198 00002000:00010000:1.0:1746065197.651167:0:10991:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065197 -> 1746065198 00002000:00010000:1.0:1746065197.651169:0:10991:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065197 -> 1746065198 00010000:00010000:1.0:1746065197.651173:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 28 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.651183:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 28 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.651200:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cd9e00/0x14b4f8542d4feb61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1536000->1662975) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b78 expref: 28 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.651221:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.651222:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.651228:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.651234:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.651257:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 11 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.651267:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260469632:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065197.651305:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.651732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.651769:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368448 00000100:00100000:2.0:1746065197.651773:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368448 00002000:00100000:2.0:1746065197.651791:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4898816->4902911) req@ffff88012b622d80 x1830881263368448/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.651798:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b622d80 with x1830881263368448 ext(4898816->4902911) 00002000:00010000:2.0:1746065197.651801:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b622d80 00000100:00100000:2.0:1746065197.651810:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8607 00000100:00100000:2.0:1746065197.651833:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263368448:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.652207:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263368448:12345-192.168.202.46@tcp:3:cat.0 Request processed in 391us (475us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065197.652213:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8607 00002000:00100000:2.0:1746065197.652218:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4898816->4902911) req@ffff88012b622d80 x1830881263368448/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.652229:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b622d80 with x1830881263368448 ext(4898816->4902911) 00002000:00010000:2.0:1746065197.652232:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b622d80 00000100:00100000:0.0:1746065197.656475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.656499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.656516:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368576 00000100:00100000:0.0:1746065197.656521:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368576 00000100:00100000:0.0:1746065197.656557:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368704 00000100:00100000:0.0:1746065197.656559:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368704 00000100:00100000:0.0:1746065197.656571:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15268 00000100:00100000:0.0:1746065197.656576:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263368576:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.656590:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.656603:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b94 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.656622:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.656624:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.656631:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 29 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.656643:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 29 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.656656:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953d2c00, rc 0) 00000100:00100000:0.0:1746065197.656696:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263368576:12345-192.168.202.46@tcp:101:cat.0 Request processed in 119us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.656701:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15268 00000100:00100000:0.0:1746065197.656716:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15269 00000100:00100000:0.0:1746065197.656719:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263368704:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.656724:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.656731:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953d2e00/0x14b4f8542d4feb84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61b9b expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.656758:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b623100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260469760:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065197.656801:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.656847:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.656943:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263368832 00000100:00100000:2.0:1746065197.656947:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263368832 00000100:00100000:2.0:1746065197.656964:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15270 00000100:00100000:2.0:1746065197.656968:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263368832:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.656974:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.656980:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938e8e00/0x14b4f8542d4feb8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ba2 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065197.657016:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260469888:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065197.657046:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065197.657392:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260469632:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065197.657406:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.657425:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263368192:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6282us (6961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.657432:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7865 00002000:00010000:2.0:1746065197.659703:0:2463:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065195 -> 1746065198 00000100:00100000:2.0:1746065197.659726:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b623100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2463:1830881260469760:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065197.659754:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800953d2e00/0x14b4f8542d4feb84 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b9b expref: 17 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.659765:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953d2e00/0x14b4f8542d4feb84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b9b expref: 17 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.659788:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953d2e00, rc 0) 00000100:00100000:2.0:1746065197.660223:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263368704:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3501us (3721us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065197.660230:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15269 00000100:00100000:2.0:1746065197.661387:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.661471:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369344 00000100:00100000:3.0:1746065197.661479:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369344 00000100:00100000:3.0:1746065197.661527:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4378 00000100:00100000:3.0:1746065197.661535:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+7:32153:x1830881263369344:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065197.662168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.662850:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369472 00000100:00100000:2.0:1746065197.662855:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369472 00002000:00100000:2.0:1746065197.662879:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800900c0700 x1830881263369472/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.662887:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0700 with x1830881263369472 ext(1048576->2097151) 00002000:00010000:2.0:1746065197.662892:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c0700 00000100:00100000:2.0:1746065197.662911:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8608 00000100:00100000:2.0:1746065197.662917:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263369472:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.663944:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:32153:x1830881263369344:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 2405us (2555us total) trans 8589944422 rc 0/0 00000100:00100000:3.0:1746065197.663953:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4378 00000100:00100000:0.0:1746065197.665919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.665947:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369600 00000100:00100000:0.0:1746065197.665953:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369600 00002000:00100000:0.0:1746065197.665984:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009b82df80 x1830881263369600/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.665993:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82df80 with x1830881263369600 ext(1048576->2097151) 00002000:00010000:0.0:1746065197.665997:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82df80 00000100:00100000:0.0:1746065197.666018:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8609 00000100:00100000:0.0:1746065197.666025:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263369600:12345-192.168.202.46@tcp:3:cat.0 00002000:00010000:3.0:1746065197.668742:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065197 -> 1746065198 00000100:00100000:3.0:1746065197.668770:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260469888:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065197.668801:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938e8e00/0x14b4f8542d4feb8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba2 expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.668832:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8e00/0x14b4f8542d4feb8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba2 expref: 29 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.668846:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e8e00, rc 0) 00000100:00100000:3.0:1746065197.668897:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263368832:12345-192.168.202.46@tcp:101:cat.0 Request processed in 11926us (12048us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065197.668906:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15270 00000100:00100000:2.0:1746065197.676183:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263369600:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10151us (10262us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065197.676193:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8609 00002000:00100000:2.0:1746065197.676204:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009b82df80 x1830881263369600/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.676213:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82df80 with x1830881263369600 ext(1048576->2097151) 00002000:00010000:2.0:1746065197.676218:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82df80 00000100:00100000:0.0:1746065197.676281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.676984:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369728 00000100:00100000:1.0:1746065197.676992:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369728 00000100:00100000:1.0:1746065197.677062:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10134 00000100:00100000:1.0:1746065197.677069:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:32162:x1830881263369728:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065197.677089:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065197.677090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065197.677106:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e38cc00/0x14b4f8542d4feb92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ba9 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.677107:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369856 00000100:00100000:3.0:1746065197.677109:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369856 00010000:00010000:1.0:1746065197.677158:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.677171:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.677180:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.677190:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.677195:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.677199:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.677286:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.677293:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.677299:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.677325:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 249 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.677334:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 249 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.677344:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260470016:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.677406:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.677445:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15271 00000100:00100000:3.0:1746065197.677451:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:32156:x1830881263369856:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.677458:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.677471:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bb0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.677487:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.677493:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.677494:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.677496:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.677514:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.677522:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 12 pid: 8429 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.677530:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260470144:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.677563:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.683691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.683858:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260470016:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.683880:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:3.0:1746065197.683967:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260470144:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.683993:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.684008:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c8f800, rc 0) 00000100:00100000:3.0:1746065197.684057:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:32156:x1830881263369856:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6606us (6966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.684065:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15271 00000100:00100000:2.0:1746065197.684185:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263369984 00000100:00100000:2.0:1746065197.684192:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263369984 00002000:00100000:2.0:1746065197.684220:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4902911) req@ffff88009b82e680 x1830881263369984/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.684228:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82e680 with x1830881263369984 ext(4194304->4902911) 00010000:00010000:2.0:1746065197.684234:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 13 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:2.0:1746065197.684243:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 13 pid: 8429 timeout: 896 lvb_type: 0 00002000:00010000:2.0:1746065197.684250:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b82e680 00000100:00100000:2.0:1746065197.684270:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2601 00000100:00100000:2.0:1746065197.684276:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263369984:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065197.685946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.686162:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370240 00000100:00100000:2.0:1746065197.686170:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370240 00000100:00100000:2.0:1746065197.686253:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4379 00000100:00100000:2.0:1746065197.686260:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:19663:x1830881263370240:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065197.686710:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:19663:x1830881263370240:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 450us (768us total) trans 8589944423 rc 0/0 00000100:00100000:2.0:1746065197.686717:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4379 00000100:00100000:3.0:1746065197.687389:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263369472:12345-192.168.202.46@tcp:3:cat.0 Request processed in 24471us (25221us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.687397:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8608 00002000:00100000:3.0:1746065197.687404:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800900c0700 x1830881263369472/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.687412:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900c0700 with x1830881263369472 ext(1048576->2097151) 00002000:00010000:3.0:1746065197.687417:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900c0700 00000100:00100000:2.0:1746065197.692099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.692397:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370368 00000100:00100000:1.0:1746065197.692484:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370368 00010000:00010000:1.0:1746065197.692521:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 251 pid: 14644 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065197.692723:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7866 00000100:00100000:1.0:1746065197.692731:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1961:x1830881263370368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.692743:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.692748:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 251 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.692757:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 251 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.692775:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0087a00/0x14b4f8542d4feace lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61afa expref: 251 pid: 14644 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.693276:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.693281:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.693291:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.693297:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.693331:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.693374:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1961:x1830881263370368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 644us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.693380:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7866 00010000:00010000:2.0:1746065197.693435:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693441:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:2.0:1746065197.693475:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:2.0:1746065197.693479:0:20754:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746065197.693494:0:20754:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693503:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693511:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693519:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693524:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693529:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b918a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.693533:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693539:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693547:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065197.693549:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065197.693552:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693555:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918a00/0x14b4f8542d4feb99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693568:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693573:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693578:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693581:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b919a00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.693582:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693590:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693595:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:2.0:1746065197.693596:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065197.693598:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693602:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919a00/0x14b4f8542d4feba0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.693630:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e38cc00/0x14b4f8542d4feb92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.693640:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 7 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.693645:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.693646:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065197.693648:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b918200, rc 0) 00000100:00100000:2.0:1746065197.693670:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32162:x1830881263369728:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 16603us (17856us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.693690:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10134 00000100:00100000:0.0:1746065197.696327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.696371:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370496 00000100:00100000:2.0:1746065197.696378:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370496 00000100:00100000:2.0:1746065197.696411:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15272 00000100:00100000:2.0:1746065197.696418:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:32160:x1830881263370496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.696431:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.696445:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bb7 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.696465:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065197.696470:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.696478:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.696487:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e9200, rc 0) 00000100:00100000:2.0:1746065197.696532:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+14:32160:x1830881263370496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.696538:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15272 00000100:00100000:0.0:1746065197.697177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.697215:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370624 00000100:00100000:1.0:1746065197.697218:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370624 00000100:00100000:1.0:1746065197.697244:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15273 00000100:00100000:1.0:1746065197.697248:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881263370624:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065197.697255:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.697261:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bbe expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.697272:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.697273:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.697279:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.697288:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 7 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.697295:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b918000, rc 0) 00000100:00100000:1.0:1746065197.697313:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263370624:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.697318:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15273 00000100:00100000:0.0:1746065197.698296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.698320:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.698341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.698378:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370752 00000100:00100000:2.0:1746065197.698382:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370752 00000100:00100000:0.0:1746065197.698388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.698398:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371008 00000100:00100000:2.0:1746065197.698399:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371008 00000100:00100000:0.0:1746065197.698405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.698419:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371264 00000100:00100000:1.0:1746065197.698422:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371264 00000100:00100000:2.0:1746065197.698433:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263370880 00000100:00100000:2.0:1746065197.698437:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263370880 00000100:00100000:2.0:1746065197.698455:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371136 00000100:00100000:2.0:1746065197.698457:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371136 00000100:00100000:2.0:1746065197.698473:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15274 00000100:00100000:2.0:1746065197.698478:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263370752:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065197.698486:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.698494:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bc5 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.698504:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.698506:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.698511:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.698519:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.698526:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953d3600, rc 0) 00000100:00100000:2.0:1746065197.698544:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263370752:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.698549:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15274 00000100:00100000:2.0:1746065197.698558:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15275 00000100:00100000:2.0:1746065197.698561:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263371008:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065197.698566:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.698572:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bd3 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.698580:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.698582:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.698585:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.698592:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.698598:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953d2200, rc 0) 00000100:00100000:2.0:1746065197.698609:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263371008:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.698616:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15275 00000100:00100000:1.0:1746065197.698916:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15276 00000100:00100000:3.0:1746065197.698920:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15277 00000100:00100000:1.0:1746065197.698921:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263370880:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:3.0:1746065197.698925:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263371136:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065197.698926:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.698930:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.698932:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bcc expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.698936:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4febd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bda expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.698941:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.698943:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.698946:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.698953:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.698959:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b918600, rc 0) 00000100:00100000:3.0:1746065197.698963:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260470272:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065197.698971:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263370880:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 51us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.698975:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15276 00000100:00100000:1.0:1746065197.698983:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15278 00000100:00100000:1.0:1746065197.698987:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263371264:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065197.698991:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.698997:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4febdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61be1 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.699003:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065197.699015:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260470400:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065197.699032:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.700877:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263369984:12345-192.168.202.46@tcp:4:cat.0 Request processed in 16595us (17197us total) trans 21474841033 rc 0/0 00000100:00100000:3.0:1746065197.700885:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2601 00002000:00100000:3.0:1746065197.700893:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->4902911) req@ffff88009b82e680 x1830881263369984/t21474841033(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/448 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.700901:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82e680 with x1830881263369984 ext(4194304->4902911) 00010000:00010000:3.0:1746065197.700908:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 14 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.700919:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 14 pid: 8429 timeout: 896 lvb_type: 0 00002000:00010000:3.0:1746065197.700925:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b82e680 00000100:00100000:2.0:1746065197.701077:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260470272:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065197.701101:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4febd8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bda expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.701110:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a60a3200/0x14b4f8542d4febd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bda expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.701119:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a60a3200, rc 0) 00000100:00100000:2.0:1746065197.701150:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263371136:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2224us (2744us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065197.701156:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15277 00000100:00100000:1.0:1746065197.701228:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260470400:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065197.701242:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4febdf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be1 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.701249:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4febdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be1 expref: 9 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065197.701257:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b919c00, rc 0) 00000100:00100000:1.0:1746065197.701274:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263371264:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 2286us (2932us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065197.701278:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15278 00000100:00100000:0.0:1746065197.703109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.703180:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371392 00000100:00100000:1.0:1746065197.703187:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371392 00010000:00010000:1.0:1746065197.703213:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 14 pid: 8429 timeout: 896 lvb_type: 0 00000100:00100000:2.0:1746065197.703221:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.703290:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7867 00000100:00100000:1.0:1746065197.703297:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263371392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.703309:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.703322:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 14 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.703331:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 14 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.703347:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f1d4000/0x14b4f8542d4feb76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4902911) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b8d expref: 14 pid: 8429 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065197.703356:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.703358:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.703364:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.703371:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.703378:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.703379:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.703381:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.703387:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.703415:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 13 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.703425:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260470528:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065197.703520:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371648 00000100:00100000:3.0:1746065197.703524:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371648 00000100:00100000:3.0:1746065197.703546:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10135 00000100:00100000:3.0:1746065197.703551:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32162:x1830881263371648:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065197.703565:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.703576:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4febe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61be8 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.703646:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.703656:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.703661:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.703684:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.703692:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 8 pid: 20754 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.703699:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260470656:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.703836:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.703843:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260470784:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065197.703956:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065197.703992:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.705929:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260470656:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.705929:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260470528:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065197.705939:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260470784:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065197.705949:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.705950:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.705979:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263371392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2682us (2875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.705988:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7867 00000100:00100000:0.0:1746065197.706238:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.706345:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263371776 00000100:00100000:1.0:1746065197.706350:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263371776 00010000:00010000:1.0:1746065197.706368:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 9 pid: 20754 timeout: 896 lvb_type: 0 00000100:00100000:3.0:1746065197.707250:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7868 00000100:00100000:3.0:1746065197.707258:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263371776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065197.707270:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.707277:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 9 pid: 20754 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.707287:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 9 pid: 20754 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.707304:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918200/0x14b4f8542d4feba7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ba9 expref: 9 pid: 20754 timeout: 896 lvb_type: 0 00010000:00010000:3.0:1746065197.707328:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065197.707333:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.707340:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.707346:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.707372:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.707395:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263371776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 139us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.707400:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7868 00010000:00010000:2.0:1746065197.707492:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.707499:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:2.0:1746065197.707514:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065197.707698:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5d400/0x14b4f8542d4febe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.707710:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.707715:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.707718:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065197.707720:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f5dc00, rc 0) 00000100:00100000:2.0:1746065197.707741:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32162:x1830881263371648:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4191us (4520us total) trans 8589944424 rc 0/0 00000100:00100000:2.0:1746065197.707747:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10135 00000100:00100000:0.0:1746065197.709494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.709565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.709770:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372160 00000100:00100000:2.0:1746065197.709777:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372160 00000100:00100000:2.0:1746065197.709808:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10136 00000100:00100000:2.0:1746065197.709833:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32162:x1830881263372160:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065197.709850:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.709862:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4febfb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bef expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.709916:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.709926:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.709932:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065197.709954:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.709964:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 9 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065197.709973:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd70380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260470912:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.710079:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372032 00000100:00100000:3.0:1746065197.710083:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372032 00002000:00100000:3.0:1746065197.710105:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880093ba1180 x1830881263372032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.710113:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1180 with x1830881263372032 ext(2097152->3145727) 00002000:00010000:3.0:1746065197.710117:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba1180 00000100:00100000:3.0:1746065197.710128:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8610 00000100:00100000:3.0:1746065197.710133:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263372032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.711159:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.713405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.713426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.713455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.713473:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372672 00000100:00100000:2.0:1746065197.713481:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372672 00002000:00100000:2.0:1746065197.713517:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4046847) req@ffff88008fd72680 x1830881263372672/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.713526:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72680 with x1830881263372672 ext(3145728->4046847) 00002000:00010000:2.0:1746065197.713531:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd72680 00000100:00100000:2.0:1746065197.713544:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372544 00000100:00100000:2.0:1746065197.713546:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372544 00002000:00100000:2.0:1746065197.713555:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012b623100 x1830881263372544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.713561:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b623100 with x1830881263372544 ext(2097152->3145727) 00002000:00010000:2.0:1746065197.713563:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b623100 00000100:00100000:2.0:1746065197.713569:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263372928 00000100:00100000:2.0:1746065197.713571:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263372928 00002000:00100000:2.0:1746065197.713579:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009bee0a80 x1830881263372928/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.713585:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0a80 with x1830881263372928 ext(2097152->3145727) 00002000:00010000:2.0:1746065197.713588:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee0a80 00000100:00100000:2.0:1746065197.713596:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8611 00000100:00100000:2.0:1746065197.713604:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263372672:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065197.713724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.713739:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373056 00000100:00100000:0.0:1746065197.713742:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373056 00002000:00100000:0.0:1746065197.713755:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880093ba0e00 x1830881263373056/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.713761:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0e00 with x1830881263373056 ext(3145728->4194303) 00002000:00010000:0.0:1746065197.713764:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba0e00 00000100:00100000:0.0:1746065197.713773:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8612 00000100:00100000:0.0:1746065197.713778:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263372544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.713811:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8613 00000100:00100000:0.0:1746065197.713877:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8614 00000100:00100000:0.0:1746065197.713882:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263373056:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.714665:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263372928:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065197.719968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.720070:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd70380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260470912:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.720093:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065197.720149:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373312 00000100:00100000:0.0:1746065197.720155:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373312 00010000:00010000:0.0:1746065197.720182:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 10 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065197.720271:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7869 00000100:00100000:0.0:1746065197.720279:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263373312:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.720291:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.720297:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 10 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.720307:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 10 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.720328:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5f5dc00/0x14b4f8542d4febed lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61be8 expref: 10 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.721277:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065197.721283:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.721292:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.721298:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065197.721411:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065197.721431:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.721437:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065197.721448:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263373312:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1169us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.721458:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7869 00000004:00200000:3.0:1746065197.721470:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065197.721474:0:20754:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065197.721485:0:20754:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.721510:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a60a2800/0x14b4f8542d4febfb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bef expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.721527:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bef expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.721532:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065197.721535:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065197.721537:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b1c00, rc 0) 00000100:00100000:3.0:1746065197.721555:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32162:x1830881263372160:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 11741us (11990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.721561:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10136 00000100:00100000:3.0:1746065197.722919:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263372032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12781us (13425us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.722926:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8610 00002000:00100000:3.0:1746065197.722934:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880093ba1180 x1830881263372032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.722947:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1180 with x1830881263372032 ext(2097152->3145727) 00002000:00010000:3.0:1746065197.722951:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba1180 00000100:00100000:2.0:1746065197.728474:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263372672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14862us (15066us total) trans 0 rc 901120/901120 00000100:00100000:2.0:1746065197.728485:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8611 00002000:00100000:2.0:1746065197.728495:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4046847) req@ffff88008fd72680 x1830881263372672/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.728503:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd72680 with x1830881263372672 ext(3145728->4046847) 00002000:00010000:2.0:1746065197.728509:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fd72680 00000100:00100000:1.0:1746065197.731236:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263373056:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17341us (17501us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065197.731247:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8614 00002000:00100000:1.0:1746065197.731257:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880093ba0e00 x1830881263373056/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.731265:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0e00 with x1830881263373056 ext(3145728->4194303) 00002000:00010000:1.0:1746065197.731270:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba0e00 00000100:00100000:0.0:1746065197.736213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.736397:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373440 00000100:00100000:1.0:1746065197.736407:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373440 00000100:00100000:1.0:1746065197.736444:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15279 00000100:00100000:1.0:1746065197.736451:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:32156:x1830881263373440:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065197.736466:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.736480:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bf6 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.736505:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.736511:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065197.736513:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065197.736516:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.736542:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.736551:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 13 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065197.736563:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260471040:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.736799:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.737559:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263372928:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23725us (24102us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065197.737566:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8613 00002000:00100000:2.0:1746065197.737574:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009bee0a80 x1830881263372928/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.737581:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0a80 with x1830881263372928 ext(2097152->3145727) 00002000:00010000:2.0:1746065197.737585:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee0a80 00000100:00100000:1.0:1746065197.738278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.738311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.738363:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373568 00000100:00100000:3.0:1746065197.738368:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373568 00000100:00100000:3.0:1746065197.738387:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373696 00000100:00100000:3.0:1746065197.738388:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373696 00000100:00100000:3.0:1746065197.738401:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15280 00000100:00100000:3.0:1746065197.738406:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263373568:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065197.738413:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.738422:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61bfd expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.738434:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.738436:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.738442:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.738454:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.738463:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66a000, rc 0) 00000100:00100000:3.0:1746065197.738483:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263373568:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.738487:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15280 00000100:00100000:3.0:1746065197.738498:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15281 00000100:00100000:3.0:1746065197.738502:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263373696:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065197.738508:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.738514:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f66b400/0x14b4f8542d4fec17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c04 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.738537:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881260471168:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065197.738572:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.739007:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263372544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25226us (25578us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065197.739013:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8612 00002000:00100000:2.0:1746065197.739019:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012b623100 x1830881263372544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.739031:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b623100 with x1830881263372544 ext(2097152->3145727) 00010000:00010000:2.0:1746065197.739036:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 12 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.739047:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 12 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065197.739052:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b623100 00000100:00100000:0.0:1746065197.739802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.739955:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260471040:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065197.739973:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 29 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.739983:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b918e00, rc 0) 00000100:00100000:1.0:1746065197.740004:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:32156:x1830881263373440:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3554us (3800us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.740010:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15279 00000100:00100000:2.0:1746065197.741382:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373824 00000100:00100000:2.0:1746065197.741390:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373824 00002000:00100000:2.0:1746065197.741423:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (4046848->4194303) req@ffff880093ba1f80 x1830881263373824/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.741430:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1f80 with x1830881263373824 ext(4046848->4194303) 00010000:00010000:2.0:1746065197.741436:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 12 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.741446:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 12 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065197.741451:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba1f80 00000100:00100000:2.0:1746065197.741477:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2602 00000100:00100000:2.0:1746065197.741482:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263373824:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065197.742591:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:21235:1830881260471168:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065197.742617:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f66b400/0x14b4f8542d4fec17 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c04 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.742626:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f66b400/0x14b4f8542d4fec17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c04 expref: 9 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.743222:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66b400, rc 0) 00000100:00100000:3.0:1746065197.743257:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263373696:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4754us (4945us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065197.743264:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15281 00000100:00100000:2.0:1746065197.746586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.748863:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.749490:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263373824:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8005us (9688us total) trans 17179873744 rc 0/0 00000100:00100000:3.0:1746065197.749500:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2602 00002000:00100000:3.0:1746065197.749509:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (4046848->4194303) req@ffff880093ba1f80 x1830881263373824/t17179873744(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/448 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.749519:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1f80 with x1830881263373824 ext(4046848->4194303) 00010000:00010000:3.0:1746065197.749527:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 14 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065197.749545:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 14 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065197.749553:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba1f80 00000100:00100000:3.0:1746065197.749582:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374208 00000100:00100000:3.0:1746065197.749588:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374208 00000100:00100000:2.0:1746065197.750895:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263373952 00000100:00100000:2.0:1746065197.750901:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263373952 00000100:00100000:2.0:1746065197.750932:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15282 00000100:00100000:2.0:1746065197.750937:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+14:32160:x1830881263373952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.750949:0:21235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.750961:0:21235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c0b expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.750978:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065197.750982:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 15 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.750990:0:21235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 15 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.750998:0:21235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e8a00, rc 0) 00000100:00100000:3.0:1746065197.751482:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10137 00000100:00100000:3.0:1746065197.751490:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32162:x1830881263374208:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065197.751498:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.751508:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fec25 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c12 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.751570:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.751579:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065197.751587:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:3.0:1746065197.751596:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:3.0:1746065197.751666:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b200/0x14b4f8542d4fec25 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.751695:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 10 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.751706:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065197.751708:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065197.751710:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f66a600, rc 0) 00000100:00100000:2.0:1746065197.752177:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:26bbd020-9fba-464a-bebc-8395a287959e+15:32160:x1830881263373952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1237us (5596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.752182:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15282 00000100:00100000:3.0:1746065197.753191:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32162:x1830881263374208:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1700us (4332us total) trans 8589944425 rc 0/0 00000100:00100000:3.0:1746065197.753197:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10137 00000100:00100000:2.0:1746065197.755027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.756977:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374336 00000100:00100000:0.0:1746065197.756987:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374336 00010000:00010000:0.0:1746065197.757019:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 15 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065197.757060:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7870 00000100:00100000:0.0:1746065197.757067:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263374336:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.757077:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.757099:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 15 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.757110:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 15 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.757131:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c8ea00/0x14b4f8542d4feb68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b7f expref: 15 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.757160:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.757162:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.757168:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.757176:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.757184:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.757185:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.757187:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 14 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.757194:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 14 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.757219:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 14 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.757231:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260471296:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065197.757303:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.757311:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260471424:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065197.757325:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.759723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.759755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.759779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.759802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.759843:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374592 00000100:00100000:0.0:1746065197.759849:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374592 00000100:00100000:0.0:1746065197.759877:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374848 00000100:00100000:0.0:1746065197.759879:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374848 00000100:00100000:0.0:1746065197.759888:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375104 00000100:00100000:0.0:1746065197.759890:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375104 00000100:00100000:0.0:1746065197.759898:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374464 00000100:00100000:0.0:1746065197.759899:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374464 00000100:00100000:0.0:1746065197.759910:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15283 00000100:00100000:0.0:1746065197.759916:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1959:x1830881263374592:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065197.759947:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.759959:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.759966:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.759972:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 14 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.759977:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.759979:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.759981:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.760001:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 14 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.760012:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 14 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.760028:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260471552:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.760089:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 9 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.760096:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 9 pid: 9716 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.760103:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260471680:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.760136:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 28 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.760143:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 28 pid: 8428 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.760150:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260471808:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.760166:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.760189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.760222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.760259:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260471296:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065197.760309:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260471424:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065197.760321:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.760339:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263374336:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3273us (5318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.760349:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7870 00000100:00100000:3.0:1746065197.760443:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374720 00000100:00100000:3.0:1746065197.760447:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374720 00000100:00100000:3.0:1746065197.760461:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263374976 00000100:00100000:3.0:1746065197.760462:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263374976 00000100:00100000:3.0:1746065197.760472:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15284 00000100:00100000:3.0:1746065197.760476:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263374848:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065197.760493:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760503:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760508:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760514:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760519:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.760520:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.760523:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760536:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760543:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 12 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.760551:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260471936:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.760591:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 11 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760598:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 11 pid: 9716 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.760605:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260472064:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.760624:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 16 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760631:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 16 pid: 8429 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.760637:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260472192:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.760649:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.760662:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15285 00000100:00100000:3.0:1746065197.760667:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881263375104:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065197.760691:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760700:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760706:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 13 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760711:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.760712:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.760714:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760726:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 13 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760733:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 13 pid: 21235 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065197.760740:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260472320:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.760762:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 28 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760768:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 28 pid: 2463 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065197.760780:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260472448:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.760790:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.760803:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15286 00000100:00100000:3.0:1746065197.760807:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263374464:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065197.760837:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760846:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760852:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760858:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760863:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.760864:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.760865:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.760878:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 12 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760884:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 12 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.760891:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260472576:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.760927:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 11 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760934:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 11 pid: 2463 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.760940:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260472704:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.760957:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.760964:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 16 pid: 8428 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.760969:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260472832:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.760980:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.760992:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15287 00000100:00100000:3.0:1746065197.760997:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881263374720:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065197.761010:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761017:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761027:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.761033:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 28 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.761037:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.761038:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.761040:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761051:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 28 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.761057:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 28 pid: 2463 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.761064:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260472960:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.761079:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 10 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.761086:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 10 pid: 2463 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.761092:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260473088:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.761105:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761111:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 13 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065197.761117:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260473216:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.761126:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.761138:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15288 00000100:00100000:3.0:1746065197.761142:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263374976:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:3.0:1746065197.761154:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761162:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761167:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.761173:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761177:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.761178:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.761180:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761194:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 12 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761199:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 12 pid: 9716 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065197.761206:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473344:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.761222:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 11 pid: 21235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065197.761228:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 11 pid: 21235 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.761235:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473472:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.761248:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.761254:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 16 pid: 9716 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065197.761260:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473600:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.761270:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.764249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.764281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.764404:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375360 00000100:00100000:2.0:1746065197.764411:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375360 00002000:00100000:2.0:1746065197.764441:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012d3b0a80 x1830881263375360/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.764449:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0a80 with x1830881263375360 ext(2097152->3145727) 00010000:00010000:2.0:1746065197.764456:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 14 pid: 21235 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.764466:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 14 pid: 21235 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065197.764472:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b0a80 00000100:00100000:2.0:1746065197.764484:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375616 00000100:00100000:2.0:1746065197.764486:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375616 00002000:00100000:2.0:1746065197.764496:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012d3b0e00 x1830881263375616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.764502:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0e00 with x1830881263375616 ext(3145728->4194303) 00010000:00010000:2.0:1746065197.764505:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 15 pid: 21235 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.764512:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 15 pid: 21235 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065197.764517:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b0e00 00000100:00100000:2.0:1746065197.764532:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2603 00000100:00100000:2.0:1746065197.764538:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263375360:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.765588:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2604 00000100:00100000:2.0:1746065197.765593:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263375616:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065197.767322:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260471552:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.772521:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.772541:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376640 00000100:00100000:0.0:1746065197.772547:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376640 00010000:00010000:0.0:1746065197.772574:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 11 pid: 9716 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.772599:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7871 00000100:00100000:0.0:1746065197.772606:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263376640:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.772615:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.772632:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 11 pid: 9716 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.772640:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 11 pid: 9716 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.772659:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.772702:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263376640:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 96us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.772708:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7871 00000100:00100000:0.0:1746065197.772740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.772750:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377024 00000100:00100000:0.0:1746065197.772753:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377024 00010000:00010000:0.0:1746065197.772761:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 12 pid: 9716 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.772773:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7872 00000100:00100000:0.0:1746065197.772776:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263377024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.772782:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.772792:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 12 pid: 9716 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.772799:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 12 pid: 9716 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.772809:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.772845:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263377024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 68us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.772851:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7872 00000100:00100000:0.0:1746065197.772891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.772901:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376384 00000100:00100000:0.0:1746065197.772904:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376384 00010000:00010000:0.0:1746065197.772913:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 18 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.772927:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7873 00000100:00100000:0.0:1746065197.772930:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263376384:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.772935:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.772941:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 18 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.772948:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 18 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.773012:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800953d3600/0x14b4f8542d4febc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bc5 expref: 10 pid: 9716 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065197.773027:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095357100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260471680:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.773035:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260471808:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.773518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.773534:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376768 00000100:00100000:2.0:1746065197.773537:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376768 00010000:00010000:2.0:1746065197.773549:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 13 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.773563:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7874 00000100:00100000:2.0:1746065197.773569:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263376768:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.773574:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.773582:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 13 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.773589:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 13 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.773600:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.773613:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263376768:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.773618:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7874 00000100:00100000:2.0:1746065197.773645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.773655:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375744 00000100:00100000:2.0:1746065197.773657:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375744 00010000:00010000:2.0:1746065197.773666:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 13 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.773688:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7875 00000100:00100000:2.0:1746065197.773692:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263375744:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.773698:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.773707:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 13 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.773713:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 13 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.773727:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.773739:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263375744:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 47us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.773744:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7875 00000100:00100000:2.0:1746065197.773769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.773778:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376000 00000100:00100000:2.0:1746065197.773781:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376000 00010000:00010000:2.0:1746065197.773789:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 17 pid: 8428 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.773801:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7876 00000100:00100000:2.0:1746065197.773805:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263376000:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.773811:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.773839:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 17 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.773847:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 17 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.773858:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.773871:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263376000:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.773876:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7876 00000100:00100000:2.0:1746065197.773907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.773914:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376256 00000100:00100000:2.0:1746065197.773917:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376256 00010000:00010000:2.0:1746065197.773925:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 10 pid: 2463 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.773937:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7877 00000100:00100000:2.0:1746065197.773941:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263376256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.773948:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.773955:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 10 pid: 2463 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.773962:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 10 pid: 2463 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.773972:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.773982:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1958:x1830881263376256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.773986:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7877 00000100:00100000:2.0:1746065197.774005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.774013:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376896 00000100:00100000:2.0:1746065197.774015:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376896 00010000:00010000:2.0:1746065197.774022:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 29 pid: 8428 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.774032:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7878 00000100:00100000:2.0:1746065197.774035:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263376896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.774039:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065197.775145:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260472320:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.775157:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4545:1830881260472448:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.775175:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.775196:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260472960:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.775204:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b918600/0x14b4f8542d4febd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bcc expref: 9 pid: 2463 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.775218:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260473088:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.775226:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260473216:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.775235:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.775251:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feb1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b39 expref: 12 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.775258:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260472576:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.775266:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260472704:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.775273:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66ae00/0x14b4f8542d4feab2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b01 expref: 16 pid: 8428 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.775279:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260472832:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.775289:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.775305:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cf6a00/0x14b4f8542d4feb30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b4e expref: 11 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.775311:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260471936:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.775318:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953d2200/0x14b4f8542d4febca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bd3 expref: 11 pid: 9716 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.775324:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260472064:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.775330:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260472192:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.775341:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.781291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.781326:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377408 00000100:00100000:3.0:1746065197.781335:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377408 00002000:00100000:3.0:1746065197.781382:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cdf480 x1830881263377408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.781392:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf480 with x1830881263377408 ext(3145728->4194303) 00010000:00010000:3.0:1746065197.781402:0:4012:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 16 pid: 9716 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065197.781414:0:4012:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 16 pid: 9716 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065197.781425:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cdf480 00000100:00100000:3.0:1746065197.781451:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2605 00000100:00100000:3.0:1746065197.781459:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263377408:12345-192.168.202.46@tcp:3:cat.0 00010000:00010000:2.0:1746065197.781480:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 29 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.781493:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 29 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.781512:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f66ac00/0x14b4f8542d4feab9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b08 expref: 29 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065197.781529:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.781561:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881263376896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7524us (7554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.781568:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7878 00010000:00010000:0.0:1746065197.781609:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930cda00/0x14b4f8542d4feb22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b40 expref: 18 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.781618:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.781618:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.781620:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.781624:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.781630:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.781655:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.781655:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065197.781661:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.781680:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263376384:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8740us (8779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.781685:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7873 00010000:00010000:1.0:1746065197.781690:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.781697:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.781707:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.781712:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fd7400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065197.781715:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.781721:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.781730:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.781735:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fd7400/0x14b4f8542d4fec3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.781768:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263374592:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 21851us (22052us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.781770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.781774:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15283 00000100:00100000:0.0:1746065197.781799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.781829:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263375872 00000100:00100000:1.0:1746065197.781832:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263375872 00010000:00010000:1.0:1746065197.781847:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 11 pid: 2463 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.781847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.781862:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7879 00000100:00100000:1.0:1746065197.781867:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1958:x1830881263375872:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065197.781867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065197.781874:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065197.781883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065197.781886:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 11 pid: 2463 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.781894:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 11 pid: 2463 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.781906:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b918000/0x14b4f8542d4febbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bbe expref: 11 pid: 2463 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.781914:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.781916:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.781918:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.781924:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.781936:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377664 00000100:00100000:1.0:1746065197.781938:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377664 00000100:00100000:0.0:1746065197.781947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00100000:1.0:1746065197.781950:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012d3b1880 x1830881263377664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.781958:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1880 with x1830881263377664 ext(2097152->3145727) 00000100:00100000:0.0:1746065197.781959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065197.781963:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 28 pid: 2463 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.781970:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 28 pid: 2463 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065197.781972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00002000:00010000:1.0:1746065197.781976:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b1880 00000100:00100000:0.0:1746065197.781981:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376128 00000100:00100000:0.0:1746065197.781983:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376128 00000100:00100000:1.0:1746065197.781984:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377792 00000100:00100000:1.0:1746065197.781985:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377792 00010000:00010000:0.0:1746065197.781992:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 30 pid: 2463 timeout: 897 lvb_type: 1 00002000:00100000:1.0:1746065197.781993:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012d3b1f80 x1830881263377792/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.781999:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1f80 with x1830881263377792 ext(3145728->4194303) 00000100:00100000:0.0:1746065197.782001:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378048 00000100:00100000:0.0:1746065197.782002:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378048 00010000:00010000:1.0:1746065197.782003:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 30 pid: 2463 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.782008:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 11 pid: 21235 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.782009:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 30 pid: 2463 timeout: 897 lvb_type: 0 00002000:00010000:1.0:1746065197.782014:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b1f80 00000100:00100000:0.0:1746065197.782015:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263376512 00000100:00100000:0.0:1746065197.782017:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263376512 00000100:00100000:1.0:1746065197.782022:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2606 00010000:00010000:0.0:1746065197.782024:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 17 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065197.782026:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263377664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065197.782031:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263377536 00000100:00100000:0.0:1746065197.782033:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263377536 00010000:00010000:0.0:1746065197.782039:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 17 pid: 8429 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.782047:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7880 00000100:00100000:0.0:1746065197.782051:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263376128:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.782056:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.782063:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 30 pid: 2463 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.782069:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 30 pid: 2463 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.782083:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800953d2c00/0x14b4f8542d4feb7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b94 expref: 30 pid: 2463 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.782090:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.782102:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263376128:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.782106:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7880 00000100:00100000:0.0:1746065197.782115:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7881 00000100:00100000:0.0:1746065197.782118:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263378048:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.782123:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.782129:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 11 pid: 21235 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.782136:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 11 pid: 21235 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.782143:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.782152:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263378048:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 33us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.782156:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7881 00000100:00100000:0.0:1746065197.782162:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7882 00000100:00100000:0.0:1746065197.782166:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263376512:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.782170:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.782175:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 17 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.782181:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 17 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.782189:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f1d5e00/0x14b4f8542d4feb6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b86 expref: 17 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.782195:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.782196:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.782199:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782204:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782216:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.782226:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881263376512:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.782230:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7882 00000100:00100000:0.0:1746065197.782238:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7883 00000100:00100000:0.0:1746065197.782241:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263377536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.782246:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.782252:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 17 pid: 8429 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.782259:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 17 pid: 8429 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.782267:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66ba00/0x14b4f8542d4fead5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b16 expref: 17 pid: 8429 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.782274:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.782275:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.782277:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782282:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782292:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.782303:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881263377536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.782307:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7883 00010000:00010000:0.0:1746065197.782320:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782326:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782335:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782340:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782350:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782354:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801302d3000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065197.782356:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782361:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782367:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782372:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801302d3000/0x14b4f8542d4fec56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.782392:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263374720:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 21396us (22203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.782396:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15287 00010000:00010000:0.0:1746065197.782410:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782415:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782424:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782430:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782434:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782438:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f66be00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065197.782440:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782445:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782451:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.782455:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66be00/0x14b4f8542d4fec41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.782478:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881263374848:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 22002us (22723us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.782483:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15284 00000100:00100000:0.0:1746065197.782506:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.782515:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378432 00000100:00100000:0.0:1746065197.782517:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378432 00010000:00010000:0.0:1746065197.782525:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 11 pid: 9716 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065197.782535:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7884 00000100:00100000:0.0:1746065197.782538:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263378432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.782543:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.782548:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 11 pid: 9716 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.782555:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 11 pid: 9716 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.782563:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.782574:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+11:1959:x1830881263378432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 34us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.782578:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7884 00010000:00010000:3.0:1746065197.783068:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4febb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb7 expref: 10 pid: 9716 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065197.783080:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473344:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.783094:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f66a000/0x14b4f8542d4fec10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bfd expref: 9 pid: 21235 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065197.783102:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473472:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.783113:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473600:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065197.783135:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.783161:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2607 00000100:00100000:3.0:1746065197.783168:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263377792:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.783169:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263375360:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18630us (18924us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065197.783176:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2603 00002000:00100000:2.0:1746065197.783183:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012d3b0a80 x1830881263375360/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.783190:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0a80 with x1830881263375360 ext(2097152->3145727) 00010000:00010000:2.0:1746065197.783194:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 14 pid: 21235 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.783202:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 14 pid: 21235 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065197.783207:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b0a80 00000100:00100000:2.0:1746065197.783227:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378304 00000100:00100000:2.0:1746065197.783231:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378304 00000100:00100000:2.0:1746065197.783256:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10138 00000100:00100000:2.0:1746065197.783262:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32165:x1830881263378304:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065197.783273:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.783285:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a325c00/0x14b4f8542d4fec64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c19 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.783364:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.783373:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.783380:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.783389:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.783393:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.783397:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.783480:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.783489:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.783495:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.783518:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.783526:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 9 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065197.783535:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260473728:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.783576:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065197.785613:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065197.785712:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.785723:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.785749:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.785756:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.785769:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.785775:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c66e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065197.785778:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.785784:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.785798:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.785804:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c66e00/0x14b4f8542d4fec4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.785964:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263375872:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4093us (4159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.785972:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7879 00000100:00100000:3.0:1746065197.786341:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263374464:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 25531us (26535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.786348:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15286 00000100:00100000:2.0:1746065197.791066:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263375616:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25464us (26776us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065197.791076:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2604 00002000:00100000:2.0:1746065197.791086:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012d3b0e00 x1830881263375616/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.791096:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0e00 with x1830881263375616 ext(3145728->4194303) 00010000:00010000:2.0:1746065197.791106:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 12 pid: 21235 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.791117:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 12 pid: 21235 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065197.791123:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b0e00 00000100:00100000:2.0:1746065197.795939:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260473728:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.795961:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:3.0:1746065197.796487:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263377408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15027us (15201us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.796497:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2605 00002000:00100000:3.0:1746065197.796507:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cdf480 x1830881263377408/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.796516:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf480 with x1830881263377408 ext(3145728->4194303) 00010000:00010000:3.0:1746065197.796524:0:4012:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 15 pid: 9716 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065197.796536:0:4012:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 15 pid: 9716 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065197.796542:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cdf480 00000100:00100000:0.0:1746065197.800641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.804131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.804364:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378688 00000100:00100000:3.0:1746065197.804371:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378688 00000100:00100000:3.0:1746065197.804404:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15289 00000100:00100000:3.0:1746065197.804410:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:32160:x1830881263378688:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.804423:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.804438:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c20 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.804456:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.804459:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.804464:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065197.804467:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.804484:0:25185:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.804496:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 11 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.804504:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a60e00, rc 0) 00000100:00100000:1.0:1746065197.805616:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378560 00000100:00100000:1.0:1746065197.805625:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378560 00000100:00100000:3.0:1746065197.805649:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:32160:x1830881263378688:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1237us (1522us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065197.805649:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 10 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065197.805656:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15289 00000100:00100000:1.0:1746065197.805682:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7885 00000100:00100000:1.0:1746065197.805688:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263378560:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.805698:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.805702:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 10 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.805709:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 10 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.805724:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66a600/0x14b4f8542d4fec2c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c12 expref: 10 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.805736:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.805740:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.805747:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.805752:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065197.805778:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065197.805836:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805842:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065197.805854:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065197.805936:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805941:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805946:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805950:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25ca00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.805953:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805958:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805964:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065197.805966:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065197.805968:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805972:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25ca00/0x14b4f8542d4fec79 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805984:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805988:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805995:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.805998:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25c600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065197.806000:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.806005:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.806010:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00000100:00100000:3.0:1746065197.806130:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263377792:12345-192.168.202.46@tcp:3:cat.0 Request processed in 22962us (24244us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065197.806130:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263378560:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 441us (5498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.806136:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7885 00000100:00100000:3.0:1746065197.806138:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2607 00002000:00100000:3.0:1746065197.806145:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012d3b1f80 x1830881263377792/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.806153:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1f80 with x1830881263377792 ext(3145728->4194303) 00010000:00010000:3.0:1746065197.806160:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 29 pid: 2463 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065197.806169:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 29 pid: 2463 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065197.806174:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b1f80 00000100:00100000:1.0:1746065197.806225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.806236:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378816 00000100:00100000:1.0:1746065197.806239:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378816 00010000:00010000:1.0:1746065197.806250:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 12 pid: 21235 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065197.806267:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7886 00000100:00100000:1.0:1746065197.806272:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263378816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.806278:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.806294:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 12 pid: 21235 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.806301:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 12 pid: 21235 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.806313:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fec1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c0b expref: 12 pid: 21235 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.806323:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.806334:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263378816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.806339:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7886 00000100:00100000:1.0:1746065197.806412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.806422:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263378944 00000100:00100000:1.0:1746065197.806424:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263378944 00010000:00010000:1.0:1746065197.806434:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 15 pid: 9716 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065197.806456:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7887 00000100:00100000:1.0:1746065197.806461:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263378944:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.806469:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.806479:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 15 pid: 9716 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.806486:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 15 pid: 9716 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.806496:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c8f800/0x14b4f8542d4febae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bb0 expref: 15 pid: 9716 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.806506:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.806507:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.806510:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.806516:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.806537:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.806550:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1960:x1830881263378944:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 88us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.806553:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7887 00010000:00010000:2.0:1746065197.806609:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065197.806613:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065197.806615:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.806617:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25c600/0x14b4f8542d4fec6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065197.806622:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.806626:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.806631:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.806635:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065197.806636:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.806639:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c25d000 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065197.806641:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.806641:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.806646:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065197.806647:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.806651:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff54800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065197.806653:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.806656:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5a36e00) 00010000:00010000:3.0:1746065197.806658:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.806658:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065197.806660:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065197.806664:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c25d000/0x14b4f8542d4fec72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065197.806665:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.806666:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.806709:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a325c00/0x14b4f8542d4fec64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c19 expref: 252 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.806715:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a325c00/0x14b4f8542d4fec64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c19 expref: 252 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.806722:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a325c00, rc 0) 00000100:00100000:2.0:1746065197.806743:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32165:x1830881263378304:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 23482us (24972us total) trans 8589944426 rc 301/301 00000100:00100000:2.0:1746065197.806749:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10138 00000100:00100000:0.0:1746065197.807370:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1961:x1830881263377664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25341us (25520us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065197.807377:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2606 00002000:00100000:0.0:1746065197.807382:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012d3b1880 x1830881263377664/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.807390:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1880 with x1830881263377664 ext(2097152->3145727) 00010000:00010000:0.0:1746065197.807394:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 27 pid: 2463 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065197.807410:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 27 pid: 2463 timeout: 897 lvb_type: 0 00002000:00010000:0.0:1746065197.807415:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b1880 00010000:00010000:3.0:1746065197.807463:0:8429:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.807472:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.807501:0:8429:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 10 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.807513:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473856:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065197.807556:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.814716:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473856:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065197.814738:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.814746:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff54800/0x14b4f8542d4fec5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.814832:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1959:x1830881263374976:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 53673us (54592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.814839:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15288 00000100:00100000:1.0:1746065197.819466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.819596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.819658:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379328 00000100:00100000:0.0:1746065197.819666:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379328 00002000:00100000:0.0:1746065197.819710:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f9e9c00 x1830881263379328/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.819719:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9e9c00 with x1830881263379328 ext(3145728->4194303) 00002000:00010000:0.0:1746065197.819724:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9e9c00 00000100:00100000:0.0:1746065197.819754:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8615 00000100:00100000:0.0:1746065197.819761:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263379328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.821276:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379072 00000100:00100000:3.0:1746065197.821286:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379072 00000100:00100000:3.0:1746065197.821323:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15290 00000100:00100000:3.0:1746065197.821332:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:32156:x1830881263379072:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065197.821344:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065197.821360:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c27 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.821381:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.821384:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065197.821391:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.821404:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.821414:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a61600, rc 0) 00000100:00100000:3.0:1746065197.821451:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:32156:x1830881263379072:12345-192.168.202.46@tcp:101:cat.0 Request processed in 119us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.821457:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15290 00000100:00100000:0.0:1746065197.824728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.827234:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379456 00000100:00100000:2.0:1746065197.827244:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379456 00010000:00010000:2.0:1746065197.827279:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 27 pid: 2463 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065197.827311:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7888 00000100:00100000:2.0:1746065197.827318:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1959:x1830881263379456:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065197.827329:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065197.827347:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 27 pid: 2463 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.827358:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 27 pid: 2463 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.827378:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b918e00/0x14b4f8542d4fec09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bf6 expref: 27 pid: 2463 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065197.827412:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.827414:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.827420:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.827429:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.827473:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065197.827532:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1959:x1830881263379456:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 211us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.827539:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7888 00010000:00010000:3.0:1746065197.827645:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.827655:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.827685:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.827692:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.827699:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.827705:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c66c00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065197.827708:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.827716:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.827728:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.827733:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c66c00/0x14b4f8542d4fec48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065197.827791:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1959:x1830881263375104:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 67121us (68009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065197.827798:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15285 00000100:00100000:3.0:1746065197.834514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.834619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.834646:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379968 00000100:00100000:3.0:1746065197.834653:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379968 00000100:00100000:3.0:1746065197.834700:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10139 00000100:00100000:3.0:1746065197.834707:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32162:x1830881263379968:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:3.0:1746065197.834747:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065197.834770:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec02 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61bef expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065197.834783:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065197.834787:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065197.834853:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32162:x1830881263379968:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 147us (234us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746065197.834863:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10139 00000100:00100000:3.0:1746065197.834882:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263379712 00000100:00100000:3.0:1746065197.834884:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263379712 00002000:00100000:3.0:1746065197.834904:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cdd500 x1830881263379712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.834913:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd500 with x1830881263379712 ext(3145728->4194303) 00002000:00010000:3.0:1746065197.834916:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdd500 00000100:00100000:3.0:1746065197.834924:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8616 00000100:00100000:3.0:1746065197.834933:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263379712:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065197.838616:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263379328:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18841us (19005us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065197.838628:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8615 00002000:00100000:1.0:1746065197.838643:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009f9e9c00 x1830881263379328/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.838652:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9e9c00 with x1830881263379328 ext(3145728->4194303) 00002000:00010000:1.0:1746065197.838658:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9e9c00 00000100:00100000:3.0:1746065197.840373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.840483:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380224 00000100:00100000:0.0:1746065197.840492:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380224 00000100:00100000:0.0:1746065197.840534:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4380 00000100:00100000:0.0:1746065197.840543:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32162:x1830881263380224:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065197.840751:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32162:x1830881263380224:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 207us (381us total) trans 8589944427 rc 0/0 00000100:00100000:0.0:1746065197.840757:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4380 00000100:00100000:3.0:1746065197.847983:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263379712:12345-192.168.202.46@tcp:3:cat.0 Request processed in 13044us (13471us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.847993:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8616 00002000:00100000:3.0:1746065197.848002:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880135cdd500 x1830881263379712/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.848010:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdd500 with x1830881263379712 ext(3145728->4194303) 00002000:00010000:3.0:1746065197.848015:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135cdd500 00000100:00100000:0.0:1746065197.851377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.856033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.856338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.856359:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380608 00000100:00100000:2.0:1746065197.856365:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380608 00000100:00100000:1.0:1746065197.856873:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380480 00000100:00100000:1.0:1746065197.856877:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380480 00000100:00100000:1.0:1746065197.856910:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4381 00000100:00100000:1.0:1746065197.856916:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32162:x1830881263380480:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:2.0:1746065197.856930:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380736 00000100:00100000:2.0:1746065197.856933:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380736 00000100:00100000:2.0:1746065197.856947:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15291 00000100:00100000:2.0:1746065197.856952:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+11:32160:x1830881263380608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.856959:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.856975:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c2e expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065197.856994:0:25185:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d72e, atime: 0x6812d72d, ctime: 0x6812d72e, blocks: 0x1029 00010000:00010000:2.0:1746065197.857007:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.857008:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.857014:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.857024:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 12 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.857032:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b1c00, rc 0) 00000100:00100000:2.0:1746065197.857067:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:32160:x1830881263380608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 114us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.857072:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15291 00000100:00100000:2.0:1746065197.857085:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15292 00000100:00100000:2.0:1746065197.857089:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:32156:x1830881263380736:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.857286:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.857293:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c35 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.857303:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.857304:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.857308:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.857316:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 27 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.857322:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4400, rc 0) 00000100:00100000:1.0:1746065197.857395:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32162:x1830881263380480:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 475us (6020us total) trans 8589944428 rc 0/0 00000100:00100000:1.0:1746065197.857402:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4381 00000100:00100000:2.0:1746065197.859141:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:32156:x1830881263380736:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2045us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.859147:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15292 00000100:00100000:0.0:1746065197.866905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.867306:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263380992 00000100:00100000:3.0:1746065197.867313:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263380992 00002000:00100000:3.0:1746065197.867353:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012d3b3b80 x1830881263380992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.867362:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b3b80 with x1830881263380992 ext(3145728->4194303) 00002000:00010000:3.0:1746065197.867366:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b3b80 00000100:00100000:3.0:1746065197.867396:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8617 00000100:00100000:3.0:1746065197.867403:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263380992:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.871393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.878108:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381248 00000100:00100000:1.0:1746065197.878122:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381248 00002000:00100000:1.0:1746065197.878172:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009bee3100 x1830881263381248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.878182:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3100 with x1830881263381248 ext(3145728->4194303) 00002000:00010000:1.0:1746065197.878187:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee3100 00000100:00100000:1.0:1746065197.878236:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8618 00000100:00100000:1.0:1746065197.878245:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263381248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.888093:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1958:x1830881263380992:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20679us (21186us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065197.888105:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8617 00002000:00100000:3.0:1746065197.888118:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012d3b3b80 x1830881263380992/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.888126:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b3b80 with x1830881263380992 ext(3145728->4194303) 00002000:00010000:3.0:1746065197.888132:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b3b80 00000100:00100000:0.0:1746065197.890451:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263381248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12197us (19058us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065197.890464:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8618 00002000:00100000:0.0:1746065197.890475:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009bee3100 x1830881263381248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.890484:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee3100 with x1830881263381248 ext(3145728->4194303) 00002000:00010000:0.0:1746065197.890489:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee3100 00000100:00100000:0.0:1746065197.903515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.903558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.903591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.903620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.903706:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381376 00000100:00100000:0.0:1746065197.903713:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381376 00000100:00100000:0.0:1746065197.903744:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381632 00000100:00100000:0.0:1746065197.903745:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381632 00000100:00100000:0.0:1746065197.903754:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381504 00000100:00100000:0.0:1746065197.903756:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381504 00000100:00100000:0.0:1746065197.903763:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263381760 00000100:00100000:0.0:1746065197.903764:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263381760 00000100:00100000:0.0:1746065197.903775:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15293 00000100:00100000:0.0:1746065197.903782:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881263381376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.903796:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.903811:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c3c expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.903854:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x7b1 00010000:00010000:0.0:1746065197.903870:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.903871:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.903878:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.903892:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.903901:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5704c00, rc 0) 00000100:00100000:0.0:1746065197.903933:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263381376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 151us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.903938:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15293 00000100:00100000:0.0:1746065197.903955:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15294 00000100:00100000:0.0:1746065197.903959:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881263381632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.903964:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.903973:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c4a expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.903984:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d72e, atime: 0x6812d72e, ctime: 0x6812d72e, blocks: 0x821 00010000:00010000:0.0:1746065197.903990:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.903991:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.903995:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 29 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.904003:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 29 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.904009:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5704400, rc 0) 00000100:00100000:0.0:1746065197.904021:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263381632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.904028:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15294 00000100:00100000:0.0:1746065197.904038:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15295 00000100:00100000:0.0:1746065197.904042:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1958:x1830881263381504:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.904046:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.904053:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c43 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.904062:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d72d, atime: 0x6812d72b, ctime: 0x6812d72d, blocks: 0x821 00010000:00010000:0.0:1746065197.904068:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.904069:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.904073:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 29 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.904080:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 29 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.904086:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5705400, rc 0) 00000100:00100000:0.0:1746065197.904097:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1958:x1830881263381504:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.904101:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15295 00000100:00100000:0.0:1746065197.904109:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15296 00000100:00100000:0.0:1746065197.904113:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1958:x1830881263381760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065197.904118:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.904123:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c51 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065197.904137:0:4545:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d72b, atime: 0x6812d72b, ctime: 0x6812d72b, blocks: 0x821 00010000:00010000:0.0:1746065197.904142:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.904144:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.904147:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.904154:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 17 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.904160:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5704800, rc 0) 00000100:00100000:0.0:1746065197.904172:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263381760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 58us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.904176:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15296 00000100:00100000:2.0:1746065197.911054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.911054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.911139:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382016 00000100:00100000:1.0:1746065197.911146:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382016 00000100:00100000:1.0:1746065197.911182:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10140 00000100:00100000:1.0:1746065197.911188:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:32168:x1830881263382016:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065197.911207:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065197.911220:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fecbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c58 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.911308:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911318:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911326:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911336:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911340:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911344:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911413:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911418:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911423:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:1.0:1746065197.911429:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065197.911487:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911492:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911500:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911504:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800930cde00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065197.911507:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911511:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911518:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065197.911520:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065197.911523:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911527:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cde00/0x14b4f8542d4fecc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911538:0:20754:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911542:0:20754:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911546:0:20754:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911549:0:20754:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800930cce00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065197.911551:0:20754:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911555:0:20754:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911562:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205700) 00010000:00010000:1.0:1746065197.911563:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065197.911565:0:20754:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911569:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cce00/0x14b4f8542d4feccd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065197.911595:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cd400/0x14b4f8542d4fecbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 11 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.911596:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065197.911604:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 10 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.911609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065197.911610:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065197.911612:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065197.911613:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cdc00, rc 0) 00000100:00100000:1.0:1746065197.911647:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:32168:x1830881263382016:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 459us (593us total) trans 8589944429 rc 0/0 00000100:00100000:1.0:1746065197.911652:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10140 00000100:00100000:0.0:1746065197.911681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.911699:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382144 00000100:00100000:0.0:1746065197.911702:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382144 00000100:00100000:2.0:1746065197.911710:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382272 00000100:00100000:2.0:1746065197.911712:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382272 00000100:00100000:0.0:1746065197.911718:0:4544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382528 00000100:00100000:0.0:1746065197.911720:0:4544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382528 00000100:00100000:2.0:1746065197.911727:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382400 00000100:00100000:2.0:1746065197.911728:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382400 00000100:00100000:0.0:1746065197.911730:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15297 00000100:00100000:0.0:1746065197.911734:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263382144:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:2.0:1746065197.911738:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15298 00010000:00010000:0.0:1746065197.911741:0:4544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065197.911742:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263382272:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.911748:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.911749:0:4544:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c5f expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.911755:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c66 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.911766:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.911766:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.911767:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.911767:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.911772:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.911772:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.911781:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.911781:0:4544:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 13 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.911788:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e8a00, rc 0) 00010000:00010000:0.0:1746065197.911788:0:4544:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5f8fa00, rc 0) 00000100:00100000:0.0:1746065197.911804:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263382144:12345-192.168.202.46@tcp:101:cat.0 Request processed in 69us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.911807:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263382272:12345-192.168.202.46@tcp:101:cat.0 Request processed in 65us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.911809:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15297 00000100:00100000:2.0:1746065197.911812:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15298 00000100:00100000:2.0:1746065197.911844:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15299 00000100:00100000:2.0:1746065197.911848:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263382528:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.911853:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.911858:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c74 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.911868:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.911869:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.911873:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.911880:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.911885:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e9200, rc 0) 00000100:00100000:2.0:1746065197.911898:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263382528:12345-192.168.202.46@tcp:101:cat.0 Request processed in 50us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.911903:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15299 00000100:00100000:2.0:1746065197.911918:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15300 00000100:00100000:2.0:1746065197.911922:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263382400:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065197.911927:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.911932:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c6d expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.911940:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.911941:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.911945:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.911952:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.911958:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e9400, rc 0) 00000100:00100000:2.0:1746065197.911972:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263382400:12345-192.168.202.46@tcp:101:cat.0 Request processed in 49us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.911976:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15300 00000100:00100000:0.0:1746065197.915903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.915943:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263382784 00000100:00100000:2.0:1746065197.915951:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263382784 00002000:00100000:2.0:1746065197.915990:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880093ba0700 x1830881263382784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.915998:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0700 with x1830881263382784 ext(4194304->5013503) 00002000:00010000:2.0:1746065197.916003:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba0700 00000100:00100000:2.0:1746065197.916034:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8619 00000100:00100000:2.0:1746065197.916040:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263382784:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065197.923418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.928125:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383040 00000100:00100000:3.0:1746065197.928139:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383040 00002000:00100000:3.0:1746065197.928189:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880093ba1500 x1830881263383040/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.928199:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1500 with x1830881263383040 ext(4194304->5013503) 00002000:00010000:3.0:1746065197.928204:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba1500 00000100:00100000:3.0:1746065197.928255:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8620 00000100:00100000:3.0:1746065197.928265:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263383040:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.929587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.931018:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263382784:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14971us (15117us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065197.931028:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8619 00002000:00100000:3.0:1746065197.931037:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880093ba0700 x1830881263382784/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.931046:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba0700 with x1830881263382784 ext(4194304->5013503) 00002000:00010000:3.0:1746065197.931051:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba0700 00000100:00100000:0.0:1746065197.931265:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383168 00000100:00100000:0.0:1746065197.931272:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383168 00000100:00100000:0.0:1746065197.931312:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15301 00000100:00100000:0.0:1746065197.931318:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:32165:x1830881263383168:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065197.931330:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.931343:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c7b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.931365:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 18 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.931372:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.931378:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.931380:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.931382:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 5/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [864256->1048575] (req 864256->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.931404:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 14 pid: 4544 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.931413:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 14 pid: 4544 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.931423:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473984:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065197.931492:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 18 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.931499:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 18 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.931505:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260474112:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065197.931520:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065197.934557:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263383040:12345-192.168.202.46@tcp:3:cat.0 Request processed in 6282us (11135us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065197.934568:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8620 00002000:00100000:3.0:1746065197.934580:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880093ba1500 x1830881263383040/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.934588:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba1500 with x1830881263383040 ext(4194304->5013503) 00002000:00010000:3.0:1746065197.934594:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba1500 00000100:00100000:0.0:1746065197.953309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.953341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.953388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.953418:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383680 00000100:00100000:0.0:1746065197.953425:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383680 00000100:00100000:0.0:1746065197.953458:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4382 00000100:00100000:0.0:1746065197.953465:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32156:x1830881263383680:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065197.953622:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32156:x1830881263383680:12345-192.168.202.46@tcp:35:cat.0 Request processed in 157us (232us total) trans 8589944430 rc 0/0 00000100:00100000:0.0:1746065197.953627:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4382 00000100:00100000:2.0:1746065197.953906:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fcac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260473984:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.953916:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260474112:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.953938:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [864256->1048575] (req 864256->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 18 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.953952:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ec21200, rc 0) 00000100:00100000:2.0:1746065197.953985:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:32165:x1830881263383168:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 22667us (24402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.953991:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15301 00000100:00100000:1.0:1746065197.954222:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383296 00000100:00100000:1.0:1746065197.954226:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383296 00010000:00010000:1.0:1746065197.954243:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 13 pid: 4544 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065197.954260:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383424 00000100:00100000:1.0:1746065197.954262:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383424 00010000:00010000:1.0:1746065197.954271:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 18 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065197.954288:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7889 00000100:00100000:1.0:1746065197.954293:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263383296:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.954301:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.954318:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 13 pid: 4544 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.954326:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 13 pid: 4544 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.954344:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5f8fa00/0x14b4f8542d4fece2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c5f expref: 13 pid: 4544 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.954362:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.954381:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+12:1958:x1830881263383296:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 87us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.954387:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7889 00000100:00100000:1.0:1746065197.954399:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7890 00000100:00100000:1.0:1746065197.954403:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881263383424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.954409:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.954416:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 18 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.954424:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 18 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.954439:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5704c00/0x14b4f8542d4feca3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c3c expref: 18 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065197.954447:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.954448:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.954454:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.954462:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.954485:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 17 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.954495:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260474240:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065197.954538:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065197.955752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.955808:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263383936 00000100:00100000:0.0:1746065197.955812:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263383936 00000100:00100000:0.0:1746065197.955854:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4383 00000100:00100000:0.0:1746065197.955860:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b878c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:32160:x1830881263383936:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:0.0:1746065197.955976:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b878c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:32160:x1830881263383936:12345-192.168.202.46@tcp:35:cat.0 Request processed in 115us (226us total) trans 8589944431 rc 0/0 00000100:00100000:0.0:1746065197.955981:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4383 00000100:00100000:0.0:1746065197.957661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.957799:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260474240:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065197.957836:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.957864:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1958:x1830881263383424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3460us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.957871:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7890 00000100:00100000:2.0:1746065197.957954:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384064 00000100:00100000:2.0:1746065197.957959:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384064 00000100:00100000:2.0:1746065197.957995:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15302 00000100:00100000:2.0:1746065197.958001:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:32168:x1830881263384064:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065197.958013:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065197.958025:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c82 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.958045:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 13 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.958052:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.958057:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.958059:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.958062:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [2576384->2981887] (req 2576384->2981887) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.958082:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 16 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.958092:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065197.958107:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260474368:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.958154:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 13 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.958161:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 13 pid: 25185 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065197.958168:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260474496:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065197.958183:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065197.966214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.966249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.966312:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384448 00000100:00100000:1.0:1746065197.966319:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384448 00010000:00010000:1.0:1746065197.966343:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 17 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065197.966369:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7891 00000100:00100000:1.0:1746065197.966375:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263384448:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.966386:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.966401:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 17 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.966410:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 17 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.966432:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.966466:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263384448:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.966471:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7891 00010000:00010000:0.0:1746065197.966599:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a61600/0x14b4f8542d4fec8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c27 expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065197.966612:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260474368:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065197.966659:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384320 00000100:00100000:3.0:1746065197.966662:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384320 00002000:00100000:3.0:1746065197.966694:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x380:0x0] (864256->868351) req@ffff88009bee2a00 x1830881263384320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.966702:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2a00 with x1830881263384320 ext(864256->868351) 00002000:00010000:3.0:1746065197.966705:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee2a00 00000100:00100000:3.0:1746065197.966720:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8621 00000100:00100000:3.0:1746065197.966724:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263384320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065197.966983:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263384320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 258us (777us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065197.966989:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8621 00002000:00100000:3.0:1746065197.966993:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (864256->868351) req@ffff88009bee2a00 x1830881263384320/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.967000:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2a00 with x1830881263384320 ext(864256->868351) 00002000:00010000:3.0:1746065197.967003:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee2a00 00000100:00100000:0.0:1746065197.973857:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.973921:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384576 00000100:00100000:1.0:1746065197.973927:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384576 00010000:00010000:1.0:1746065197.973953:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 14 pid: 25185 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065197.973974:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7892 00000100:00100000:1.0:1746065197.973979:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263384576:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065197.973989:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065197.974005:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 14 pid: 25185 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.974019:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 14 pid: 25185 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065197.974037:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.974039:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065197.974044:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 14 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.974051:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 14 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065197.974076:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 14 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.974084:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260474624:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065197.974148:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ebd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065197.974291:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fec80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c20 expref: 14 pid: 25185 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065197.974308:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260474496:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.974327:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.974335:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b919e00, rc 0) 00000100:00100000:2.0:1746065197.974369:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:32168:x1830881263384064:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 16367us (16711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.974375:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15302 00000100:00100000:1.0:1746065197.982648:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260474624:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065197.982665:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065197.982666:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.982712:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263384576:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8732us (8862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.982721:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7892 00000100:00100000:2.0:1746065197.982934:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384704 00000100:00100000:2.0:1746065197.982941:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384704 00000100:00100000:2.0:1746065197.982979:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15303 00000100:00100000:2.0:1746065197.982985:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:32165:x1830881263384704:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065197.982999:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065197.983000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065197.983013:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c89 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065197.983023:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263384960 00000100:00100000:1.0:1746065197.983026:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263384960 00010000:00010000:2.0:1746065197.983036:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 30 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.983043:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746065197.983044:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (2576384->2580479) req@ffff88009f9eb480 x1830881263384960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746065197.983049:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.983050:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065197.983053:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->1572863] (req 1048576->1572863) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065197.983057:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9eb480 with x1830881263384960 ext(2576384->2580479) 00002000:00010000:1.0:1746065197.983060:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9eb480 00000100:00100000:1.0:1746065197.983070:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8622 00010000:00010000:2.0:1746065197.983074:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065197.983074:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263384960:12345-192.168.202.46@tcp:3:multiop.0 00010000:00010000:2.0:1746065197.983084:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 13 pid: 25185 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.983093:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260474752:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.983146:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 30 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065197.983157:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 30 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.983163:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260474880:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065197.983174:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263384960:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 99us (174us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065197.983176:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065197.983179:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8622 00002000:00100000:1.0:1746065197.983184:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (2576384->2580479) req@ffff88009f9eb480 x1830881263384960/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065197.983190:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9eb480 with x1830881263384960 ext(2576384->2580479) 00002000:00010000:1.0:1746065197.983193:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9eb480 00000100:00100000:0.0:1746065197.986257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.986299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.986323:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385216 00000100:00100000:0.0:1746065197.986329:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385216 00010000:00010000:0.0:1746065197.986359:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 31 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.986398:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385088 00000100:00100000:0.0:1746065197.986400:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385088 00010000:00010000:0.0:1746065197.986410:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 14 pid: 25185 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065197.986423:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7893 00000100:00100000:0.0:1746065197.986429:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263385216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.986439:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.986456:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 31 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.986466:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 31 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.986486:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.986514:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263385216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.986519:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7893 00000100:00100000:0.0:1746065197.986536:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7894 00000100:00100000:0.0:1746065197.986539:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263385088:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.986545:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.986551:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 14 pid: 25185 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.986562:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 14 pid: 25185 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065197.986571:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.986572:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.986578:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.986584:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.986607:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 30 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.986616:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260475008:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065197.986662:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09cf00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065197.987148:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fece9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c66 expref: 14 pid: 25185 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.987164:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260474752:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.987173:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5705400/0x14b4f8542d4fecb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c43 expref: 30 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065197.987182:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1830881260474880:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065197.987200:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 29 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065197.987207:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b919c00, rc 0) 00000100:00100000:2.0:1746065197.987229:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:32165:x1830881263384704:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4244us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065197.987235:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15303 00000100:00100000:0.0:1746065197.989481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065197.989651:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385472 00000100:00100000:3.0:1746065197.989658:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385472 00002000:00100000:3.0:1746065197.989700:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2977792->2981887) req@ffff88009b82f100 x1830881263385472/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.989708:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82f100 with x1830881263385472 ext(2977792->2981887) 00002000:00010000:3.0:1746065197.989712:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b82f100 00000100:00100000:3.0:1746065197.989728:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8623 00000100:00100000:3.0:1746065197.989733:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263385472:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065197.989895:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263385472:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 161us (421us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065197.989901:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8623 00002000:00100000:3.0:1746065197.989906:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2977792->2981887) req@ffff88009b82f100 x1830881263385472/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065197.989913:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82f100 with x1830881263385472 ext(2977792->2981887) 00002000:00010000:3.0:1746065197.989915:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b82f100 00000100:00100000:1.0:1746065197.990056:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260475008:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065197.990072:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065197.990092:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263385088:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3551us (3792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065197.990098:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7894 00000100:00100000:0.0:1746065197.994342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065197.994393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065197.994627:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385984 00000100:00100000:2.0:1746065197.994635:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385984 00002000:00100000:2.0:1746065197.994666:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1568768->1572863) req@ffff88009b82dc00 x1830881263385984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065197.994688:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82dc00 with x1830881263385984 ext(1568768->1572863) 00002000:00010000:2.0:1746065197.994692:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82dc00 00000100:00100000:2.0:1746065197.994720:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8624 00000100:00100000:2.0:1746065197.994725:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263385984:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065197.994915:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263385984:12345-192.168.202.46@tcp:3:cat.0 Request processed in 189us (526us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065197.994921:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8624 00002000:00100000:2.0:1746065197.994925:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1568768->1572863) req@ffff88009b82dc00 x1830881263385984/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065197.995065:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263385728 00000100:00100000:1.0:1746065197.995069:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263385728 00000100:00100000:1.0:1746065197.995094:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4384 00000100:00100000:1.0:1746065197.995099:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:32168:x1830881263385728:12345-192.168.202.46@tcp:35:multiop.0 00002000:00100000:2.0:1746065197.995317:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82dc00 with x1830881263385984 ext(1568768->1572863) 00002000:00010000:2.0:1746065197.995320:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82dc00 00000100:00100000:1.0:1746065197.995446:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:32168:x1830881263385728:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 346us (1113us total) trans 8589944432 rc 0/0 00000100:00100000:1.0:1746065197.995451:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4384 00000100:00100000:0.0:1746065197.997399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065197.997793:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386240 00000100:00100000:1.0:1746065197.997799:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386240 00000100:00100000:1.0:1746065197.997858:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4385 00000100:00100000:1.0:1746065197.997865:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32165:x1830881263386240:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065197.998966:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32165:x1830881263386240:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1098us (1569us total) trans 8589944433 rc 0/0 00000100:00100000:1.0:1746065197.998973:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4385 00010000:00010000:3.0:1746065198.030901:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065198.093286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.093466:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386496 00000100:00100000:2.0:1746065198.093474:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386496 00000100:00100000:2.0:1746065198.093512:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10141 00000100:00100000:2.0:1746065198.093519:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+12:32175:x1830881263386496:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065198.093535:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.093549:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919800/0x14b4f8542d4fed13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c90 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.093624:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.093635:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.093644:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065198.093653:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065198.093755:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b919800/0x14b4f8542d4fed13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 15 pid: 14643 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746065198.093863:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065198.094201:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.094209:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.094211:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065198.094213:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b918800, rc 0) 00000100:00100000:2.0:1746065198.095916:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:32175:x1830881263386496:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2392us (2632us total) trans 8589944434 rc 0/0 00000100:00100000:2.0:1746065198.095927:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10141 00000100:00100000:0.0:1746065198.100534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.100575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.100626:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386624 00000100:00100000:3.0:1746065198.100634:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386624 00000100:00100000:3.0:1746065198.100684:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386752 00000100:00100000:3.0:1746065198.100686:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386752 00000100:00100000:3.0:1746065198.100703:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15304 00000100:00100000:3.0:1746065198.100709:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263386624:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.100724:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.100737:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fed28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c97 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.100776:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260475136:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065198.100863:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065198.100948:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15305 00000100:00100000:3.0:1746065198.100954:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263386752:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.100961:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.100970:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fed2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61c9e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.100989:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260475264:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065198.101009:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00080000:0.0:1746065198.101198:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065198.101201:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1746065198.105173:0:21998:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime: 1746065195 -> 1746065198 00002000:00010000:3.0:1746065198.105180:0:21998:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime: 1746065195 -> 1746065198 00002000:00010000:3.0:1746065198.105182:0:21998:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime: 1746065195 -> 1746065198 00000100:00100000:3.0:1746065198.105202:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260475136:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065198.105229:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fed28 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c97 expref: 13 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.105242:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a60e00/0x14b4f8542d4fed28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c97 expref: 13 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.105269:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a60e00, rc 0) 00000100:00100000:3.0:1746065198.105309:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263386624:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4598us (4780us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065198.105315:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15304 00002000:00010000:3.0:1746065198.106415:0:8428:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime: 1746065197 -> 1746065198 00002000:00010000:3.0:1746065198.106419:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065195 -> 1746065198 00002000:00010000:3.0:1746065198.106421:0:8428:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime: 1746065197 -> 1746065198 00000100:00100000:3.0:1746065198.106434:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260475264:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065198.106452:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fed2f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c9e expref: 14 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.106461:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938e8a00/0x14b4f8542d4fed2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c9e expref: 14 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.106468:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e8a00, rc 0) 00000100:00100000:3.0:1746065198.106580:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263386752:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5624us (6002us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065198.106586:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15305 00000100:00100000:3.0:1746065198.108789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.108844:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263386880 00000100:00100000:0.0:1746065198.108852:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263386880 00000100:00100000:0.0:1746065198.108891:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15306 00000100:00100000:0.0:1746065198.108898:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+12:32175:x1830881263386880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.108911:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.108925:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ca5 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.108947:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.108954:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065198.108955:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065198.108958:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.108981:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 15 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.108991:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 15 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.109001:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260475392:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.109426:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.114283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.114379:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260475392:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.114403:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.114418:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd7800, rc 0) 00000100:00100000:2.0:1746065198.114451:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:32175:x1830881263386880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5554us (5668us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.114457:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15306 00000100:00100000:3.0:1746065198.114505:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387008 00000100:00100000:3.0:1746065198.114512:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387008 00002000:00100000:3.0:1746065198.114726:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (864256->1048575) req@ffff88012d7ff480 x1830881263387008/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.114734:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff480 with x1830881263387008 ext(864256->1048575) 00010000:00010000:3.0:1746065198.114739:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.114750:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065198.114755:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d7ff480 00000100:00100000:3.0:1746065198.114777:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2608 00000100:00100000:3.0:1746065198.114783:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263387008:12345-192.168.202.46@tcp:4:cat.0 00000100:00080000:1.0:1746065198.116001:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065198.124885:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881263387008:12345-192.168.202.46@tcp:4:cat.0 Request processed in 10092us (10599us total) trans 21474841034 rc 0/0 00000100:00100000:3.0:1746065198.124896:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2608 00002000:00100000:3.0:1746065198.124906:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (864256->1048575) req@ffff88012d7ff480 x1830881263387008/t21474841034(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.124914:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff480 with x1830881263387008 ext(864256->1048575) 00010000:00010000:3.0:1746065198.124924:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 18 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.124938:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 18 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065198.124944:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d7ff480 00000100:00100000:0.0:1746065198.128788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.128889:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387136 00000100:00100000:1.0:1746065198.128896:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387136 00010000:00010000:1.0:1746065198.128924:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 18 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065198.128957:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7895 00000100:00100000:1.0:1746065198.128963:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881263387136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065198.128974:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065198.128991:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 18 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.129000:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 18 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.129019:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ec21200/0x14b4f8542d4fecfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 864256->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c7b expref: 18 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.129045:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.129047:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.129054:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 12 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.129060:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 12 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.129087:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 12 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.129097:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260475520:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065198.129161:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.133613:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260475520:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065198.133632:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065198.133684:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1959:x1830881263387136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4719us (4902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.133695:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7895 00000100:00100000:0.0:1746065198.134791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.134884:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387392 00000100:00100000:3.0:1746065198.134891:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387392 00002000:00100000:3.0:1746065198.134923:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012d3b2a00 x1830881263387392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.134931:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b2a00 with x1830881263387392 ext(0->1048575) 00002000:00010000:3.0:1746065198.134935:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b2a00 00000100:00100000:3.0:1746065198.134985:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8625 00000100:00100000:3.0:1746065198.134991:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263387392:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065198.149771:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263387392:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14772us (14974us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.149782:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8625 00002000:00100000:3.0:1746065198.149793:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012d3b2a00 x1830881263387392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.149801:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b2a00 with x1830881263387392 ext(0->1048575) 00002000:00010000:3.0:1746065198.149806:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b2a00 00000100:00100000:0.0:1746065198.155643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.155703:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387520 00000100:00100000:2.0:1746065198.155710:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387520 00000100:00100000:2.0:1746065198.155764:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15307 00000100:00100000:2.0:1746065198.155772:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:32175:x1830881263387520:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065198.155791:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.155806:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cac expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.155847:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.155854:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065198.155855:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065198.155858:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.155885:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 28 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.155895:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 28 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.155906:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260475648:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.155982:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065198.158327:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260475648:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.158351:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.158365:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b918c00, rc 0) 00000100:00100000:2.0:1746065198.158717:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:32175:x1830881263387520:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2943us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.158725:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15307 00000100:00100000:0.0:1746065198.158788:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.159155:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387648 00000100:00100000:3.0:1746065198.159160:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387648 00002000:00100000:3.0:1746065198.159201:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1572863) req@ffff88012d3b3480 x1830881263387648/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.159210:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b3480 with x1830881263387648 ext(1048576->1572863) 00010000:00010000:3.0:1746065198.159216:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 29 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.159227:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 29 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065198.159232:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b3480 00000100:00100000:3.0:1746065198.159250:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2609 00000100:00100000:3.0:1746065198.159256:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1961:x1830881263387648:12345-192.168.202.46@tcp:4:cat.0 00000100:00080000:0.0:1746065198.159684:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065198.168405:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263387648:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9138us (9606us total) trans 17179873745 rc 0/0 00000100:00100000:3.0:1746065198.168417:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2609 00002000:00100000:3.0:1746065198.168428:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1572863) req@ffff88012d3b3480 x1830881263387648/t17179873745(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.168437:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b3480 with x1830881263387648 ext(1048576->1572863) 00010000:00010000:3.0:1746065198.168445:0:350:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 31 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.168460:0:350:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 31 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065198.168467:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d3b3480 00000100:00100000:0.0:1746065198.171180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.171361:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263387776 00000100:00100000:1.0:1746065198.171370:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263387776 00010000:00010000:1.0:1746065198.171402:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 31 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065198.171439:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7896 00000100:00100000:1.0:1746065198.171446:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263387776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065198.171458:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065198.171476:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 31 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.171491:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 31 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.171509:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b919c00/0x14b4f8542d4fed0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c89 expref: 31 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.171533:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.171535:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.171541:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.171548:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.171576:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.171587:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260475776:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065198.171661:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.176404:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260475776:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065198.176422:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065198.176469:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1961:x1830881263387776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5022us (5295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.176478:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7896 00000100:00100000:0.0:1746065198.200088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.200138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.200217:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388160 00000100:00100000:3.0:1746065198.200225:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388160 00002000:00100000:3.0:1746065198.200258:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012d3b0380 x1830881263388160/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.200267:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0380 with x1830881263388160 ext(1048576->2097151) 00002000:00010000:3.0:1746065198.200271:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b0380 00000100:00100000:3.0:1746065198.200283:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388288 00000100:00100000:3.0:1746065198.200285:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388288 00002000:00100000:3.0:1746065198.200294:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012d3b3100 x1830881263388288/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.200300:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b3100 with x1830881263388288 ext(1048576->2097151) 00002000:00010000:3.0:1746065198.200303:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b3100 00000100:00100000:3.0:1746065198.200314:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8626 00000100:00100000:3.0:1746065198.200320:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263388160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065198.201378:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8627 00000100:00100000:2.0:1746065198.201387:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263388288:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.207082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.208685:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388544 00000100:00100000:3.0:1746065198.208695:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388544 00002000:00100000:3.0:1746065198.208735:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012d3b0700 x1830881263388544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.208745:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0700 with x1830881263388544 ext(1048576->2097151) 00002000:00010000:3.0:1746065198.208749:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b0700 00000100:00100000:3.0:1746065198.208774:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8628 00000100:00100000:3.0:1746065198.208781:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263388544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.212933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.212961:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388800 00000100:00100000:0.0:1746065198.212968:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388800 00000100:00100000:0.0:1746065198.213006:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10142 00000100:00100000:0.0:1746065198.213014:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32179:x1830881263388800:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.213033:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.213050:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7ba00/0x14b4f8542d4fed44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cb3 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.213137:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213148:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213158:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213168:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213174:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213179:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213269:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213276:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213282:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065198.213289:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065198.213355:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213361:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213366:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213371:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134d7bc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065198.213374:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213379:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213389:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065198.213391:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065198.213395:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213399:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7bc00/0x14b4f8542d4fed4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213414:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213418:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213423:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213426:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134d7be00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065198.213428:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213432:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213437:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800982ac400) 00010000:00010000:0.0:1746065198.213439:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065198.213441:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213445:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7be00/0x14b4f8542d4fed52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.213474:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134d7ba00/0x14b4f8542d4fed44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.213483:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 255 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.213489:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065198.213492:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065198.213494:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3f2000, rc 0) 00000100:00100000:0.0:1746065198.213530:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:32179:x1830881263388800:12345-192.168.202.46@tcp:101:cat.0 Request processed in 518us (605us total) trans 8589944435 rc 0/0 00000100:00100000:0.0:1746065198.213536:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10142 00000100:00080000:0.0:1746065198.213556:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065198.225885:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263388160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 25556us (25795us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.225896:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8626 00002000:00100000:3.0:1746065198.225906:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012d3b0380 x1830881263388160/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.225915:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0380 with x1830881263388160 ext(1048576->2097151) 00002000:00010000:3.0:1746065198.225921:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b0380 00000100:00100000:2.0:1746065198.229506:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263388288:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28111us (29358us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065198.229516:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8627 00002000:00100000:2.0:1746065198.229525:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88012d3b3100 x1830881263388288/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.229534:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b3100 with x1830881263388288 ext(1048576->2097151) 00002000:00010000:2.0:1746065198.229539:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b3100 00000100:00100000:3.0:1746065198.236981:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263388544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28192us (29900us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.236991:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8628 00002000:00100000:3.0:1746065198.237001:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012d3b0700 x1830881263388544/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.237009:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0700 with x1830881263388544 ext(1048576->2097151) 00002000:00010000:3.0:1746065198.237014:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b0700 00000100:00100000:2.0:1746065198.242219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.242441:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.242551:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263388928 00000100:00100000:3.0:1746065198.242560:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263388928 00000100:00100000:3.0:1746065198.242588:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389184 00000100:00100000:3.0:1746065198.242589:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389184 00000100:00100000:3.0:1746065198.242601:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15308 00000100:00100000:3.0:1746065198.242606:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881263388928:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.242622:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.242635:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cba expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.242657:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.242658:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.242665:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.242689:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.242697:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5069c00, rc 0) 00000100:00100000:3.0:1746065198.242729:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1959:x1830881263388928:12345-192.168.202.46@tcp:101:cat.0 Request processed in 124us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.242735:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15308 00000100:00100000:3.0:1746065198.242746:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15309 00000100:00100000:3.0:1746065198.242749:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881263389184:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.242754:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.242758:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c67000/0x14b4f8542d4fed6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cc8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.242801:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260475904:192.168.202.46@tcp:106: 00000100:00100000:3.0:1746065198.242858:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.242905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.245613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.246467:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389440 00000100:00100000:3.0:1746065198.246474:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389440 00000100:00100000:3.0:1746065198.246516:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10143 00000100:00100000:3.0:1746065198.246523:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc9b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:32182:x1830881263389440:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065198.246541:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.246555:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7c800/0x14b4f8542d4fed75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ccf expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.246629:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065198.246641:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 13 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.246648:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.246653:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065198.246690:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.246700:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 256 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.246710:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260476032:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065198.246771:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 13 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.246778:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 13 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.246785:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260476160:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.246799:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065198.247336:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389056 00000100:00100000:2.0:1746065198.247340:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389056 00000100:00100000:2.0:1746065198.247364:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15310 00000100:00100000:2.0:1746065198.247368:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1959:x1830881263389056:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065198.247376:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.247384:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cc1 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.247397:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.247399:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.247405:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.247419:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.247427:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b919800, rc 0) 00000100:00100000:2.0:1746065198.247454:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1959:x1830881263389056:12345-192.168.202.46@tcp:101:cat.0 Request processed in 85us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.247460:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15310 00000100:00100000:0.0:1746065198.251484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.251598:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260476032:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.251618:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389696 00000100:00100000:0.0:1746065198.251623:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389696 00000100:00100000:0.0:1746065198.251653:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10144 00000100:00100000:0.0:1746065198.251658:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:32183:x1830881263389696:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065198.251685:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.251699:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2200/0x14b4f8542d4fed8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cd6 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.251766:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.251775:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.251782:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00002000:00010000:3.0:1746065198.252053:0:8428:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065198 -> 1746065199 00000100:00100000:3.0:1746065198.252069:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260475904:192.168.202.46@tcp:106: 00010000:00010000:3.0:1746065198.252091:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c67000/0x14b4f8542d4fed6e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc8 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.252100:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c67000/0x14b4f8542d4fed6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc8 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.252125:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c67000, rc 0) 00000100:00100000:3.0:1746065198.252158:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1959:x1830881263389184:12345-192.168.202.46@tcp:101:cat.0 Request processed in 9408us (9717us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065198.252164:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15309 00000100:00100000:2.0:1746065198.254195:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260476160:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.254215:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065198.254872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.256530:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389824 00000100:00100000:1.0:1746065198.256540:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389824 00010000:00010000:1.0:1746065198.256570:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 257 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065198.256611:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7897 00000100:00100000:1.0:1746065198.256617:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1961:x1830881263389824:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065198.256629:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065198.256634:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 257 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.256643:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 257 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.256659:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2000/0x14b4f8542d4fed59 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cb3 expref: 257 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.256685:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065198.256690:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065198.256697:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:1.0:1746065198.256701:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065198.256745:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1961:x1830881263389824:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 127us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.256750:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7897 00000100:00100000:1.0:1746065198.257852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.257956:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263389952 00000100:00100000:3.0:1746065198.257960:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263389952 00010000:00010000:3.0:1746065198.257974:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 16 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.258201:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7898 00000100:00100000:3.0:1746065198.258206:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263389952:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.258214:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.258218:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 16 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.258225:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 16 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.258238:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fecd4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c58 expref: 16 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.258248:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065198.258251:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065198.258257:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065198.258262:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:3.0:1746065198.258267:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.258271:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.258275:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.258929:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.258937:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065198.258953:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065198.259063:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2200/0x14b4f8542d4fed8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 17 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.259097:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.259129:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263389952:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 923us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.259135:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7898 00010000:00010000:2.0:1746065198.259425:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.259431:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000004:00200000:2.0:1746065198.259441:0:20754:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065198.259497:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7c800/0x14b4f8542d4fed75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 257 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.259519:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 256 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.259524:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.259527:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065198.259529:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c7ca00, rc 0) 00000100:00100000:2.0:1746065198.259550:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc9b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:32182:x1830881263389440:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 13028us (16645us total) trans 8589944437 rc 0/0 00000100:00100000:2.0:1746065198.259555:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10143 00010000:00010000:0.0:1746065198.262217:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 15 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.262227:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065198.262230:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065198.262232:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3f2600, rc 0) 00000100:00100000:3.0:1746065198.262324:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:32183:x1830881263389696:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 10664us (10845us total) trans 8589944436 rc 0/0 00000100:00100000:3.0:1746065198.262333:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10144 00000100:00100000:0.0:1746065198.268384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.268466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.268535:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390208 00000100:00100000:3.0:1746065198.268542:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390208 00002000:00100000:3.0:1746065198.268577:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3551231) req@ffff88012d3b1500 x1830881263390208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 504/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.268591:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1500 with x1830881263390208 ext(2097152->3551231) 00002000:00010000:3.0:1746065198.268595:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b1500 00000100:00100000:3.0:1746065198.268607:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390464 00000100:00100000:3.0:1746065198.268609:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390464 00002000:00100000:3.0:1746065198.268618:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (3551232->4194303) req@ffff88012d3b0000 x1830881263390464/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.268623:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0000 with x1830881263390464 ext(3551232->4194303) 00002000:00010000:3.0:1746065198.268625:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b0000 00000100:00100000:3.0:1746065198.268641:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8629 00000100:00100000:3.0:1746065198.268647:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263390208:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065198.273795:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8630 00000100:00100000:2.0:1746065198.273811:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263390464:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.284352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.284397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.284441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.284477:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390720 00000100:00100000:0.0:1746065198.284485:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390720 00002000:00100000:0.0:1746065198.284520:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012d3b1180 x1830881263390720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.284529:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1180 with x1830881263390720 ext(2097152->3145727) 00002000:00010000:0.0:1746065198.284533:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b1180 00000100:00100000:0.0:1746065198.284547:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263390976 00000100:00100000:0.0:1746065198.284550:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263390976 00002000:00100000:0.0:1746065198.284563:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012d3b1c00 x1830881263390976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.284574:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1c00 with x1830881263390976 ext(0->1048575) 00002000:00010000:0.0:1746065198.284576:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b1c00 00000100:00100000:0.0:1746065198.284587:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391232 00000100:00100000:0.0:1746065198.284590:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391232 00002000:00100000:0.0:1746065198.284601:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012d3b3800 x1830881263391232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.284606:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b3800 with x1830881263391232 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.284609:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b3800 00000100:00100000:0.0:1746065198.284622:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8631 00000100:00100000:0.0:1746065198.284628:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263390720:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065198.286806:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8632 00000100:00100000:2.0:1746065198.286834:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881263390976:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065198.287625:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8633 00000100:00100000:1.0:1746065198.287634:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263391232:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.294444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.296796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.299542:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391488 00000100:00100000:3.0:1746065198.299553:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391488 00002000:00100000:3.0:1746065198.299595:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2ce00 x1830881263391488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.299605:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ce00 with x1830881263391488 ext(1048576->2097151) 00002000:00010000:3.0:1746065198.299610:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2ce00 00000100:00100000:3.0:1746065198.299653:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8634 00000100:00100000:3.0:1746065198.299660:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263391488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065198.301610:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391744 00000100:00100000:2.0:1746065198.301618:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391744 00002000:00100000:2.0:1746065198.301645:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f9e8a80 x1830881263391744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.301653:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9e8a80 with x1830881263391744 ext(1048576->2097151) 00002000:00010000:2.0:1746065198.301658:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9e8a80 00000100:00100000:2.0:1746065198.301692:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8635 00000100:00100000:2.0:1746065198.301698:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263391744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.303322:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263390464:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29512us (34851us total) trans 0 rc 643072/643072 00000100:00100000:0.0:1746065198.303330:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8630 00002000:00100000:0.0:1746065198.303337:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3551232->4194303) req@ffff88012d3b0000 x1830881263390464/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.303344:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b0000 with x1830881263390464 ext(3551232->4194303) 00002000:00010000:0.0:1746065198.303348:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b0000 00000100:00100000:2.0:1746065198.305444:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263390208:12345-192.168.202.46@tcp:3:cat.0 Request processed in 36791us (37061us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065198.305453:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8629 00002000:00100000:2.0:1746065198.305461:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3551231) req@ffff88012d3b1500 x1830881263390208/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 504/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.305469:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1500 with x1830881263390208 ext(2097152->3551231) 00002000:00010000:2.0:1746065198.305474:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b1500 00000100:00100000:0.0:1746065198.310745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.311684:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263391872 00000100:00100000:1.0:1746065198.311692:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263391872 00000100:00100000:1.0:1746065198.312124:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15311 00000100:00100000:1.0:1746065198.312132:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:32182:x1830881263391872:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065198.312147:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.312163:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cdd expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.312189:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.312196:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065198.312197:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065198.312200:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 23 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.312227:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.312236:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 12 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065198.312246:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260476288:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065198.312323:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.312846:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263390720:12345-192.168.202.46@tcp:3:cat.0 Request processed in 28187us (28473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065198.312856:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8631 00002000:00100000:1.0:1746065198.312866:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012d3b1180 x1830881263390720/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.312874:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1180 with x1830881263390720 ext(2097152->3145727) 00002000:00010000:1.0:1746065198.312879:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b1180 00000100:00100000:2.0:1746065198.318618:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263390976:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31796us (34212us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065198.318629:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8632 00002000:00100000:2.0:1746065198.318639:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88012d3b1c00 x1830881263390976/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.318648:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b1c00 with x1830881263390976 ext(0->1048575) 00002000:00010000:2.0:1746065198.318654:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d3b1c00 00000100:00100000:1.0:1746065198.324626:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260476288:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065198.324654:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 21 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.324681:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cc400, rc 0) 00000100:00100000:1.0:1746065198.324731:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:32182:x1830881263391872:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 12599us (13992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.324738:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15311 00000100:00100000:0.0:1746065198.329922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.329983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.330380:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263391232:12345-192.168.202.46@tcp:3:cat.0 Request processed in 42746us (45937us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.330392:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8633 00002000:00100000:0.0:1746065198.330401:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88012d3b3800 x1830881263391232/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.330409:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d3b3800 with x1830881263391232 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.330414:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d3b3800 00000100:00100000:0.0:1746065198.330435:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392000 00000100:00100000:0.0:1746065198.330440:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392000 00002000:00100000:0.0:1746065198.330464:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2576384->2981887) req@ffff88008ec2c700 x1830881263392000/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.330470:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c700 with x1830881263392000 ext(2576384->2981887) 00010000:00010000:0.0:1746065198.330476:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 13 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.330489:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 13 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:0.0:1746065198.330494:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec2c700 00000100:00100000:0.0:1746065198.330506:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2610 00000100:00100000:0.0:1746065198.330512:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263392000:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065198.331282:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263391488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31618us (36842us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.331289:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8634 00002000:00100000:3.0:1746065198.331295:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2ce00 x1830881263391488/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.331307:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2ce00 with x1830881263391488 ext(1048576->2097151) 00002000:00010000:3.0:1746065198.331310:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2ce00 00000100:00100000:1.0:1746065198.331380:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392128 00000100:00100000:1.0:1746065198.331383:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392128 00000100:00100000:1.0:1746065198.331405:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15312 00000100:00100000:1.0:1746065198.331411:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:32175:x1830881263392128:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065198.331419:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.331431:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ce4 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.331448:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065198.331453:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.331463:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065198.331466:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.331492:0:8851:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.331503:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 16 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.331510:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cdc00, rc 0) 00000100:00100000:1.0:1746065198.331526:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:32175:x1830881263392128:12345-192.168.202.46@tcp:101:cat.0 Request processed in 116us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.331531:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15312 00000100:00100000:2.0:1746065198.343787:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263391744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 42077us (46986us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065198.343800:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8635 00002000:00100000:2.0:1746065198.343812:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009f9e8a80 x1830881263391744/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.343832:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f9e8a80 with x1830881263391744 ext(1048576->2097151) 00002000:00010000:2.0:1746065198.343837:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f9e8a80 00000100:00100000:2.0:1746065198.347863:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263392000:12345-192.168.202.46@tcp:4:cat.0 Request processed in 17343us (17943us total) trans 21474841035 rc 0/0 00000100:00100000:2.0:1746065198.347873:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2610 00002000:00100000:2.0:1746065198.347883:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (2576384->2981887) req@ffff88008ec2c700 x1830881263392000/t21474841035(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.347891:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c700 with x1830881263392000 ext(2576384->2981887) 00010000:00010000:2.0:1746065198.347899:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.347913:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065198.347925:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec2c700 00000100:00100000:2.0:1746065198.354069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.357403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.357615:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392384 00000100:00100000:3.0:1746065198.357625:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392384 00000100:00100000:3.0:1746065198.357684:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15313 00000100:00100000:3.0:1746065198.357691:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:32179:x1830881263392384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.357706:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.357720:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ceb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.357739:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065198.357787:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065198.357793:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.357804:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.357826:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b264a00, rc 0) 00000100:00100000:1.0:1746065198.357908:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392256 00000100:00100000:1.0:1746065198.357912:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392256 00010000:00010000:1.0:1746065198.357927:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065198.357953:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7899 00000100:00100000:1.0:1746065198.357957:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263392256:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065198.357963:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065198.357977:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.357989:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.358002:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b919e00/0x14b4f8542d4fed05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2576384->2981887) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c82 expref: 16 pid: 8429 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.358014:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.358015:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.358019:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.358025:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.358044:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.358052:0:10991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065198.358061:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260476544:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065198.358573:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:32179:x1830881263392384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 882us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.358579:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15313 00000100:00100000:1.0:1746065198.358656:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.360275:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260476544:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065198.360290:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065198.360319:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263392256:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2360us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.360328:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7899 00000100:00100000:0.0:1746065198.362638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.362731:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392640 00000100:00100000:2.0:1746065198.362738:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392640 00002000:00100000:2.0:1746065198.362776:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4009984->4014079) req@ffff88009fa75c00 x1830881263392640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.362784:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75c00 with x1830881263392640 ext(4009984->4014079) 00010000:00010000:2.0:1746065198.362792:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.362804:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065198.362810:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa75c00 00000100:00100000:2.0:1746065198.362844:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2611 00000100:00100000:2.0:1746065198.362851:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263392640:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065198.363002:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263392640:12345-192.168.202.46@tcp:3:cat.0 Request processed in 151us (369us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065198.363008:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2611 00002000:00100000:2.0:1746065198.363013:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x383:0x0] (4009984->4014079) req@ffff88009fa75c00 x1830881263392640/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/4536 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.363019:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa75c00 with x1830881263392640 ext(4009984->4014079) 00010000:00010000:2.0:1746065198.363023:0:21488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.363032:0:21488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065198.363037:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa75c00 00000100:00100000:0.0:1746065198.366407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.366442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.366469:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263392896 00000100:00100000:3.0:1746065198.366475:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263392896 00000100:00100000:0.0:1746065198.366477:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.366491:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393152 00000100:00100000:0.0:1746065198.366494:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393152 00000100:00100000:3.0:1746065198.366522:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15314 00000100:00100000:0.0:1746065198.366528:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15315 00000100:00100000:3.0:1746065198.366531:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:32183:x1830881263392896:12345-192.168.202.46@tcp:101:multiop.0 00000100:00100000:0.0:1746065198.366534:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:32182:x1830881263393152:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065198.366546:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.366546:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.366558:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cf2 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.366558:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61cf9 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.366579:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 19 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.366579:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 13 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.366587:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 16 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.366587:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.366592:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.366592:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.366593:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.366593:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.366596:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1290240->1826815] (req 1290240->1826815) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 16 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.366596:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->3293183] (req 3145728->3293183) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.366617:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 16 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.366617:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 32 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.366626:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 16 pid: 25185 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065198.366626:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 32 pid: 25185 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.366636:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260476800:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.366636:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260476672:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065198.366696:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393024 00000100:00100000:1.0:1746065198.366699:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393024 00010000:00010000:0.0:1746065198.366704:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 13 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.366711:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 13 pid: 25185 timeout: 897 lvb_type: 0 00002000:00100000:1.0:1746065198.366718:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4009984->4194303) req@ffff88009fa74e00 x1830881263393024/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065198.366718:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260476928:192.168.202.46@tcp:104: 00002000:00100000:1.0:1746065198.366726:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74e00 with x1830881263393024 ext(4009984->4194303) 00010000:00010000:1.0:1746065198.366730:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.366737:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 20 pid: 8851 timeout: 897 lvb_type: 0 00002000:00010000:1.0:1746065198.366742:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa74e00 00000100:00100000:1.0:1746065198.366758:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2612 00000100:00100000:1.0:1746065198.366762:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263393024:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065198.366837:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09ccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065198.366839:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 20 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.366846:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 20 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065198.366857:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260477056:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.366874:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.372539:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260476672:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.372599:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260476928:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.372623:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->3293183] (req 3145728->3293183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.372636:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5ce00, rc 0) 00000100:00100000:0.0:1746065198.372681:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:32182:x1830881263393152:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 6146us (6201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.372688:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15315 00000100:00100000:0.0:1746065198.372764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.372785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.372856:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393536 00000100:00100000:1.0:1746065198.372861:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393536 00010000:00010000:1.0:1746065198.372884:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 14 pid: 25185 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065198.372901:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393280 00000100:00100000:1.0:1746065198.372902:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393280 00010000:00010000:1.0:1746065198.372913:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 17 pid: 25185 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065198.372929:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7900 00000100:00100000:1.0:1746065198.372935:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263393536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065198.372943:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065198.372962:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 14 pid: 25185 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.372970:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 14 pid: 25185 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.372988:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4fec95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c2e expref: 14 pid: 25185 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.373000:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065198.373019:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263393536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.373024:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7900 00000100:00100000:1.0:1746065198.373035:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7901 00000100:00100000:1.0:1746065198.373039:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263393280:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065198.373046:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065198.373057:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 17 pid: 25185 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065198.373064:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 17 pid: 25185 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065198.373081:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065198.373094:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263393280:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 55us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.373100:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7901 00010000:00010000:3.0:1746065198.374037:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938e9200/0x14b4f8542d4fecf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c74 expref: 16 pid: 25185 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065198.374063:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260476800:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.374073:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260477056:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065198.374091:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1290240->1826815] (req 1290240->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.374100:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b264c00, rc 0) 00000100:00100000:3.0:1746065198.374124:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:32183:x1830881263392896:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 7594us (7725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.374130:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15314 00000100:00100000:0.0:1746065198.374605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.374621:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393408 00000100:00100000:0.0:1746065198.374626:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393408 00010000:00010000:0.0:1746065198.374646:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 32 pid: 25185 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.374683:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7902 00000100:00100000:0.0:1746065198.374688:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263393408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.374697:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.374712:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 32 pid: 25185 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.374720:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 32 pid: 25185 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.374735:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4fec9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c35 expref: 32 pid: 25185 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.374747:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.374749:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.374755:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.374762:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.374787:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 31 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.374797:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ba3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260477184:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065198.374863:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.374889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.374992:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393664 00000100:00100000:3.0:1746065198.374995:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393664 00010000:00010000:3.0:1746065198.375007:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 22 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065198.375023:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7903 00000100:00100000:3.0:1746065198.375028:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263393664:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.375035:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.375045:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 22 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.375052:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 22 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.375063:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5704800/0x14b4f8542d4fecb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c51 expref: 22 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.375071:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.375072:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.375076:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.375082:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.375096:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.375103:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260477312:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065198.375138:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.376454:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263393024:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9685us (10005us total) trans 21474841036 rc 0/0 00000100:00100000:1.0:1746065198.376463:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2612 00002000:00100000:1.0:1746065198.376472:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (4009984->4194303) req@ffff88009fa74e00 x1830881263393024/t21474841036(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.376481:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa74e00 with x1830881263393024 ext(4009984->4194303) 00010000:00010000:1.0:1746065198.376489:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 22 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.376501:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 22 pid: 8851 timeout: 897 lvb_type: 0 00002000:00010000:1.0:1746065198.376507:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fa74e00 00000100:00100000:2.0:1746065198.379455:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ba3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260477184:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065198.379474:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.379507:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263393408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4818us (4902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.379517:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7902 00000100:00100000:3.0:1746065198.379600:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260477312:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065198.379611:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.379626:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263393664:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4597us (4736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.379631:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7903 00000100:00100000:0.0:1746065198.380883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.380919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.380992:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263393920 00000100:00100000:1.0:1746065198.380997:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263393920 00002000:00100000:1.0:1746065198.381028:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1290240->1294335) req@ffff880093ba3480 x1830881263393920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.381036:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3480 with x1830881263393920 ext(1290240->1294335) 00002000:00010000:1.0:1746065198.381041:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba3480 00000100:00100000:1.0:1746065198.381066:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8636 00000100:00100000:1.0:1746065198.381072:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263393920:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065198.381197:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263393920:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 125us (316us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065198.381205:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8636 00002000:00100000:1.0:1746065198.381210:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1290240->1294335) req@ffff880093ba3480 x1830881263393920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/4536 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.381217:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3480 with x1830881263393920 ext(1290240->1294335) 00002000:00010000:1.0:1746065198.381220:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba3480 00000100:00100000:0.0:1746065198.381326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.381381:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263394304 00000100:00100000:3.0:1746065198.381385:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263394304 00010000:00010000:3.0:1746065198.381400:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 21 pid: 8851 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.381417:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7904 00000100:00100000:3.0:1746065198.381421:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263394304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.381430:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065198.381440:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065198 -> 1746065199 00002000:00010000:3.0:1746065198.381443:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065198 -> 1746065199 00010000:00010000:3.0:1746065198.381447:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 21 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.381456:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 21 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.381473:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930cc400/0x14b4f8542d4feda6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cdd expref: 21 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.381484:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.381486:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.381492:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.381499:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.381506:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.381508:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.381510:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.381516:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.381537:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 20 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.381547:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260477440:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065198.381600:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.381608:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260477568:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065198.381623:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065198.381870:0:21488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263394176 00000100:00100000:2.0:1746065198.381874:0:21488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263394176 00002000:00100000:2.0:1746065198.381891:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3289088->3293183) req@ffff880093ba2680 x1830881263394176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.381899:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2680 with x1830881263394176 ext(3289088->3293183) 00002000:00010000:2.0:1746065198.381901:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2680 00000100:00100000:2.0:1746065198.381913:0:21488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8637 00000100:00100000:2.0:1746065198.381918:0:21488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263394176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065198.381989:0:21488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263394176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 71us (663us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065198.381994:0:21488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8637 00002000:00100000:2.0:1746065198.381998:0:21488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x389:0x0] (3289088->3293183) req@ffff880093ba2680 x1830881263394176/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/4536 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.382004:0:21488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2680 with x1830881263394176 ext(3289088->3293183) 00002000:00010000:2.0:1746065198.382007:0:21488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2680 00000100:00100000:2.0:1746065198.384757:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260477440:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065198.384767:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260477568:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065198.384784:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.385005:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263394304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3391us (3893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.385015:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7904 00000100:00100000:0.0:1746065198.389027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.389165:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263394560 00000100:00100000:3.0:1746065198.389172:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263394560 00002000:00100000:3.0:1746065198.389210:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880093ba3b80 x1830881263394560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.389218:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3b80 with x1830881263394560 ext(3145728->4194303) 00002000:00010000:3.0:1746065198.389221:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba3b80 00000100:00100000:3.0:1746065198.389252:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8638 00000100:00100000:3.0:1746065198.389259:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263394560:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065198.395473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.395967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.395997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.396017:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.396684:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263394816 00000100:00100000:0.0:1746065198.396692:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263394816 00002000:00100000:0.0:1746065198.396726:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x382:0x0] (1822720->1826815) req@ffff88009bee1f80 x1830881263394816/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.396736:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1f80 with x1830881263394816 ext(1822720->1826815) 00002000:00010000:0.0:1746065198.396740:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee1f80 00000100:00100000:0.0:1746065198.396754:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395072 00000100:00100000:0.0:1746065198.396757:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395072 00002000:00100000:0.0:1746065198.396767:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009bee2680 x1830881263395072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.396774:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2680 with x1830881263395072 ext(2097152->3145727) 00002000:00010000:0.0:1746065198.396776:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee2680 00000100:00100000:0.0:1746065198.396786:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395328 00000100:00100000:0.0:1746065198.396788:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395328 00002000:00100000:0.0:1746065198.396796:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009bee0700 x1830881263395328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.396803:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0700 with x1830881263395328 ext(3145728->4194303) 00002000:00010000:0.0:1746065198.396805:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee0700 00000100:00100000:0.0:1746065198.396826:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395584 00000100:00100000:0.0:1746065198.396828:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395584 00002000:00100000:0.0:1746065198.396839:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009bee2300 x1830881263395584/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.396844:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2300 with x1830881263395584 ext(2097152->3145727) 00002000:00010000:0.0:1746065198.396846:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee2300 00000100:00100000:0.0:1746065198.396864:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8639 00000100:00100000:0.0:1746065198.396871:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263394816:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065198.397011:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263394816:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 139us (1544us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065198.397017:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8639 00002000:00100000:0.0:1746065198.397021:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x382:0x0] (1822720->1826815) req@ffff88009bee1f80 x1830881263394816/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/4536 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.397027:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1f80 with x1830881263394816 ext(1822720->1826815) 00002000:00010000:0.0:1746065198.397029:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee1f80 00000100:00100000:0.0:1746065198.397045:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8640 00000100:00100000:0.0:1746065198.397050:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263395072:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065198.397725:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8641 00000100:00100000:3.0:1746065198.397733:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263395328:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.397956:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8642 00000100:00100000:0.0:1746065198.397961:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263395584:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.400594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.402579:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395840 00000100:00100000:2.0:1746065198.402589:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395840 00002000:00100000:2.0:1746065198.402624:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3293184->4194303) req@ffff880093ba2300 x1830881263395840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.402634:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2300 with x1830881263395840 ext(3293184->4194303) 00002000:00010000:2.0:1746065198.402638:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba2300 00000100:00100000:2.0:1746065198.402657:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8643 00000100:00100000:2.0:1746065198.402664:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263395840:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065198.414990:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263394560:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 25722us (25960us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.415001:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8638 00002000:00100000:3.0:1746065198.415011:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880093ba3b80 x1830881263394560/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.415020:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3b80 with x1830881263394560 ext(3145728->4194303) 00002000:00010000:3.0:1746065198.415025:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ba3b80 00000100:00100000:0.0:1746065198.415908:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1958:x1830881263395072:12345-192.168.202.46@tcp:3:cat.0 Request processed in 18855us (19940us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.415920:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8640 00002000:00100000:0.0:1746065198.415925:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009bee2680 x1830881263395072/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.415931:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2680 with x1830881263395072 ext(2097152->3145727) 00002000:00010000:0.0:1746065198.415934:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee2680 00000100:00100000:3.0:1746065198.421646:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263395328:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23906us (25640us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.421656:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8641 00002000:00100000:3.0:1746065198.421675:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009bee0700 x1830881263395328/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.421684:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0700 with x1830881263395328 ext(3145728->4194303) 00002000:00010000:3.0:1746065198.421689:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bee0700 00000100:00100000:0.0:1746065198.428992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.431143:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263395584:12345-192.168.202.46@tcp:3:cat.0 Request processed in 33175us (35119us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065198.431152:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8642 00002000:00100000:1.0:1746065198.431162:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009bee2300 x1830881263395584/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.431171:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee2300 with x1830881263395584 ext(2097152->3145727) 00002000:00010000:1.0:1746065198.431175:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee2300 00000100:00100000:3.0:1746065198.431296:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263395968 00000100:00100000:3.0:1746065198.431303:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263395968 00000100:00100000:3.0:1746065198.431329:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15316 00000100:00100000:3.0:1746065198.431334:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:32175:x1830881263395968:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.431345:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.431358:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d00 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.431380:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.431391:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065198.431393:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065198.431396:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.431420:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 32 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.431430:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 32 pid: 8851 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.431439:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260477696:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.432733:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ade40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065198.433917:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263395840:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31249us (33324us total) trans 0 rc 901120/901120 00000100:00100000:3.0:1746065198.433925:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8643 00002000:00100000:3.0:1746065198.433933:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3293184->4194303) req@ffff880093ba2300 x1830881263395840/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.433941:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba2300 with x1830881263395840 ext(3293184->4194303) 00010000:00010000:3.0:1746065198.433948:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 31 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.433959:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 31 pid: 8851 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065198.433970:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba2300 00000100:00100000:3.0:1746065198.437384:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1830881260477696:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065198.437437:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.437450:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b264200, rc 0) 00000100:00100000:3.0:1746065198.437501:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+14:32175:x1830881263395968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6165us (8515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.437508:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15316 00000100:00100000:0.0:1746065198.439066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.439481:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396096 00000100:00100000:3.0:1746065198.439489:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396096 00002000:00100000:3.0:1746065198.439523:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3293183) req@ffff880093ba3800 x1830881263396096/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.439532:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3800 with x1830881263396096 ext(3145728->3293183) 00010000:00010000:3.0:1746065198.439539:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 31 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.439550:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 31 pid: 8851 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065198.439556:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba3800 00000100:00100000:3.0:1746065198.439586:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2613 00000100:00100000:3.0:1746065198.439593:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1961:x1830881263396096:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065198.440547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.441175:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396224 00000100:00100000:3.0:1746065198.441180:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396224 00000100:00100000:3.0:1746065198.441869:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15317 00000100:00100000:3.0:1746065198.441877:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:32179:x1830881263396224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.441889:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.441902:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d07 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.441921:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065198.441925:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.441934:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 34 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.441942:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b264400, rc 0) 00000100:00100000:3.0:1746065198.441970:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:32179:x1830881263396224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 94us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.441975:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15317 00000100:00100000:2.0:1746065198.443787:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263396096:12345-192.168.202.46@tcp:4:cat.0 Request processed in 4190us (4722us total) trans 17179873746 rc 0/0 00000100:00100000:2.0:1746065198.443795:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2613 00002000:00100000:2.0:1746065198.443804:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->3293183) req@ffff880093ba3800 x1830881263396096/t17179873746(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.443838:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3800 with x1830881263396096 ext(3145728->3293183) 00010000:00010000:2.0:1746065198.443845:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 34 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.443857:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 34 pid: 8851 timeout: 897 lvb_type: 0 00002000:00010000:2.0:1746065198.443863:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ba3800 00000100:00100000:0.0:1746065198.447131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.447221:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396352 00000100:00100000:2.0:1746065198.447228:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396352 00010000:00010000:2.0:1746065198.447256:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 34 pid: 8851 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.447290:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7905 00000100:00100000:2.0:1746065198.447296:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263396352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.447308:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065198.447322:0:7078:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065198 -> 1746065199 00002000:00010000:2.0:1746065198.447325:0:7078:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065198 -> 1746065199 00010000:00010000:2.0:1746065198.447329:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 34 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.447339:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 34 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.447356:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5ce00/0x14b4f8542d4fedbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf9 expref: 34 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.447373:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.447374:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.447379:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.447386:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.447391:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.447392:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.447394:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.447399:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.447422:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 33 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065198.447430:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260477824:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065198.448038:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065198.448047:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260477952:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065198.448219:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.453171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.453212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.453280:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396608 00000100:00100000:3.0:1746065198.453289:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396608 00000100:00100000:1.0:1746065198.453289:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263396864 00000100:00100000:1.0:1746065198.453292:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263396864 00002000:00100000:3.0:1746065198.453324:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094d94700 x1830881263396608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.453324:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094d95f80 x1830881263396864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.453333:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94700 with x1830881263396608 ext(3145728->4194303) 00002000:00100000:1.0:1746065198.453333:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881263396864 ext(3145728->4194303) 00002000:00010000:3.0:1746065198.453337:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d94700 00002000:00010000:1.0:1746065198.453340:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:3.0:1746065198.453353:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8644 00000100:00100000:3.0:1746065198.453359:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263396608:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065198.453536:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8645 00000100:00100000:1.0:1746065198.453545:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263396864:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065198.453617:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260477824:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065198.453625:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7078:1830881260477952:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065198.453643:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.453682:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1958:x1830881263396352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6386us (6557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.453688:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7905 00000100:00100000:1.0:1746065198.465898:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263396864:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 12346us (12674us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065198.465909:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8645 00002000:00100000:1.0:1746065198.465921:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094d95f80 x1830881263396864/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.465929:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d95f80 with x1830881263396864 ext(3145728->4194303) 00002000:00010000:1.0:1746065198.465934:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d95f80 00000100:00100000:3.0:1746065198.465958:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263396608:12345-192.168.202.46@tcp:3:cat.0 Request processed in 12599us (12796us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.465965:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8644 00002000:00100000:3.0:1746065198.465969:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094d94700 x1830881263396608/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.465975:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d94700 with x1830881263396608 ext(3145728->4194303) 00002000:00010000:3.0:1746065198.465978:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d94700 00000100:00100000:0.0:1746065198.475597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.475651:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397248 00000100:00100000:3.0:1746065198.475658:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397248 00002000:00100000:3.0:1746065198.475702:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d97100 x1830881263397248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.475715:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97100 with x1830881263397248 ext(4194304->5013503) 00002000:00010000:3.0:1746065198.475719:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97100 00000100:00100000:3.0:1746065198.475748:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8646 00000100:00100000:3.0:1746065198.475755:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263397248:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.477681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.478225:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397120 00000100:00100000:1.0:1746065198.478232:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397120 00000100:00100000:1.0:1746065198.478266:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15318 00000100:00100000:1.0:1746065198.478272:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263397120:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065198.478285:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.478300:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009340b400/0x14b4f8542d4fedd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d0e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.478341:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260478080:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065198.478833:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ebcc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065198.483461:0:8851:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065195 -> 1746065199 00002000:00010000:1.0:1746065198.483467:0:8851:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065195 -> 1746065199 00002000:00010000:1.0:1746065198.483469:0:8851:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065195 -> 1746065199 00000100:00100000:1.0:1746065198.483491:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260478080:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065198.483517:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009340b400/0x14b4f8542d4fedd7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d0e expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065198.483529:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009340b400/0x14b4f8542d4fedd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d0e expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065198.483771:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009340b400, rc 0) 00000100:00100000:1.0:1746065198.483909:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263397120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5635us (6239us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065198.483917:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15318 00000100:00100000:3.0:1746065198.483923:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263397248:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8168us (8334us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065198.483930:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8646 00002000:00100000:3.0:1746065198.483936:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094d97100 x1830881263397248/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.483944:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d97100 with x1830881263397248 ext(4194304->5013503) 00002000:00010000:3.0:1746065198.483948:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d97100 00000100:00100000:0.0:1746065198.487365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.487780:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397504 00000100:00100000:3.0:1746065198.487788:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397504 00002000:00100000:3.0:1746065198.487848:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fcaf100 x1830881263397504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.487862:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaf100 with x1830881263397504 ext(4194304->5013503) 00002000:00010000:3.0:1746065198.487866:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fcaf100 00000100:00100000:3.0:1746065198.487895:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8647 00000100:00100000:3.0:1746065198.487901:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263397504:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065198.496592:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263397504:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8681us (9226us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065198.496602:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8647 00002000:00100000:3.0:1746065198.497899:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fcaf100 x1830881263397504/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.497910:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaf100 with x1830881263397504 ext(4194304->5013503) 00002000:00010000:3.0:1746065198.497915:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fcaf100 00000100:00100000:0.0:1746065198.506007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.506081:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397632 00000100:00100000:1.0:1746065198.506090:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397632 00000100:00100000:1.0:1746065198.507245:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15319 00000100:00100000:1.0:1746065198.507256:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263397632:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065198.507271:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.507290:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009340b600/0x14b4f8542d4fedde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d15 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.507341:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260478208:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065198.507426:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ebcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.510148:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260478208:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065198.510175:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009340b600/0x14b4f8542d4fedde lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d15 expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065198.510187:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009340b600/0x14b4f8542d4fedde lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d15 expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065198.510251:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009340b600, rc 0) 00000100:00100000:1.0:1746065198.510300:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263397632:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3045us (4299us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065198.510307:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15319 00000100:00100000:0.0:1746065198.514680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.514781:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263397760 00000100:00100000:1.0:1746065198.514789:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263397760 00000100:00100000:1.0:1746065198.514904:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15320 00000100:00100000:1.0:1746065198.514913:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263397760:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065198.514928:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.514942:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009340b800/0x14b4f8542d4fede5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d1c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.514985:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260478336:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065198.515056:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945ebcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.518773:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8851:1830881260478336:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065198.518802:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009340b800/0x14b4f8542d4fede5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d1c expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065198.518843:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009340b800/0x14b4f8542d4fede5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d1c expref: 21 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065198.518866:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009340b800, rc 0) 00000100:00100000:1.0:1746065198.518909:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263397760:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3996us (4247us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065198.518917:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15320 00000100:00100000:0.0:1746065198.524638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.524873:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398016 00000100:00100000:1.0:1746065198.524881:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398016 00000100:00100000:1.0:1746065198.524937:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4386 00000100:00100000:1.0:1746065198.524943:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:32179:x1830881263398016:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065198.525407:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:32179:x1830881263398016:12345-192.168.202.46@tcp:35:cat.0 Request processed in 463us (777us total) trans 8589944438 rc 0/0 00000100:00100000:1.0:1746065198.525414:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4386 00000100:00100000:0.0:1746065198.540043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.540086:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398144 00000100:00100000:3.0:1746065198.540094:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398144 00000100:00100000:3.0:1746065198.540154:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10145 00000100:00100000:3.0:1746065198.540161:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:32188:x1830881263398144:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065198.540179:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.540192:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264600/0x14b4f8542d4fedec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d23 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.540239:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.540250:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.540259:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.540271:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.540275:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.540279:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.540366:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.540375:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 256 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.540381:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.540386:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.540408:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.540417:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 14 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.540426:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260478464:192.168.202.46@tcp:104: 00000100:00080000:0.0:1746065198.540565:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746065198.540923:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 256 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.540936:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 256 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.540944:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260478592:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.543260:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.545488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.545563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.545708:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260478464:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.545718:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260478592:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065198.545739:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065198.545839:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398400 00000100:00100000:0.0:1746065198.545845:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398400 00000100:00100000:0.0:1746065198.545889:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398656 00000100:00100000:0.0:1746065198.545891:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398656 00000100:00100000:0.0:1746065198.545917:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4387 00000100:00100000:0.0:1746065198.545924:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:15426:x1830881263398400:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065198.546088:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:15426:x1830881263398400:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 162us (606us total) trans 8589944439 rc 0/0 00000100:00100000:0.0:1746065198.546094:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4387 00000100:00100000:2.0:1746065198.546254:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4388 00000100:00100000:2.0:1746065198.546262:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:27246:x1830881263398656:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065198.546354:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:27246:x1830881263398656:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 94us (792us total) trans 8589944440 rc 0/0 00000100:00100000:2.0:1746065198.546359:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4388 00000100:00100000:0.0:1746065198.552945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.553060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.553948:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398784 00000100:00100000:3.0:1746065198.553957:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398784 00010000:00010000:3.0:1746065198.553997:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 16 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.554038:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263398912 00000100:00100000:3.0:1746065198.554041:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263398912 00010000:00010000:3.0:1746065198.554053:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 258 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.554069:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7906 00000100:00100000:3.0:1746065198.554076:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263398784:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.554088:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.554094:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 16 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.554108:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 16 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.554128:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fed91 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cd6 expref: 16 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.554156:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065198.554160:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554167:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554172:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554177:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.554220:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263398784:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 144us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.554227:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7906 00000100:00100000:3.0:1746065198.554241:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7907 00000100:00100000:3.0:1746065198.554246:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:1960:x1830881263398912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.554252:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.554256:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 258 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.554264:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 258 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.554277:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c7ca00/0x14b4f8542d4fed7c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ccf expref: 258 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.554284:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065198.554286:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554292:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554297:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554314:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.554328:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1960:x1830881263398912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 82us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.554333:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7907 00010000:00010000:3.0:1746065198.554352:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554357:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:3.0:1746065198.554398:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:3.0:1746065198.554403:0:14643:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746065198.554417:0:14643:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554425:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554436:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554442:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554454:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554460:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b264800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065198.554464:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554470:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554477:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065198.554480:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065198.554483:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554487:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264800/0x14b4f8542d4fedf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554495:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554500:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554505:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554508:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b264e00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065198.554511:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554515:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554521:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c8fa900) 00010000:00010000:3.0:1746065198.554523:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065198.554526:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554529:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264e00/0x14b4f8542d4fedfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.554557:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b264600/0x14b4f8542d4fedec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.554568:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 11 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.554574:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065198.554576:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065198.554578:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b265400, rc 0) 00000100:00100000:3.0:1746065198.554604:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:32188:x1830881263398144:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 14444us (14568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.554610:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10145 00000100:00100000:0.0:1746065198.559227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.559414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.559441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.559464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.559478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.559500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.559528:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399040 00000100:00100000:0.0:1746065198.559536:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399040 00000100:00100000:0.0:1746065198.559574:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399168 00000100:00100000:0.0:1746065198.559577:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399168 00000100:00100000:0.0:1746065198.559587:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399296 00000100:00100000:0.0:1746065198.559588:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399296 00000100:00100000:0.0:1746065198.559595:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399424 00000100:00100000:0.0:1746065198.559597:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399424 00000100:00100000:0.0:1746065198.559603:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399552 00000100:00100000:0.0:1746065198.559605:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399552 00000100:00100000:0.0:1746065198.559612:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399680 00000100:00100000:0.0:1746065198.559614:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399680 00000100:00100000:0.0:1746065198.559624:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15321 00000100:00100000:0.0:1746065198.559630:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263399040:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065198.559644:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.559659:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d2a expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.559687:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.559689:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.559698:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.559710:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.559719:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb18600, rc 0) 00000100:00100000:0.0:1746065198.559756:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263399040:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 126us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.559762:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15321 00000100:00100000:0.0:1746065198.559779:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15322 00000100:00100000:0.0:1746065198.559783:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263399168:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065198.559789:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.559796:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d31 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.559805:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.559806:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.559810:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.559840:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.559846:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb19400, rc 0) 00000100:00100000:0.0:1746065198.559860:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263399168:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 77us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.559864:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15322 00000100:00100000:0.0:1746065198.559874:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15323 00000100:00100000:0.0:1746065198.559878:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263399296:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065198.559883:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.559888:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d38 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.559896:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.559897:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.559900:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.559907:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.559912:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb19a00, rc 0) 00000100:00100000:0.0:1746065198.559924:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263399296:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 46us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.559928:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15323 00000100:00100000:0.0:1746065198.559938:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15324 00000100:00100000:0.0:1746065198.559942:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263399424:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065198.559948:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.559953:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb19200/0x14b4f8542d4fee1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d3f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.559983:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260478720:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065198.560032:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.560051:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15325 00000100:00100000:0.0:1746065198.560057:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263399552:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065198.560062:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.560068:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d46 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.560077:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.560079:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.560084:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.560092:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.560099:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb18c00, rc 0) 00000100:00100000:0.0:1746065198.560113:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263399552:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 57us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.560118:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15325 00000100:00100000:0.0:1746065198.560129:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15326 00000100:00100000:0.0:1746065198.560133:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263399680:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065198.560138:0:4545:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.560143:0:4545:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d4d expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.560151:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.560152:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.560155:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.560162:0:4545:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 9 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.560168:0:4545:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb18200, rc 0) 00000100:00100000:0.0:1746065198.560183:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263399680:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 50us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.560191:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15326 00000100:00080000:0.0:1746065198.560205:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065198.560208:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065198.563910:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260478720:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065198.563938:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb19200/0x14b4f8542d4fee1d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d3f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.563949:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb19200/0x14b4f8542d4fee1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d3f expref: 9 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.563973:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb19200, rc 0) 00000100:00100000:0.0:1746065198.564014:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263399424:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 4070us (4547us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065198.564020:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15324 00000100:00100000:0.0:1746065198.566762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.567775:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263399936 00000100:00100000:3.0:1746065198.567784:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263399936 00000100:00100000:3.0:1746065198.567843:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10146 00000100:00100000:3.0:1746065198.567850:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:32188:x1830881263399936:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065198.567867:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.567882:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265600/0x14b4f8542d4fee32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d54 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.567955:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.567968:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.567973:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.567998:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.568007:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 12 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.568016:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260478848:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.568081:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ade40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065198.569343:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260478848:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065198.569357:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065198.569898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.570144:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400064 00000100:00100000:2.0:1746065198.570149:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400064 00010000:00010000:2.0:1746065198.570171:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 13 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.570360:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7908 00000100:00100000:2.0:1746065198.570368:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263400064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.570377:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.570383:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 13 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.570392:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 13 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.570408:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265400/0x14b4f8542d4fee01 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d23 expref: 13 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.570435:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.570439:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.570445:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.570451:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.570475:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065198.570505:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:0.0:1746065198.570512:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:0.0:1746065198.570531:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000100:00100000:2.0:1746065198.570599:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:1961:x1830881263400064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 149us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.570607:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7908 00010000:00010000:0.0:1746065198.570646:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265600/0x14b4f8542d4fee32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d54 expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.570658:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d54 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.570664:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065198.570678:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065198.570680:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b265000, rc 0) 00000100:00100000:0.0:1746065198.570707:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:32188:x1830881263399936:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 2858us (3952us total) trans 8589944441 rc 0/0 00000100:00100000:0.0:1746065198.570712:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10146 00000100:00100000:0.0:1746065198.572227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.572280:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400320 00000100:00100000:2.0:1746065198.572284:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400320 00000100:00100000:2.0:1746065198.572304:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10147 00000100:00100000:2.0:1746065198.572309:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:32188:x1830881263400320:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.572321:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.572323:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065198.572335:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265000/0x14b4f8542d4fee39 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d54 expref: 12 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.572344:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.572347:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065198.572354:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0c00/0x14b4f8542d4fee47 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d5b expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.572409:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0e00/0x14b4f8542d4fee4e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.572418:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0e00/0x14b4f8542d4fee4e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.572424:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0e00/0x14b4f8542d4fee4e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:2.0:1746065198.572432:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065198.572496:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0c00/0x14b4f8542d4fee47 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d5b expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.572511:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0e00/0x14b4f8542d4fee4e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d5b expref: 13 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.572516:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.572518:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065198.572519:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939e0e00, rc 0) 00000100:00100000:2.0:1746065198.572554:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:32188:x1830881263400320:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 244us (328us total) trans 8589944442 rc 0/0 00000100:00100000:2.0:1746065198.572559:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10147 00000100:00100000:0.0:1746065198.573926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.573965:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400448 00000100:00100000:2.0:1746065198.573974:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400448 00000100:00100000:2.0:1746065198.574003:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10148 00000100:00100000:2.0:1746065198.574009:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+13:32188:x1830881263400448:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.574023:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.574032:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1000/0x14b4f8542d4fee5c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d62 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.574060:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1000/0x14b4f8542d4fee5c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d62 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.574068:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1000/0x14b4f8542d4fee5c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d62 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.574081:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.574083:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065198.574086:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939e1000, rc 0) 00000100:00100000:2.0:1746065198.574121:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:32188:x1830881263400448:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 111us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.574125:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10148 00000100:00100000:0.0:1746065198.575763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.575790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.575809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.575853:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.575864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.575882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.575896:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400576 00000100:00100000:0.0:1746065198.575901:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400576 00000100:00100000:0.0:1746065198.575924:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400832 00000100:00100000:0.0:1746065198.575926:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400832 00000100:00100000:0.0:1746065198.575935:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401088 00000100:00100000:0.0:1746065198.575937:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401088 00000100:00100000:0.0:1746065198.575944:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400704 00000100:00100000:0.0:1746065198.575945:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400704 00000100:00100000:0.0:1746065198.575953:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263400960 00000100:00100000:0.0:1746065198.575955:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263400960 00000100:00100000:0.0:1746065198.575963:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401216 00000100:00100000:0.0:1746065198.575964:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401216 00000100:00100000:0.0:1746065198.575973:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15327 00000100:00100000:0.0:1746065198.575979:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263400576:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065198.576009:0:8429:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576023:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576030:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576037:0:8429:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576043:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.576045:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.576047:0:8429:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576074:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576085:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 19 pid: 8428 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.576096:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260478976:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.576160:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 10 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576172:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 10 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.576179:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260479104:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.576203:0:8429:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576211:0:8429:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 14 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.576217:0:8429:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260479232:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.576233:0:8429:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.576251:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15328 00000100:00100000:0.0:1746065198.576256:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263400832:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065198.576271:0:25185:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576280:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 32 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576286:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576292:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576297:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.576298:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.576300:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576312:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576318:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 13 pid: 25185 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.576326:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260479360:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.576347:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576354:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 11 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.576360:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260479488:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.576380:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 32 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576387:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 32 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.576399:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260479616:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.576414:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.576428:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15329 00000100:00100000:0.0:1746065198.576433:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263401088:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065198.576449:0:2462:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576457:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576463:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576468:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576473:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.576474:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.576476:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576487:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 19 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576494:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 19 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.576501:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260479744:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.576523:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 10 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576529:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 10 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.576536:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260479872:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.576556:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 14 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576564:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 14 pid: 8851 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.576571:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260480000:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.576581:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.576596:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15330 00000100:00100000:0.0:1746065198.576601:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263400704:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065198.576615:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576623:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576634:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576640:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576645:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.576646:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.576648:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576662:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 32 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576682:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 32 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.576690:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260480128:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.576711:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 11 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.576719:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 11 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.576725:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260480256:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.576743:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576750:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.576757:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260480384:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.576768:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.576783:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15331 00000100:00100000:0.0:1746065198.576788:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263400960:12345-192.168.202.46@tcp:1:mirror_io.0 00000100:00100000:2.0:1746065198.576791:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15332 00000100:00100000:2.0:1746065198.576797:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263401216:12345-192.168.202.46@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065198.576803:0:21235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.576811:0:21998:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576811:0:21235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.576834:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576837:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065198.576838:0:21235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065198.576840:0:21235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.576841:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.576847:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576854:0:21235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 14 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.576855:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.576857:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.576858:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.576860:0:21235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 14 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.576870:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 32 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.576872:0:21235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260480512:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.576877:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 32 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.576883:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260480640:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.576910:0:21235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e1bb000 going to sleep for 11 seconds 00010000:00010000:2.0:1746065198.576927:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 11 pid: 4545 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.576933:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 11 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065198.576940:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260480768:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.576958:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 13 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.576965:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 13 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.576977:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260480896:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.576987:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.582053:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260479744:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.582079:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260479872:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.582097:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260480000:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.582125:0:2462:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.582155:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260480128:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.582174:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260480256:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.582191:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260480384:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.582204:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.582228:0:21235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:21235:1830881260480512:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065198.582236:0:21235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.582681:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260479360:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065198.582688:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260479488:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065198.582693:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260479616:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065198.582705:0:25185:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065198.582768:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260478976:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.582776:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260479104:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.582782:0:8429:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bd3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1830881260479232:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.582798:0:8429:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.582859:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.582900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.582939:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401856 00000100:00100000:1.0:1746065198.582945:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401856 00010000:00010000:1.0:1746065198.582970:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 14 pid: 25185 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065198.582990:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401984 00000100:00100000:1.0:1746065198.582992:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401984 00010000:00010000:1.0:1746065198.583001:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 11 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065198.583143:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260480640:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.583151:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260480768:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065198.583157:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260480896:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065198.583170:0:21998:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.587066:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7909 00000100:00100000:3.0:1746065198.587146:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263401856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065198.587158:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7910 00000100:00100000:2.0:1746065198.587165:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1959:x1830881263401984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.587237:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.587260:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 11 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.587264:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.587272:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 11 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.587277:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 14 pid: 25185 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.587284:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 14 pid: 25185 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065198.587288:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4fee24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d46 expref: 11 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.587294:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938e9400/0x14b4f8542d4fecf7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c6d expref: 14 pid: 25185 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065198.587300:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065198.587318:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.587709:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263401856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 569us (4849us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.587709:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1959:x1830881263401984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 543us (4806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.587715:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7909 00000100:00100000:2.0:1746065198.587718:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7910 00000100:00100000:2.0:1746065198.588358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.588373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.589054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.590893:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401472 00000100:00100000:1.0:1746065198.590903:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401472 00000100:00100000:0.0:1746065198.590903:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401728 00000100:00100000:0.0:1746065198.590907:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401728 00010000:00010000:1.0:1746065198.590934:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 10 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065198.590956:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401344 00000100:00100000:1.0:1746065198.590958:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401344 00000100:00100000:2.0:1746065198.591007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.591027:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263401600 00000100:00100000:3.0:1746065198.591030:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263401600 00010000:00010000:0.0:1746065198.591034:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 33 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.591045:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 12 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065198.591056:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7911 00000100:00100000:3.0:1746065198.591065:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7912 00000100:00100000:0.0:1746065198.591065:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1961:x1830881263401472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065198.591069:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263401728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.591077:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.591078:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.591093:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 33 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065198.591093:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 10 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.591103:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 33 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065198.591103:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 10 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.591120:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5704400/0x14b4f8542d4fecaa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c4a expref: 33 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065198.591120:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18600/0x14b4f8542d4fee08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d2a expref: 10 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.591134:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065198.591135:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.591172:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1961:x1830881263401728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.591178:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7912 00000100:00100000:2.0:1746065198.591186:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7913 00000100:00100000:2.0:1746065198.591192:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+12:1961:x1830881263401600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.591199:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.591206:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 12 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065198.591218:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 12 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065198.591223:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 20 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065198.591229:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb19a00/0x14b4f8542d4fee16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d38 expref: 12 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065198.591237:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.591239:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.591242:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.591242:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7914 00000100:00100000:1.0:1746065198.591247:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263401344:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.591250:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.591254:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065198.591261:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 20 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065198.591268:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 20 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065198.591270:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065198.591277:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5069c00/0x14b4f8542d4fed67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cba expref: 20 pid: 8428 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065198.591288:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065198.591317:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263401472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 254us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.591322:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7911 00000100:00100000:2.0:1746065198.591596:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1961:x1830881263401600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 403us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.591602:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7913 00000100:00100000:3.0:1746065198.591612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.591626:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402368 00000100:00100000:2.0:1746065198.591628:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402368 00000100:00100000:3.0:1746065198.591637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065198.591639:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 32 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:2.0:1746065198.591658:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7915 00000100:00100000:2.0:1746065198.591662:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263402368:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065198.591675:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263401344:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 419us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.591680:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7914 00010000:00010000:2.0:1746065198.591682:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.591690:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 32 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065198.591697:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 32 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065198.591697:0:25185:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.591704:0:25185:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.591707:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b919800/0x14b4f8542d4fed83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cc1 expref: 32 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:2.0:1746065198.591715:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065198.591722:0:25185:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065198.591728:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263402368:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 66us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065198.591728:0:25185:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065198.591732:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7915 00010000:00010000:1.0:1746065198.591735:0:25185:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.591741:0:25185:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800930cd000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065198.591744:0:25185:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.591751:0:25185:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.591760:0:25185:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.591765:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930cd000/0x14b4f8542d4fee6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.591830:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263400832:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 15558us (16023us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.591837:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15328 00000100:00100000:3.0:1746065198.591983:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402496 00000100:00100000:3.0:1746065198.591986:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402496 00002000:00100000:3.0:1746065198.592010:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1290240->1826815) req@ffff880135cdc700 x1830881263402496/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.592018:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc700 with x1830881263402496 ext(1290240->1826815) 00010000:00010000:3.0:1746065198.592024:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.592033:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065198.592042:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cdc700 00000100:00100000:3.0:1746065198.592053:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2614 00000100:00100000:3.0:1746065198.592058:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263402496:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:3.0:1746065198.592483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.592542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.592557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.593140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.593285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.593298:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402880 00000100:00100000:2.0:1746065198.593302:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402880 00010000:00010000:2.0:1746065198.593317:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 31 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.593339:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402112 00000100:00100000:2.0:1746065198.593341:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402112 00010000:00010000:2.0:1746065198.593351:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 17 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.593362:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402624 00000100:00100000:2.0:1746065198.593364:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402624 00010000:00010000:2.0:1746065198.593372:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.593380:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403136 00000100:00100000:2.0:1746065198.593381:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403136 00010000:00010000:2.0:1746065198.593390:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 19 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.593398:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7916 00000100:00100000:2.0:1746065198.593403:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263402880:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.593411:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.593424:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 31 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593431:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 31 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593446:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fedd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d07 expref: 31 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593459:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.593479:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263402880:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 75us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.593485:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7916 00000100:00100000:2.0:1746065198.593496:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7917 00000100:00100000:2.0:1746065198.593500:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263402112:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.593505:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.593515:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 17 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593522:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 17 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593533:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fd7800/0x14b4f8542d4fed36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ca5 expref: 17 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593540:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.593541:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.593545:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593552:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593568:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.593581:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263402112:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.593586:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7917 00000100:00100000:2.0:1746065198.593595:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7918 00000100:00100000:2.0:1746065198.593600:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263402624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.593605:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.593613:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593620:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593630:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b918c00/0x14b4f8542d4fed3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cac expref: 13 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593639:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.593652:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263402624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.593657:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7918 00000100:00100000:2.0:1746065198.593694:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7919 00000100:00100000:2.0:1746065198.593700:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881263403136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.593706:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.593714:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 19 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593721:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 19 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593735:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fedb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ceb expref: 19 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.593743:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.593755:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1960:x1830881263403136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 56us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.593760:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7919 00010000:00010000:2.0:1746065198.593776:0:8429:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593783:0:8429:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593797:0:8429:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593803:0:8429:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593810:0:8429:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593828:0:8429:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb19e00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065198.593831:0:8429:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593841:0:8429:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593849:0:8429:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.593855:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb19e00/0x14b4f8542d4fee63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065198.593891:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263400576:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 17912us (18131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.593897:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15327 00000100:00100000:3.0:1746065198.595524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.595541:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402240 00000100:00100000:3.0:1746065198.595548:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402240 00010000:00010000:3.0:1746065198.595571:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 10 pid: 21998 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065198.595595:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263402752 00000100:00100000:3.0:1746065198.595597:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263402752 00010000:00010000:3.0:1746065198.595606:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 11 pid: 4545 timeout: 897 lvb_type: 1 00000100:00100000:3.0:1746065198.595620:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7920 00000100:00100000:3.0:1746065198.595625:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263402240:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.595633:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.595649:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 11 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.595663:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 11 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.595694:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb19400/0x14b4f8542d4fee0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d31 expref: 11 pid: 21998 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.595705:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.595706:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.595710:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.595717:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.595740:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.595760:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263402240:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 135us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.595764:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7920 00000100:00100000:3.0:1746065198.595773:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7921 00000100:00100000:3.0:1746065198.595776:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263402752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.595780:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.595786:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 9 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.595791:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 9 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.595797:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb18200/0x14b4f8542d4fee2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d4d expref: 9 pid: 4545 timeout: 897 lvb_type: 1 00010000:00010000:3.0:1746065198.595804:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.595810:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263402752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 35us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.595827:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7921 00000100:00100000:3.0:1746065198.595844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.595852:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403008 00000100:00100000:3.0:1746065198.595854:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403008 00010000:00010000:3.0:1746065198.595861:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 16 pid: 8851 timeout: 897 lvb_type: 0 00000100:00100000:3.0:1746065198.595868:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7922 00000100:00100000:3.0:1746065198.595870:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1958:x1830881263403008:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.595874:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.595882:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 16 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.595887:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 16 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.595894:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930cdc00/0x14b4f8542d4fedad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ce4 expref: 16 pid: 8851 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.595902:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.595903:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.595904:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.595908:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.595916:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.595924:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263403008:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.595927:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7922 00010000:00010000:0.0:1746065198.595943:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.595952:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.595957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.595966:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403264 00000100:00100000:1.0:1746065198.595970:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403264 00010000:00010000:0.0:1746065198.595970:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.595977:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.595984:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 12 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.595984:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.595990:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cbb000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065198.595993:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.595997:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7923 00010000:00010000:0.0:1746065198.596001:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065198.596002:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1961:x1830881263403264:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065198.596008:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.596010:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596015:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4fee78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.596057:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263400704:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 19455us (20202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.596065:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15330 00010000:00010000:0.0:1746065198.596089:0:2462:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596094:0:2462:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596107:0:2462:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596112:0:2462:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596116:0:2462:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596120:0:2462:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c3f2800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065198.596122:0:2462:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596126:0:2462:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596134:0:2462:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.596138:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c3f2800/0x14b4f8542d4fee71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.596183:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1960:x1830881263401088:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 19749us (20372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.596188:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15329 00010000:00010000:1.0:1746065198.596972:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 12 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.596984:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 12 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.596997:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b264200/0x14b4f8542d4fedc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d00 expref: 12 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.597005:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.597007:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.597009:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.597015:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.597027:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065198.597048:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+11:1961:x1830881263403264:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1045us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.597055:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7923 00010000:00010000:3.0:1746065198.597578:0:21998:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.597585:0:21998:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.597605:0:21998:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.597610:0:21998:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.597616:0:21998:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.597624:0:21998:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800939e0a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065198.597627:0:21998:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.597632:0:21998:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.597641:0:21998:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.597646:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.597720:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263401216:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 20922us (21836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.597726:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15332 00000100:00100000:3.0:1746065198.605289:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:1958:x1830881263402496:12345-192.168.202.46@tcp:4:cat.0 Request processed in 13221us (13641us total) trans 21474841037 rc 0/0 00000100:00100000:3.0:1746065198.605301:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2614 00002000:00100000:3.0:1746065198.605313:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x382:0x0] (1290240->1826815) req@ffff880135cdc700 x1830881263402496/t21474841037(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.605322:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdc700 with x1830881263402496 ext(1290240->1826815) 00010000:00010000:3.0:1746065198.605332:0:21481:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:3.0:1746065198.605352:0:21481:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 897 lvb_type: 0 00002000:00010000:3.0:1746065198.605358:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135cdc700 00000100:00100000:0.0:1746065198.608900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.609160:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403392 00000100:00100000:1.0:1746065198.609168:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403392 00010000:00010000:1.0:1746065198.609200:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065198.609760:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7924 00000100:00100000:1.0:1746065198.609768:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881263403392:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065198.609782:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065198.609805:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.609889:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.609911:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fedc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1826815) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61cf2 expref: 15 pid: 8428 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065198.609925:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.609927:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065198.609931:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.609938:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.609958:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065198.610009:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263403392:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 241us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.610015:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7924 00010000:00010000:0.0:1746065198.610191:0:21235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.610199:0:21235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.610217:0:21235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.610224:0:21235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.610230:0:21235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.610236:0:21235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb5d200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065198.610239:0:21235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.610245:0:21235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.610255:0:21235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.610260:0:21235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5d200/0x14b4f8542d4fee7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.610311:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1960:x1830881263400960:12345-192.168.202.46@tcp:1:mirror_io.0 Request processed in 33523us (34445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.610317:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15331 00000100:00100000:0.0:1746065198.613092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.613154:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403648 00000100:00100000:2.0:1746065198.613161:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403648 00000100:00100000:2.0:1746065198.613293:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10149 00000100:00100000:2.0:1746065198.613299:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+14:32188:x1830881263403648:12345-192.168.202.46@tcp:36:mirror_io.0 00010000:00010000:2.0:1746065198.613334:0:20754:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.613353:0:20754:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1000/0x14b4f8542d4fee5c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d62 expref: 14 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.613368:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.613371:0:20754:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065198.613393:0:20754:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.613402:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 256 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.613409:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.613414:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.613419:0:20754:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.613424:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 7/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.613444:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 14 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.613453:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 14 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.613463:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260481024:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.614866:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 14 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.614877:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 14 pid: 14644 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.614887:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260481152:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.614936:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 256 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.614943:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 256 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.614950:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260481280:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.614968:0:20754:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 256 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.614974:0:20754:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 256 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.614980:0:20754:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260481408:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.614990:0:20754:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065198.616223:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260481024:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065198.617081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.617274:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263403904 00000100:00100000:1.0:1746065198.617280:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263403904 00000100:00100000:1.0:1746065198.617331:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4389 00000100:00100000:1.0:1746065198.617338:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:19663:x1830881263403904:12345-192.168.202.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065198.617513:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:19663:x1830881263403904:12345-192.168.202.46@tcp:35:ldlm_bl.0 Request processed in 174us (433us total) trans 8589944443 rc 0/0 00000100:00100000:1.0:1746065198.617519:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4389 00000100:00100000:2.0:1746065198.617915:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260481152:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.617924:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260481280:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.617931:0:20754:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20754:1830881260481408:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.617951:0:20754:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:0.0:1746065198.618195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.618262:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.618281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.618297:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404160 00000100:00100000:0.0:1746065198.618301:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404160 00010000:00010000:0.0:1746065198.618319:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 257 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.618333:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404032 00000100:00100000:0.0:1746065198.618335:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404032 00010000:00010000:0.0:1746065198.618341:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 16 pid: 14644 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.618350:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7925 00000100:00100000:0.0:1746065198.618354:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1961:x1830881263404160:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.618362:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.618366:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 257 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.618373:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 257 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.618393:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c733800/0x14b4f8542d4feb53 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b6a expref: 257 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.618407:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065198.618411:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065198.618418:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.618460:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404288 00000100:00100000:2.0:1746065198.618463:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404288 00010000:00010000:2.0:1746065198.618473:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 257 pid: 20754 timeout: 897 lvb_type: 0 00000100:00100000:2.0:1746065198.618485:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7926 00000100:00100000:2.0:1746065198.618489:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263404032:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.618495:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.618497:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 16 pid: 14644 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.618503:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 16 pid: 14644 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.618512:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f6000/0x14b4f8542d4feb5a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b71 expref: 16 pid: 14644 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.618520:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.618523:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.618527:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.618543:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263404032:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 53us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.618547:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7926 00000100:00100000:2.0:1746065198.618557:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7927 00000100:00100000:2.0:1746065198.618560:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1961:x1830881263404288:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.618565:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.618568:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 257 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.618575:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 257 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.618587:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f66b600/0x14b4f8542d4feb4c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61b63 expref: 257 pid: 20754 timeout: 897 lvb_type: 0 00010000:00010000:2.0:1746065198.618594:0:7079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.618597:0:7079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.618601:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.618613:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1961:x1830881263404288:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 52us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.618618:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7927 00000100:00100000:0.0:1746065198.619287:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:1961:x1830881263404160:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 929us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.619293:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7925 00000100:00100000:2.0:1746065198.621306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.621366:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404416 00000100:00100000:0.0:1746065198.621373:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404416 00010000:00010000:0.0:1746065198.621399:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 15 pid: 14643 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065198.621452:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7928 00000100:00100000:0.0:1746065198.621459:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263404416:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.621470:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.621475:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 15 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.621484:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 15 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.621500:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918800/0x14b4f8542d4fed1a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61c90 expref: 15 pid: 14643 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065198.621515:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065198.621519:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065198.621526:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065198.621531:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20754 initiator: MDT0 00010000:00010000:0.0:1746065198.622596:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065198.622651:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263404416:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1189us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.622659:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7928 00010000:00010000:2.0:1746065198.623167:0:20754:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.623175:0:20754:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000040:00080000:2.0:1746065198.623703:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3174, 88 off268744 00000004:00080000:2.0:1746065198.623711:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797914894935ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.623783:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3191, 88 off270424 00000004:00080000:2.0:1746065198.623788:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 797914972461ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065198.623800:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3192, 88 off270512 00000004:00080000:2.0:1746065198.623802:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 797914987184ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065198.623810:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3175, 88 off268832 00000004:00080000:2.0:1746065198.623812:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797914996501ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.624291:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3176, 88 off268920 00000004:00080000:2.0:1746065198.624296:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797915480881ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.624304:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3193, 88 off270600 00000004:00080000:2.0:1746065198.624307:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 797915491506ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065198.624327:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3194, 88 off270688 00000004:00080000:2.0:1746065198.624330:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 797915514628ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065198.624336:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3195, 88 off270776 00000004:00080000:2.0:1746065198.624338:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 797915522734ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065198.624344:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3177, 88 off269008 00000004:00080000:2.0:1746065198.624347:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797915531304ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.624352:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3196, 88 off270864 00000004:00080000:2.0:1746065198.624355:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 797915539429ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065198.624496:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3178, 88 off269096 00000004:00080000:2.0:1746065198.624499:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797915684036ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.624506:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3197, 88 off270952 00000004:00080000:2.0:1746065198.624509:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 797915693459ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065198.624514:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3179, 88 off269184 00000004:00080000:2.0:1746065198.624516:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797915701219ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.624522:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3180, 88 off269272 00000004:00080000:2.0:1746065198.624524:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797915708589ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.624530:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3181, 88 off269360 00000004:00080000:2.0:1746065198.624532:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797915716951ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.624538:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3182, 88 off269448 00000004:00080000:2.0:1746065198.624540:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797915724853ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065198.624546:0:20754:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3198, 88 off271040 00000004:00080000:2.0:1746065198.624548:0:20754:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 797915732821ns, next at 737095943431ns, rc = 0 00000001:00080000:1.0:1746065198.650926:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944441 is committed 00000001:00080000:1.0:1746065198.650938:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944439 is committed 00000001:00080000:1.0:1746065198.650944:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944435 is committed 00000001:00080000:1.0:1746065198.650954:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944443 is committed 00000001:00080000:1.0:1746065198.650959:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944438 is committed 00000001:00080000:1.0:1746065198.650977:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944444 is committed 00000004:00080000:1.0:1746065198.650981:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2478 committed 00000004:00080000:1.0:1746065198.650989:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2462 committed 00000004:00080000:1.0:1746065198.650993:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2461 committed 00000004:00080000:1.0:1746065198.650994:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2460 committed 00000004:00080000:1.0:1746065198.650996:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2459 committed 00000004:00080000:1.0:1746065198.650997:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2477 committed 00000004:00080000:1.0:1746065198.650998:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2458 committed 00000004:00080000:1.0:1746065198.650999:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2476 committed 00000004:00080000:1.0:1746065198.651001:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2457 committed 00000004:00080000:1.0:1746065198.651002:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2475 committed 00000004:00080000:1.0:1746065198.651003:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2474 committed 00000004:00080000:1.0:1746065198.651004:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2473 committed 00000004:00080000:1.0:1746065198.651005:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2456 committed 00000004:00080000:1.0:1746065198.651007:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2455 committed 00000004:00080000:1.0:1746065198.651009:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2472 committed 00000004:00080000:1.0:1746065198.651011:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2471 committed 00000004:00080000:1.0:1746065198.651012:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2454 committed 00000001:00080000:1.0:1746065198.651022:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944440 is committed 00000100:00100000:1.0:1746065198.651215:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260481536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.651264:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.651295:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260482048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.651308:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.651317:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260482560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.651331:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.651341:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260483072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.651351:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.651364:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746065198.651368:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260481920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.651377:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.651386:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260482432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.651396:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.651404:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260482944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.651414:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.651423:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260483456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.651434:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.651457:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260481536 00000100:00100000:1.0:1746065198.651462:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260481536 00000100:00100000:1.0:1746065198.651496:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260482048 00000100:00100000:1.0:1746065198.651498:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260482048 00000100:00100000:1.0:1746065198.651507:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260482560 00000100:00100000:1.0:1746065198.651509:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260482560 00000100:00100000:1.0:1746065198.651520:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260483072 00000100:00100000:1.0:1746065198.651521:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260483072 00000100:00100000:1.0:1746065198.651528:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260481920 00000100:00100000:1.0:1746065198.651530:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260481920 00000100:00100000:1.0:1746065198.651536:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260482432 00000100:00100000:1.0:1746065198.651537:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260482432 00000100:00100000:1.0:1746065198.651558:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260482944 00000100:00100000:1.0:1746065198.651560:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260482944 00000100:00100000:1.0:1746065198.651566:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260483456 00000100:00100000:1.0:1746065198.651567:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260483456 00000100:00100000:1.0:1746065198.651575:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15333 00000100:00100000:1.0:1746065198.651581:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3296:x1830881260481536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.651752:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3296:x1830881260481536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (487us total) trans 17179873747 rc 0/0 00000100:00100000:1.0:1746065198.651758:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15333 00000100:00100000:1.0:1746065198.651771:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15334 00000100:00100000:1.0:1746065198.651775:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3296:x1830881260482048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065198.651867:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065198.651870:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.651872:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.651874:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.651875:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065198.651894:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3296:x1830881260482048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (584us total) trans 17179873748 rc 0/0 00000100:00100000:1.0:1746065198.651899:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15334 00000100:00100000:1.0:1746065198.651910:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15335 00000100:00100000:1.0:1746065198.651919:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3296:x1830881260482560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.652050:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260481664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.652069:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.652081:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260482176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.652096:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.652102:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260482688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.652112:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.652117:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260483200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.652126:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.652133:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746065198.652136:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260481792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.652145:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.652150:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260482304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.652158:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.652163:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260482816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.652171:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.652176:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260483328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.652184:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.652198:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260481664 00000100:00100000:3.0:1746065198.652200:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260481664 00000100:00100000:3.0:1746065198.652210:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260482176 00000100:00100000:3.0:1746065198.652211:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260482176 00000100:00100000:3.0:1746065198.652215:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260482688 00000100:00100000:3.0:1746065198.652216:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260482688 00000100:00100000:3.0:1746065198.652220:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260483200 00000100:00100000:3.0:1746065198.652222:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260483200 00000100:00100000:3.0:1746065198.652226:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260481792 00000100:00100000:3.0:1746065198.652227:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260481792 00000100:00100000:3.0:1746065198.652231:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260482304 00000100:00100000:3.0:1746065198.652232:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260482304 00000100:00100000:3.0:1746065198.652236:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260482816 00000100:00100000:3.0:1746065198.652237:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260482816 00000100:00100000:3.0:1746065198.652242:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260483328 00000100:00100000:3.0:1746065198.652243:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260483328 00000100:00100000:3.0:1746065198.652250:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15336 00000100:00100000:3.0:1746065198.652253:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3296:x1830881260483072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.652344:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830881260483072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (991us total) trans 21474841038 rc 0/0 00000100:00100000:3.0:1746065198.652349:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15336 00000100:00100000:3.0:1746065198.652359:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15337 00000100:00100000:3.0:1746065198.652363:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881260481920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065198.652433:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065198.652435:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065198.652437:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:3.0:1746065198.652439:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:3.0:1746065198.652440:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065198.652464:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881260481920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (1085us total) trans 17179873749 rc 0/0 00000100:00100000:3.0:1746065198.652469:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15337 00000100:00100000:3.0:1746065198.652479:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15338 00000100:00100000:2.0:1746065198.652482:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15339 00000100:00100000:3.0:1746065198.652483:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3296:x1830881260482432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065198.652489:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3296:x1830881260482944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065198.652548:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065198.652550:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065198.652552:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1746065198.652554:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3296:x1830881260482432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1156us total) trans 17179873750 rc 0/0 00002000:00010000:2.0:1746065198.652554:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065198.652555:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065198.652559:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15338 00000100:00100000:3.0:1746065198.652568:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15340 00000100:00100000:3.0:1746065198.652571:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830881260483456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065198.652571:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3296:x1830881260482944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1156us total) trans 21474841039 rc 0/0 00000100:00100000:2.0:1746065198.652576:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15339 00000100:00100000:2.0:1746065198.652583:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15341 00000100:00100000:2.0:1746065198.652586:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881260481664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.652640:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830881260483456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1205us total) trans 21474841040 rc 0/0 00000100:00100000:3.0:1746065198.652645:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15340 00000100:00100000:2.0:1746065198.652652:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260481664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (583us total) trans 17179873751 rc 0/0 00000100:00100000:3.0:1746065198.652653:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15342 00000100:00100000:2.0:1746065198.652657:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15341 00000100:00100000:3.0:1746065198.652658:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260482176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065198.652678:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15343 00000100:00100000:2.0:1746065198.652683:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830881260482688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.652738:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260482176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (640us total) trans 17179873752 rc 0/0 00000100:00100000:3.0:1746065198.652743:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15342 00000100:00100000:2.0:1746065198.652745:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260482688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (632us total) trans 21474841041 rc 0/0 00000100:00100000:2.0:1746065198.652749:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15343 00000100:00100000:3.0:1746065198.652751:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15344 00000100:00100000:3.0:1746065198.652756:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3297:x1830881260483200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065198.652756:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15345 00000100:00100000:2.0:1746065198.652760:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881260481792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.652837:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260483200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (709us total) trans 21474841042 rc 0/0 00000100:00100000:2.0:1746065198.652837:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260481792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (689us total) trans 17179873753 rc 0/0 00000100:00100000:3.0:1746065198.652842:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15344 00000100:00100000:2.0:1746065198.652851:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15345 00000100:00100000:2.0:1746065198.652865:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15346 00000100:00100000:2.0:1746065198.652869:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3297:x1830881260482304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065198.652941:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3297:x1830881260482304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (781us total) trans 17179873754 rc 0/0 00000100:00100000:2.0:1746065198.652945:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15346 00000100:00100000:2.0:1746065198.652953:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15347 00000100:00100000:2.0:1746065198.652956:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260482816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065198.653026:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881260482816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (853us total) trans 21474841043 rc 0/0 00000100:00100000:2.0:1746065198.653030:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15347 00000100:00100000:2.0:1746065198.653038:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15348 00000100:00100000:2.0:1746065198.653042:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3297:x1830881260483328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065198.653096:0:4544:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065198.653099:0:4544:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065198.653100:0:4544:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065198.653102:0:4544:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065198.653103:0:4544:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746065198.653119:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3297:x1830881260483328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (934us total) trans 21474841044 rc 0/0 00000100:00100000:2.0:1746065198.653124:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15348 00000004:00010000:2.0:1746065198.653166:0:20754:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a4e8380 reply state ffff8800940bd400 transno 8589944444 ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20754 initiator: MDT0 00000100:00100000:2.0:1746065198.653175:0:20754:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746065198.653227:0:20754:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746065198.653236:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32188:x1830881263403648:12345-192.168.202.46@tcp:36:mirror_io.0 Request processed in 39936us (40151us total) trans 8589944444 rc 0/0 00000100:00100000:2.0:1746065198.653241:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10149 00010000:00010000:2.0:1746065198.653338:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.653346:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.653352:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.653356:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800939e1800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065198.653360:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.653365:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.653377:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.653379:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065198.653382:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00010000:00010000:2.0:1746065198.653386:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e1800/0x14b4f8542d4fee8d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20754 initiator: MDT0 00000100:00100000:1.0:1746065198.653550:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3296:x1830881260482560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1635us (2217us total) trans 21474841045 rc 0/0 00000100:00100000:1.0:1746065198.653555:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15335 00000100:00080000:1.0:1746065198.653678:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065198.653681:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746065198.653737:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9eaa00/2, rc 0, transno 17179873749 00000100:00100000:1.0:1746065198.653742:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260481920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065198.653748:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9eb800/2, rc 0, transno 17179873750 00000100:00100000:1.0:1746065198.653750:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260482432:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065198.653759:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9e9180/2, rc 0, transno 21474841039 00000100:00100000:1.0:1746065198.653763:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260482944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065198.653768:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fcac700/2, rc 0, transno 21474841040 00000100:00100000:1.0:1746065198.653770:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260483456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065198.653776:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9e8700/2, rc 0, transno 17179873747 00000100:00100000:1.0:1746065198.653778:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260481536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065198.653782:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9ea300/2, rc 0, transno 17179873748 00000100:00100000:1.0:1746065198.653784:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260482048:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065198.653788:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9e8000/2, rc 0, transno 21474841045 00000100:00100000:1.0:1746065198.653790:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260482560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065198.653794:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9eb100/2, rc 0, transno 21474841038 00000100:00100000:1.0:1746065198.653796:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260483072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.653839:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065198.653845:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260483584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.653860:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.653888:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260483584 00000100:00100000:1.0:1746065198.653891:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260483584 00000100:00100000:1.0:1746065198.653903:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15349 00000100:00100000:1.0:1746065198.653907:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881260483584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.653975:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009380f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3295:x1830881260483584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (114us total) trans 21474841046 rc 0/0 00000100:00100000:1.0:1746065198.653980:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15349 00000004:00080000:1.0:1746065198.653994:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009380e680/2, rc 0, transno 21474841046 00000100:00100000:1.0:1746065198.653997:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260483584:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065198.654062:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9ea680/2, rc 0, transno 17179873753 00000100:00100000:3.0:1746065198.654065:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260481792:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065198.654071:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9e9880/2, rc 0, transno 17179873754 00000100:00100000:3.0:1746065198.654073:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260482304:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065198.654081:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9e9f80/2, rc 0, transno 21474841043 00000100:00100000:3.0:1746065198.654083:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260482816:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065198.654088:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9ead80/2, rc 0, transno 21474841044 00000100:00100000:3.0:1746065198.654090:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260483328:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065198.654096:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9ebb80/2, rc 0, transno 17179873751 00000100:00100000:3.0:1746065198.654099:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260481664:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065198.654104:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9e9500/2, rc 0, transno 17179873752 00000100:00100000:3.0:1746065198.654107:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260482176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065198.654112:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9e8380/2, rc 0, transno 21474841041 00000100:00100000:3.0:1746065198.654114:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260482688:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065198.654119:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9e8e00/2, rc 0, transno 21474841042 00000100:00100000:3.0:1746065198.654121:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260483200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.657749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.662721:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404544 00000100:00100000:2.0:1746065198.662734:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404544 00000100:00100000:2.0:1746065198.667746:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10150 00000100:00100000:2.0:1746065198.668498:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32188:x1830881263404544:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.668519:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.668536:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d69 expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.668584:0:20754:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.668601:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.668616:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.668618:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065198.668622:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939e0a00, rc 0) 00000100:00100000:2.0:1746065198.668683:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32188:x1830881263404544:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 195us (10942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.668689:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10150 00000100:00100000:0.0:1746065198.674438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.674722:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404672 00000100:00100000:2.0:1746065198.674729:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404672 00000100:00100000:2.0:1746065198.675848:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 799 00000100:00100000:2.0:1746065198.675858:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32188:x1830881263404672:12345-192.168.202.46@tcp:103:mirror_io.0 00010000:00010000:2.0:1746065198.675873:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.675894:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0e00/0x14b4f8542d4fee4e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d5b expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.675922:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.675925:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.676536:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32188:x1830881263404672:12345-192.168.202.46@tcp:103:mirror_io.0 Request processed in 567us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.676543:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 799 00000100:00100000:0.0:1746065198.679569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.679629:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263404928 00000100:00100000:3.0:1746065198.679637:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263404928 00000100:00100000:3.0:1746065198.679694:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4390 00000100:00100000:3.0:1746065198.679701:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32188:x1830881263404928:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065198.679964:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32188:x1830881263404928:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 263us (402us total) trans 8589944445 rc 0/0 00000100:00100000:3.0:1746065198.679970:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4390 00000100:00100000:0.0:1746065198.681456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.681504:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405184 00000100:00100000:3.0:1746065198.681510:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405184 00000100:00100000:3.0:1746065198.681966:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4391 00000100:00100000:3.0:1746065198.681973:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32188:x1830881263405184:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065198.682110:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32188:x1830881263405184:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 138us (658us total) trans 8589944446 rc 0/0 00000100:00100000:3.0:1746065198.682116:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4391 00000100:00100000:0.0:1746065198.703422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.703512:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.703690:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405696 00000100:00100000:1.0:1746065198.703699:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405696 00000100:00100000:1.0:1746065198.703735:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405440 00000100:00100000:1.0:1746065198.703737:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405440 00000100:00100000:1.0:1746065198.703754:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10151 00000100:00100000:1.0:1746065198.703760:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+6:32198:x1830881263405696:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065198.703783:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.703798:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d000/0x14b4f8542d4fee9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d77 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.703905:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.703916:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.703924:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.703933:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.703937:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.703941:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704016:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704021:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704029:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065198.704036:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065198.704096:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704100:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704105:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704109:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013548d200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065198.704112:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704116:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704124:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065198.704126:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065198.704129:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704133:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d200/0x14b4f8542d4feea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704157:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704161:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704168:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704171:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013548d400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065198.704173:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704176:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704180:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205e00) 00010000:00010000:1.0:1746065198.704182:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065198.704184:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704187:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d400/0x14b4f8542d4feea9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704213:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d000/0x14b4f8542d4fee9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.704221:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.704226:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065198.704227:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065198.704229:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548d600, rc 0) 00000100:00100000:1.0:1746065198.704262:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:32198:x1830881263405696:12345-192.168.202.46@tcp:101:cat.0 Request processed in 502us (848us total) trans 8589944447 rc 0/0 00000100:00100000:1.0:1746065198.704267:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10151 00000100:00100000:1.0:1746065198.704279:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10152 00000100:00100000:1.0:1746065198.704284:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:32194:x1830881263405440:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065198.704290:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.704295:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548cc00/0x14b4f8542d4feebe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d70 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.704325:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704331:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704336:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704343:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704347:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704351:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704395:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704401:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.704406:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065198.704411:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065198.706936:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.706947:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.706953:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.706957:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013548d800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065198.706960:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.706966:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.706978:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065198.706981:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065198.706984:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.706987:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d800/0x14b4f8542d4feec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.706998:0:14643:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.707002:0:14643:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.707006:0:14643:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.707010:0:14643:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013548da00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065198.707011:0:14643:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.707016:0:14643:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.707021:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:1.0:1746065198.707022:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065198.707024:0:14643:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.707027:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548da00/0x14b4f8542d4feecc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.707069:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548cc00/0x14b4f8542d4feebe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 250 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.707079:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.707084:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065198.707086:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065198.707088:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548dc00, rc 0) 00000100:00100000:1.0:1746065198.707141:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32194:x1830881263405440:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2855us (3627us total) trans 8589944448 rc 0/0 00000100:00100000:1.0:1746065198.707147:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10152 00000100:00100000:0.0:1746065198.708295:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.708329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.708355:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.708368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.708379:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.708390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.708411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.708429:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263405824 00000100:00100000:0.0:1746065198.708435:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263405824 00000100:00100000:0.0:1746065198.708462:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406208 00000100:00100000:0.0:1746065198.708465:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406208 00000100:00100000:0.0:1746065198.708475:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406336 00000100:00100000:0.0:1746065198.708477:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406336 00000100:00100000:0.0:1746065198.708484:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406464 00000100:00100000:0.0:1746065198.708486:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406464 00000100:00100000:0.0:1746065198.708494:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406592 00000100:00100000:0.0:1746065198.708495:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406592 00000100:00100000:0.0:1746065198.708502:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406720 00000100:00100000:0.0:1746065198.708504:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406720 00000100:00100000:0.0:1746065198.708514:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15350 00000100:00100000:0.0:1746065198.708519:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263405824:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.708532:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.708545:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d7e expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.708562:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d72e, atime: 0x6812d72b, ctime: 0x6812d72e, blocks: 0x7b1 00010000:00010000:0.0:1746065198.708576:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708577:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708584:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708595:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708603:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5c600, rc 0) 00000100:00100000:0.0:1746065198.708628:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263405824:12345-192.168.202.46@tcp:101:cat.0 Request processed in 109us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.708633:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15350 00000100:00100000:0.0:1746065198.708650:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15351 00000100:00100000:0.0:1746065198.708654:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263406208:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.708660:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.708679:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d8c expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.708692:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d72e, atime: 0x6812d72b, ctime: 0x6812d72e, blocks: 0x821 00010000:00010000:0.0:1746065198.708699:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708700:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708704:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708712:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708719:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5dc00, rc 0) 00000100:00100000:0.0:1746065198.708733:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263406208:12345-192.168.202.46@tcp:101:cat.0 Request processed in 78us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.708738:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15351 00000100:00100000:0.0:1746065198.708748:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15352 00000100:00100000:0.0:1746065198.708752:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263406336:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.708757:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.708764:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d93 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.708772:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d72e, atime: 0x6812d72e, ctime: 0x6812d72e, blocks: 0x821 00010000:00010000:0.0:1746065198.708782:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708783:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708786:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708794:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708800:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5d800, rc 0) 00000100:00100000:0.0:1746065198.708836:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263406336:12345-192.168.202.46@tcp:101:cat.0 Request processed in 61us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.708840:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15352 00000100:00100000:0.0:1746065198.708851:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15353 00000100:00100000:0.0:1746065198.708855:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263406464:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.708860:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.708866:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d9a expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.708876:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d72f, atime: 0x6812d72b, ctime: 0x6812d72f, blocks: 0x821 00010000:00010000:0.0:1746065198.708882:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708883:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708886:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708895:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708905:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5ce00, rc 0) 00000100:00100000:0.0:1746065198.708917:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263406464:12345-192.168.202.46@tcp:101:cat.0 Request processed in 62us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.708921:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15353 00000100:00100000:0.0:1746065198.708931:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15354 00000100:00100000:0.0:1746065198.708934:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263406592:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.708940:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.708946:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61da1 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.708954:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d72f, atime: 0x6812d72f, ctime: 0x6812d72f, blocks: 0x1689 00010000:00010000:0.0:1746065198.708960:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708961:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.708965:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708972:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.708979:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5ca00, rc 0) 00000100:00100000:0.0:1746065198.708992:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263406592:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.708996:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15354 00000100:00100000:0.0:1746065198.709005:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15355 00000100:00100000:0.0:1746065198.709008:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263406720:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.709014:0:8851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.709020:0:8851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61da8 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.709029:0:8851:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d72f, atime: 0x6812d72d, ctime: 0x6812d72f, blocks: 0x1029 00010000:00010000:0.0:1746065198.709034:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.709036:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.709039:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.709046:0:8851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.709052:0:8851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5d400, rc 0) 00000100:00100000:0.0:1746065198.709064:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263406720:12345-192.168.202.46@tcp:101:cat.0 Request processed in 55us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.709069:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15355 00000100:00100000:1.0:1746065198.709330:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406080 00000100:00100000:1.0:1746065198.709335:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406080 00000100:00100000:1.0:1746065198.709359:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10153 00000100:00100000:1.0:1746065198.709364:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:32195:x1830881263406080:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065198.709375:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.709384:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548de00/0x14b4f8542d4fef0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61d85 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.709447:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.709456:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.709462:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 248 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.709467:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.709487:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 248 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.709496:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 248 pid: 14643 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065198.709504:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260483712:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065198.709551:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.709557:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 9 pid: 14643 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065198.709562:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d3b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260483840:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065198.709573:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.712981:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260483712:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065198.712992:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d3b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260483840:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065198.713008:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065198.714994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.715809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.716098:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406976 00000100:00100000:1.0:1746065198.716105:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406976 00000100:00100000:1.0:1746065198.716141:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10154 00000100:00100000:1.0:1746065198.716148:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+10:32198:x1830881263406976:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065198.716165:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.716180:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61daf expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.716227:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.716239:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.716256:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065198.716259:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065198.716261:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548c000, rc 0) 00000100:00100000:2.0:1746065198.716685:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263406848 00000100:00100000:2.0:1746065198.716689:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263406848 00010000:00010000:2.0:1746065198.716706:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 12 pid: 14643 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065198.717301:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:32198:x1830881263406976:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1151us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.717308:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10154 00000100:00100000:0.0:1746065198.717419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.717955:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407104 00000100:00100000:2.0:1746065198.717960:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407104 00010000:00010000:2.0:1746065198.717978:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 249 pid: 14643 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065198.717999:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7929 00000100:00100000:2.0:1746065198.718006:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+11:1960:x1830881263406848:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.718014:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.718019:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 11 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.718027:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 11 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.718043:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548d600/0x14b4f8542d4feeb0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d77 expref: 11 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.718057:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.718061:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.718067:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.718071:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.718095:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:1960:x1830881263406848:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 90us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.718101:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7929 00000100:00100000:2.0:1746065198.718112:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7930 00000100:00100000:2.0:1746065198.718117:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:1961:x1830881263407104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.718122:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.718126:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 249 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.718134:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 249 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.718144:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548dc00/0x14b4f8542d4feed3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d70 expref: 249 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.718151:0:7078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.718154:0:7078:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.718160:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.718164:0:7078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.718180:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.718194:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:1961:x1830881263407104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 77us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.718198:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7930 00010000:00010000:1.0:1746065198.718270:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.718277:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14643 initiator: MDT0 00000004:00200000:1.0:1746065198.718292:0:14643:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065198.718400:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548de00/0x14b4f8542d4fef0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 11 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.718415:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 10 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.718421:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065198.718423:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065198.718424:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548c800, rc 0) 00000100:00100000:1.0:1746065198.718444:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+10:32195:x1830881263406080:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9080us (10154us total) trans 8589944449 rc 0/0 00000100:00100000:1.0:1746065198.718449:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10153 00000100:00100000:0.0:1746065198.738353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.738374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.738386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.738412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.738433:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407488 00000100:00100000:0.0:1746065198.738441:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407488 00002000:00100000:0.0:1746065198.738490:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009ba1d880 x1830881263407488/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.738500:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d880 with x1830881263407488 ext(0->1048575) 00002000:00010000:0.0:1746065198.738505:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1d880 00000100:00100000:0.0:1746065198.738519:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407744 00000100:00100000:0.0:1746065198.738522:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407744 00002000:00100000:0.0:1746065198.738533:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009ba1f800 x1830881263407744/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.738539:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f800 with x1830881263407744 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.738541:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1f800 00000100:00100000:0.0:1746065198.738548:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263407872 00000100:00100000:0.0:1746065198.738549:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263407872 00002000:00100000:0.0:1746065198.738556:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009ba1d500 x1830881263407872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.738562:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d500 with x1830881263407872 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.738564:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d500 00000100:00100000:0.0:1746065198.738570:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408128 00000100:00100000:0.0:1746065198.738572:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408128 00002000:00100000:0.0:1746065198.738579:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012d134e00 x1830881263408128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.738584:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134e00 with x1830881263408128 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.738586:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d134e00 00000100:00100000:0.0:1746065198.738605:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8648 00000100:00100000:0.0:1746065198.738611:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881263407488:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.740721:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8649 00000100:00100000:0.0:1746065198.740732:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881263407744:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.742340:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8650 00000100:00100000:0.0:1746065198.742350:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881263407872:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065198.748470:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8651 00000100:00100000:2.0:1746065198.748491:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881263408128:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.777418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.777510:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408384 00000100:00100000:0.0:1746065198.777518:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408384 00000100:00100000:0.0:1746065198.777554:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10155 00000100:00100000:0.0:1746065198.777561:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:32201:x1830881263408384:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.777582:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.777596:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61db6 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.777685:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777695:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777703:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777711:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777716:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777720:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777795:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe600/0x14b4f8542d4fef3c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777801:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe600/0x14b4f8542d4fef3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777806:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe600/0x14b4f8542d4fef3c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065198.777830:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065198.777886:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777891:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777896:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777900:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129cbea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065198.777903:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777907:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777915:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065198.777917:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065198.777920:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777923:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbea00/0x14b4f8542d4fef2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777936:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777943:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777947:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777950:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129cbe800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065198.777951:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777955:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777959:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880129d38f00) 00010000:00010000:0.0:1746065198.777960:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065198.777962:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777965:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.777989:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61db6 expref: 251 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.777998:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe600/0x14b4f8542d4fef3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61db6 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.778002:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065198.778004:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065198.778006:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cbe600, rc 0) 00000100:00100000:0.0:1746065198.778037:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32201:x1830881263408384:12345-192.168.202.46@tcp:101:cat.0 Request processed in 477us (627us total) trans 8589944450 rc 0/0 00000100:00100000:0.0:1746065198.778042:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10155 00000100:00100000:0.0:1746065198.779091:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881263407488:12345-192.168.202.46@tcp:3:cat.0 Request processed in 40477us (40746us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.779099:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8648 00002000:00100000:0.0:1746065198.779106:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009ba1d880 x1830881263407488/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.779114:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d880 with x1830881263407488 ext(0->1048575) 00002000:00010000:0.0:1746065198.779118:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1d880 00000100:00100000:1.0:1746065198.779370:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881263407744:12345-192.168.202.46@tcp:3:cat.0 Request processed in 38640us (40994us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065198.779376:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8649 00002000:00100000:1.0:1746065198.779380:0:21483:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009ba1f800 x1830881263407744/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.779386:0:21483:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1f800 with x1830881263407744 ext(1048576->2097151) 00002000:00010000:1.0:1746065198.779389:0:21483:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1f800 00000100:00100000:2.0:1746065198.787103:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263407872:12345-192.168.202.46@tcp:3:cat.0 Request processed in 44746us (48706us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065198.787115:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8650 00002000:00100000:2.0:1746065198.787125:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009ba1d500 x1830881263407872/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.787133:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d500 with x1830881263407872 ext(1048576->2097151) 00002000:00010000:2.0:1746065198.787138:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1d500 00000100:00100000:2.0:1746065198.801529:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263408128:12345-192.168.202.46@tcp:3:cat.0 Request processed in 53035us (63103us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065198.801542:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8651 00002000:00100000:2.0:1746065198.801555:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88012d134e00 x1830881263408128/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.801564:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d134e00 with x1830881263408128 ext(1048576->2097151) 00002000:00010000:2.0:1746065198.801569:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d134e00 00000100:00100000:1.0:1746065198.801860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.801901:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.801968:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408512 00000100:00100000:3.0:1746065198.801975:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408512 00000100:00100000:3.0:1746065198.802006:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408640 00000100:00100000:3.0:1746065198.802008:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408640 00000100:00100000:3.0:1746065198.802022:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15356 00000100:00100000:3.0:1746065198.802028:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1958:x1830881263408512:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.802041:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.802055:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61dbd expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.802076:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.802078:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.802084:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.802098:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 19 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.802107:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc4be00, rc 0) 00000100:00100000:3.0:1746065198.802141:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1958:x1830881263408512:12345-192.168.202.46@tcp:101:cat.0 Request processed in 113us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.802146:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15356 00000100:00100000:3.0:1746065198.802156:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15357 00000100:00100000:3.0:1746065198.802160:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+30:1958:x1830881263408640:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065198.802167:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.802174:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61dc4 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.802184:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.802186:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065198.802189:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.802197:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 31 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065198.802203:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc4a000, rc 0) 00000100:00100000:3.0:1746065198.802217:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263408640:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.802221:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15357 00000100:00100000:0.0:1746065198.808191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.808231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.808259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.808280:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408768 00000100:00100000:0.0:1746065198.808288:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408768 00000100:00100000:0.0:1746065198.808334:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263408896 00000100:00100000:0.0:1746065198.808337:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263408896 00000100:00100000:0.0:1746065198.808349:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409024 00000100:00100000:0.0:1746065198.808350:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409024 00000100:00100000:0.0:1746065198.808362:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15358 00000100:00100000:0.0:1746065198.808368:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+31:1958:x1830881263408768:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.808385:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.808399:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61dcb expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.808417:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.808419:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.808427:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 32 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.808446:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 32 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.808455:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cbee00, rc 0) 00000100:00100000:0.0:1746065198.808493:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263408768:12345-192.168.202.46@tcp:101:cat.0 Request processed in 125us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.808498:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15358 00000100:00100000:0.0:1746065198.808525:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15359 00000100:00100000:0.0:1746065198.808530:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263408896:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.808537:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.808545:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61dd2 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.808555:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.808556:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.808560:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.808570:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.808576:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cbec00, rc 0) 00000100:00100000:0.0:1746065198.808591:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263408896:12345-192.168.202.46@tcp:101:cat.0 Request processed in 61us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.808595:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15359 00000100:00100000:0.0:1746065198.808607:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15360 00000100:00100000:0.0:1746065198.808611:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263409024:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.808616:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.808622:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61dd9 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.808631:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.808632:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.808635:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.808643:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.808649:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cbe800, rc 0) 00000100:00100000:0.0:1746065198.808674:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263409024:12345-192.168.202.46@tcp:101:cat.0 Request processed in 51us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.808680:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15360 00000100:00100000:0.0:1746065198.808723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.808736:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409152 00000100:00100000:0.0:1746065198.808738:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409152 00000100:00100000:0.0:1746065198.808751:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15361 00000100:00100000:0.0:1746065198.808755:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+32:1958:x1830881263409152:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065198.808760:0:2463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.808766:0:2463:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61de0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.808779:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.808780:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.808784:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 33 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.808792:0:2463:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 33 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.808798:0:2463:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cbe400, rc 0) 00000100:00100000:0.0:1746065198.808812:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1958:x1830881263409152:12345-192.168.202.46@tcp:101:cat.0 Request processed in 57us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.808841:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15361 00000100:00100000:0.0:1746065198.829297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.829328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.829348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.829366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.829387:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.829405:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409408 00000100:00100000:0.0:1746065198.829412:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409408 00002000:00100000:0.0:1746065198.829446:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094a95c00 x1830881263409408/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.829454:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95c00 with x1830881263409408 ext(2097152->3145727) 00002000:00010000:0.0:1746065198.829458:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a95c00 00000100:00100000:0.0:1746065198.829470:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409664 00000100:00100000:0.0:1746065198.829472:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409664 00002000:00100000:0.0:1746065198.829478:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094a94a80 x1830881263409664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.829484:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94a80 with x1830881263409664 ext(3145728->4194303) 00002000:00010000:0.0:1746065198.829486:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a94a80 00000100:00100000:0.0:1746065198.829492:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263409920 00000100:00100000:0.0:1746065198.829493:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263409920 00002000:00100000:0.0:1746065198.829501:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a95880 x1830881263409920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.829507:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95880 with x1830881263409920 ext(2097152->3145727) 00002000:00010000:0.0:1746065198.829509:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a95880 00000100:00100000:0.0:1746065198.829516:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410176 00000100:00100000:0.0:1746065198.829517:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410176 00002000:00100000:0.0:1746065198.829522:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a95f80 x1830881263410176/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.829527:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95f80 with x1830881263410176 ext(3145728->4194303) 00002000:00010000:0.0:1746065198.829529:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a95f80 00000100:00100000:0.0:1746065198.829534:0:350:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410432 00000100:00100000:0.0:1746065198.829536:0:350:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410432 00002000:00100000:0.0:1746065198.829542:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880094a97800 x1830881263410432/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.829547:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a97800 with x1830881263410432 ext(0->1048575) 00002000:00010000:0.0:1746065198.829550:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a97800 00000100:00100000:0.0:1746065198.829557:0:350:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8652 00000100:00100000:0.0:1746065198.829562:0:350:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881263409408:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.830533:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8653 00000100:00100000:0.0:1746065198.830540:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881263409664:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.831469:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8654 00000100:00100000:0.0:1746065198.831474:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881263409920:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065198.832862:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8655 00000100:00100000:3.0:1746065198.832870:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881263410176:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065198.833762:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8656 00000100:00100000:3.0:1746065198.833768:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263410432:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065198.838078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.838112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.838131:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410944 00000100:00100000:1.0:1746065198.838131:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263410688 00000100:00100000:2.0:1746065198.838139:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410944 00000100:00100000:1.0:1746065198.838139:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263410688 00002000:00100000:1.0:1746065198.838173:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008ec2f480 x1830881263410688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.838174:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2c380 x1830881263410944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.838182:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c380 with x1830881263410944 ext(1048576->2097151) 00002000:00100000:1.0:1746065198.838182:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f480 with x1830881263410688 ext(1048576->2097151) 00002000:00010000:2.0:1746065198.838187:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2c380 00002000:00010000:1.0:1746065198.838187:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2f480 00000100:00100000:2.0:1746065198.838212:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8657 00000100:00100000:1.0:1746065198.838216:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8658 00000100:00100000:2.0:1746065198.838218:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263410944:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065198.838221:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263410688:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065198.839850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.839903:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411200 00000100:00100000:1.0:1746065198.839907:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411200 00002000:00100000:1.0:1746065198.839933:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880129b0c000 x1830881263411200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.839941:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c000 with x1830881263411200 ext(1048576->2097151) 00002000:00010000:1.0:1746065198.839945:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0c000 00000100:00100000:1.0:1746065198.839959:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8659 00000100:00100000:1.0:1746065198.839965:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263411200:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065198.868762:0:350:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:26bbd020-9fba-464a-bebc-8395a287959e+19:1959:x1830881263409408:12345-192.168.202.46@tcp:3:cat.0 Request processed in 39190us (39462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065198.868772:0:350:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8652 00002000:00100000:2.0:1746065198.868782:0:350:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880094a95c00 x1830881263409408/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.868791:0:350:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95c00 with x1830881263409408 ext(2097152->3145727) 00002000:00010000:2.0:1746065198.868796:0:350:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a95c00 00000100:00100000:2.0:1746065198.878389:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263409664:12345-192.168.202.46@tcp:3:cat.0 Request processed in 47841us (49051us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065198.878401:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8653 00002000:00100000:2.0:1746065198.878411:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff880094a94a80 x1830881263409664/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065198.878419:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a94a80 with x1830881263409664 ext(3145728->4194303) 00002000:00010000:2.0:1746065198.878424:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a94a80 00000100:00100000:1.0:1746065198.889036:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+16:1959:x1830881263409920:12345-192.168.202.46@tcp:3:cat.0 Request processed in 57552us (59677us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065198.889047:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8654 00002000:00100000:1.0:1746065198.889058:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff880094a95880 x1830881263409920/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065198.889066:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95880 with x1830881263409920 ext(2097152->3145727) 00002000:00010000:1.0:1746065198.889071:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a95880 00000100:00100000:3.0:1746065198.892014:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1959:x1830881263410176:12345-192.168.202.46@tcp:3:cat.0 Request processed in 59136us (62637us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.892025:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8655 00002000:00100000:3.0:1746065198.892035:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff880094a95f80 x1830881263410176/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.892048:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95f80 with x1830881263410176 ext(3145728->4194303) 00002000:00010000:3.0:1746065198.892052:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a95f80 00000100:00100000:0.0:1746065198.902264:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1959:x1830881263410944:12345-192.168.202.46@tcp:3:cat.0 Request processed in 64038us (64143us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.902275:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8657 00002000:00100000:0.0:1746065198.902285:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008ec2c380 x1830881263410944/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.902294:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2c380 with x1830881263410944 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.902299:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2c380 00000100:00100000:3.0:1746065198.903100:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263410432:12345-192.168.202.46@tcp:3:cat.0 Request processed in 69328us (73707us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065198.903109:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8656 00002000:00100000:3.0:1746065198.903116:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880094a97800 x1830881263410432/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.903124:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a97800 with x1830881263410432 ext(0->1048575) 00002000:00010000:3.0:1746065198.903128:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a97800 00000100:00100000:0.0:1746065198.915346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.915417:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411456 00000100:00100000:3.0:1746065198.915425:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411456 00002000:00100000:3.0:1746065198.915462:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094a95180 x1830881263411456/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.915471:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95180 with x1830881263411456 ext(4194304->5013503) 00002000:00010000:3.0:1746065198.915475:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a95180 00000100:00100000:3.0:1746065198.915507:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8660 00000100:00100000:3.0:1746065198.915515:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263411456:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065198.932441:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.932483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.932935:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263411200:12345-192.168.202.46@tcp:3:cat.0 Request processed in 92968us (93088us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.932944:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8659 00002000:00100000:0.0:1746065198.932953:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff880129b0c000 x1830881263411200/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.932961:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129b0c000 with x1830881263411200 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.932965:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129b0c000 00000100:00100000:0.0:1746065198.933170:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1959:x1830881263410688:12345-192.168.202.46@tcp:3:cat.0 Request processed in 94949us (95100us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.933175:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8658 00002000:00100000:0.0:1746065198.933179:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88008ec2f480 x1830881263410688/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.933186:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec2f480 with x1830881263410688 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.933188:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec2f480 00000100:00100000:2.0:1746065198.933588:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411712 00000100:00100000:2.0:1746065198.933594:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411712 00000100:00100000:2.0:1746065198.933619:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411840 00000100:00100000:2.0:1746065198.933621:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411840 00000100:00100000:2.0:1746065198.933646:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10156 00000100:00100000:2.0:1746065198.933651:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32194:x1830881263411712:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065198.933675:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.933677:0:14643:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065198.933698:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe600/0x14b4f8542d4fef3c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61db6 expref: 250 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.933721:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.933725:0:14643:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065198.933732:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918c00/0x14b4f8542d4fef74 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61de7 expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.933774:0:14643:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.933783:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.933789:0:14643:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.933794:0:14643:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 5/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.933828:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 9 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.933837:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 9 pid: 14645 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065198.933845:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260483968:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.933899:0:14643:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 9 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.933905:0:14643:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 9 pid: 20754 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065198.933911:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260484096:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.933923:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065198.934053:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10157 00000100:00100000:1.0:1746065198.934060:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32202:x1830881263411840:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065198.934070:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.934076:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1ca400/0x14b4f8542d4fef82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61dee expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.934110:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065198.934117:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065198.934125:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065198.934133:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065198.934138:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065198.934142:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065198.934215:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065198.934220:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.934225:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.934229:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:1.0:1746065198.934237:0:14644:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.934246:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 9 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.934252:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 9 pid: 14643 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065198.934259:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260484224:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065198.934279:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065198.938095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.938334:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260483968:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065198.938352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.938425:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412096 00000100:00100000:3.0:1746065198.938430:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412096 00010000:00010000:3.0:1746065198.938455:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 10 pid: 14645 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065198.938677:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263411968 00000100:00100000:1.0:1746065198.938681:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263411968 00000100:00100000:1.0:1746065198.938703:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10158 00000100:00100000:1.0:1746065198.938709:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32201:x1830881263411968:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065198.938721:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.938732:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61df5 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.938773:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61df5 expref: 252 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.938781:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61df5 expref: 252 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.938790:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065198.938792:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065198.938795:0:14645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.938799:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1cbc00, rc 0) 00000100:00100000:1.0:1746065198.938842:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+252:32201:x1830881263411968:12345-192.168.202.46@tcp:101:cat.0 Request processed in 133us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.938847:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10158 00000100:00100000:3.0:1746065198.938892:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7931 00000100:00100000:3.0:1746065198.938897:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+10:1958:x1830881263412096:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065198.938904:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065198.938908:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 10 pid: 14645 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065198.938916:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 10 pid: 14645 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065198.938930:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c000/0x14b4f8542d4fef19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61daf expref: 10 pid: 14645 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065198.938944:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065198.938947:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065198.938952:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.938956:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.938960:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065198.938963:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065198.938976:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:1958:x1830881263412096:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.938980:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7931 00000100:00100000:3.0:1746065198.939158:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263411456:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23644us (23820us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065198.939164:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8660 00002000:00100000:3.0:1746065198.939171:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff880094a95180 x1830881263411456/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065198.939179:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a95180 with x1830881263411456 ext(4194304->5013503) 00002000:00010000:3.0:1746065198.939182:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a95180 00000100:00100000:1.0:1746065198.939505:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260484224:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065198.939518:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000100:00100000:2.0:1746065198.941363:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260484096:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065198.941381:0:14643:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00000100:00100000:0.0:1746065198.941737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.941790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.941850:0:20754:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412352 00000100:00100000:1.0:1746065198.941855:0:20754:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412352 00000100:00100000:1.0:1746065198.941882:0:20754:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10159 00000100:00100000:1.0:1746065198.941887:0:20754:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:32198:x1830881263412352:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065198.941902:0:20754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065198.941913:0:20754:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cba00/0x14b4f8542d4fefa5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61dfc expref: -99 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.941949:0:20754:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cba00/0x14b4f8542d4fefa5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dfc expref: 10 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.941957:0:20754:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cba00/0x14b4f8542d4fefa5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dfc expref: 10 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065198.941966:0:20754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065198.941968:0:20754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065198.941970:0:20754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:1.0:1746065198.941978:0:20754:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1cba00, rc 0) 00000100:00100000:1.0:1746065198.942017:0:20754:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:32198:x1830881263412352:12345-192.168.202.46@tcp:101:cat.0 Request processed in 130us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.942022:0:20754:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10159 00000100:00100000:2.0:1746065198.942068:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412224 00000100:00100000:2.0:1746065198.942070:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412224 00010000:00010000:2.0:1746065198.942083:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 10 pid: 14643 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065198.942097:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7932 00000100:00100000:2.0:1746065198.942100:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+10:1961:x1830881263412224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.942107:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.942111:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 10 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.942118:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 10 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.942130:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013548c800/0x14b4f8542d4fef12 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d85 expref: 10 pid: 14643 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.942140:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.942143:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065198.942147:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.942152:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.942156:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065198.942160:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.942171:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1961:x1830881263412224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 71us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.942176:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7932 00000100:00100000:0.0:1746065198.943290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.943345:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412480 00000100:00100000:2.0:1746065198.943349:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412480 00010000:00010000:2.0:1746065198.943363:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 11 pid: 20754 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065198.943809:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7933 00000100:00100000:2.0:1746065198.943834:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+11:1960:x1830881263412480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065198.943843:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065198.943847:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 11 pid: 20754 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.943855:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 11 pid: 20754 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.943868:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e0a00/0x14b4f8542d4fee94 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d69 expref: 11 pid: 20754 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065198.943876:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.943880:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065198.943885:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.943890:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.943894:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14643 initiator: MDT0 00010000:00010000:2.0:1746065198.943899:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065198.943903:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61df5 expref: 251 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.943907:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065198.943930:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065198.943956:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263412480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 142us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.943961:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7933 00010000:00010000:3.0:1746065198.944170:0:14643:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00010000:00010000:3.0:1746065198.944176:0:14643:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14643 initiator: MDT0 00000040:00080000:3.0:1746065198.944650:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3183, 88 off269536 00000004:00080000:3.0:1746065198.944655:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798235839711ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944703:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3199, 88 off271128 00000004:00080000:3.0:1746065198.944707:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798235891581ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065198.944718:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3200, 88 off271216 00000004:00080000:3.0:1746065198.944720:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798235905231ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065198.944727:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3184, 88 off269624 00000004:00080000:3.0:1746065198.944730:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798235914275ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944735:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3185, 88 off269712 00000004:00080000:3.0:1746065198.944737:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798235921792ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944743:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3201, 88 off271304 00000004:00080000:3.0:1746065198.944745:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798235930236ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065198.944751:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3202, 88 off271392 00000004:00080000:3.0:1746065198.944753:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798235937992ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065198.944759:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3203, 88 off271480 00000004:00080000:3.0:1746065198.944761:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798235945594ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065198.944766:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3186, 88 off269800 00000004:00080000:3.0:1746065198.944769:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798235953304ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944776:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3204, 88 off271568 00000004:00080000:3.0:1746065198.944778:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798235962746ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065198.944784:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3187, 88 off269888 00000004:00080000:3.0:1746065198.944786:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798235970701ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944792:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3205, 88 off271656 00000004:00080000:3.0:1746065198.944794:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798235978727ns, next at 737095943431ns, rc = 0 00000040:00080000:3.0:1746065198.944800:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3188, 88 off269976 00000004:00080000:3.0:1746065198.944803:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798235987352ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944808:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3189, 88 off270064 00000004:00080000:3.0:1746065198.944811:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798235995381ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944840:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3190, 88 off270152 00000004:00080000:3.0:1746065198.944842:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798236027039ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944849:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3191, 88 off270240 00000004:00080000:3.0:1746065198.944852:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798236036307ns, next at 737048221954ns, rc = 0 00000040:00080000:3.0:1746065198.944858:0:14643:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3206, 88 off271744 00000004:00080000:3.0:1746065198.944860:0:14643:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798236044822ns, next at 737095943431ns, rc = 0 00010000:00010000:3.0:1746065198.975477:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de7 expref: 253 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.975490:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065198.975492:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065198.975495:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065198.975502:0:14643:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065198.975506:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14644 initiator: MDT0 00010000:00010000:3.0:1746065198.975515:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61df5 expref: 253 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.975521:0:14643:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61df5 expref: 253 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.975525:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61df5 expref: 253 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.975531:0:14643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cba00/0x14b4f8542d4fefa5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dfc expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.975535:0:14643:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cba00/0x14b4f8542d4fefa5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dfc expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.975540:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cba00/0x14b4f8542d4fefa5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dfc expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.975566:0:14643:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cba00/0x14b4f8542d4fefa5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dfc expref: 8 pid: 20754 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.975575:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260484352:192.168.202.46@tcp:105: 00000001:00080000:1.0:1746065198.975678:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944450 is committed 00000001:00080000:1.0:1746065198.975686:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944449 is committed 00000001:00080000:1.0:1746065198.975696:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944451 is committed 00000004:00080000:1.0:1746065198.975699:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2486 committed 00000004:00080000:1.0:1746065198.975706:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2471 committed 00000004:00080000:1.0:1746065198.975710:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2470 committed 00000004:00080000:1.0:1746065198.975711:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2469 committed 00000004:00080000:1.0:1746065198.975713:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2468 committed 00000004:00080000:1.0:1746065198.975714:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2485 committed 00000004:00080000:1.0:1746065198.975716:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2467 committed 00000004:00080000:1.0:1746065198.975717:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2484 committed 00000004:00080000:1.0:1746065198.975718:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2466 committed 00000004:00080000:1.0:1746065198.975719:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2483 committed 00000004:00080000:1.0:1746065198.975720:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2482 committed 00000004:00080000:1.0:1746065198.975722:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2481 committed 00000004:00080000:1.0:1746065198.975723:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2465 committed 00000004:00080000:1.0:1746065198.975724:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2464 committed 00000004:00080000:1.0:1746065198.975725:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2480 committed 00000004:00080000:1.0:1746065198.975726:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2479 committed 00000004:00080000:1.0:1746065198.975727:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2463 committed 00000001:00080000:1.0:1746065198.975731:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944446 is committed 00000100:00100000:1.0:1746065198.975844:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260484736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.975875:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065198.976207:0:14643:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61df5 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065198.976214:0:14643:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260486528:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065198.976234:0:14643:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065198.976244:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260484480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.976260:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260484608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.976409:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260485248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.976423:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.976431:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260485760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.976440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.976447:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260486272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.976455:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.976467:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746065198.976470:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260484864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.976479:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.976485:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260485376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.976494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.976500:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260485888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.976509:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.976516:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260486400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.976525:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065198.976542:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260484736 00000100:00100000:1.0:1746065198.976547:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260484736 00000100:00100000:1.0:1746065198.976569:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260485248 00000100:00100000:1.0:1746065198.976570:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260485248 00000100:00100000:1.0:1746065198.976577:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260485760 00000100:00100000:1.0:1746065198.976578:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260485760 00000100:00100000:1.0:1746065198.976586:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260486272 00000100:00100000:1.0:1746065198.976587:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260486272 00000100:00100000:1.0:1746065198.976593:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260484864 00000100:00100000:1.0:1746065198.976595:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260484864 00000100:00100000:1.0:1746065198.976599:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260485376 00000100:00100000:1.0:1746065198.976600:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260485376 00000100:00100000:1.0:1746065198.976604:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260485888 00000100:00100000:1.0:1746065198.976605:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260485888 00000100:00100000:1.0:1746065198.976610:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260486400 00000100:00100000:1.0:1746065198.976611:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260486400 00000100:00100000:1.0:1746065198.976618:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15362 00000100:00100000:1.0:1746065198.976623:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881260484736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065198.976770:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065198.976773:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065199 -> 1746065199 00002000:00010000:1.0:1746065198.976775:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065197 -> 1746065197 00002000:00010000:1.0:1746065198.976776:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065199 -> 1746065199 00002000:00010000:1.0:1746065198.976778:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065198.976799:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881260484736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (923us total) trans 17179873755 rc 0/0 00000100:00100000:1.0:1746065198.976804:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15362 00000100:00100000:1.0:1746065198.976831:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15363 00000100:00100000:1.0:1746065198.976834:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881260485248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.976894:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881260485248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (470us total) trans 17179873756 rc 0/0 00000100:00100000:1.0:1746065198.976898:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15363 00000100:00100000:1.0:1746065198.976907:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15364 00000100:00100000:1.0:1746065198.976910:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881260485760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065198.976978:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:1.0:1746065198.976980:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065199 -> 1746065199 00002000:00010000:1.0:1746065198.976982:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065199 -> 1746065199 00002000:00010000:1.0:1746065198.976984:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065199 -> 1746065199 00002000:00010000:1.0:1746065198.976985:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5769 -> 5769 00000100:00100000:1.0:1746065198.976998:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260485760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (557us total) trans 21474841047 rc 0/0 00000100:00100000:1.0:1746065198.977004:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15364 00000100:00100000:1.0:1746065198.977012:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15365 00000100:00100000:1.0:1746065198.977015:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881260486272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065198.977061:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977062:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977064:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977065:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977067:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x381:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065198.977079:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260486272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (622us total) trans 21474841048 rc 0/0 00000100:00100000:1.0:1746065198.977082:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15365 00000100:00100000:1.0:1746065198.977088:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15366 00000100:00100000:1.0:1746065198.977092:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881260484864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065198.977136:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977138:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065198.977140:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065198.977141:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065198.977143:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065198.977155:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881260484864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (675us total) trans 17179873757 rc 0/0 00000100:00100000:1.0:1746065198.977159:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15366 00000100:00100000:1.0:1746065198.977165:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15367 00000100:00100000:1.0:1746065198.977168:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3295:x1830881260485376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065198.977218:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3295:x1830881260485376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (723us total) trans 17179873758 rc 0/0 00000100:00100000:1.0:1746065198.977224:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15367 00000100:00100000:1.0:1746065198.977231:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15368 00000100:00100000:1.0:1746065198.977234:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881260485888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065198.977276:0:8429:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977278:0:8429:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977280:0:8429:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977281:0:8429:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065198.977283:0:8429:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x384:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065198.977294:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260485888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (785us total) trans 21474841049 rc 0/0 00000100:00100000:1.0:1746065198.977298:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15368 00000100:00100000:1.0:1746065198.977304:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15369 00000100:00100000:1.0:1746065198.977307:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3295:x1830881260486400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065198.977358:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3295:x1830881260486400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (832us total) trans 21474841050 rc 0/0 00000100:00100000:1.0:1746065198.977362:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15369 00000004:00080000:1.0:1746065198.977442:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0fb80/2, rc 0, transno 17179873757 00000100:00100000:1.0:1746065198.977446:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260484864:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065198.977451:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f146680/2, rc 0, transno 17179873758 00000100:00100000:1.0:1746065198.977454:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260485376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065198.977459:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f211500/2, rc 0, transno 21474841049 00000100:00100000:1.0:1746065198.977463:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260485888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065198.977468:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b622a00/2, rc 0, transno 21474841050 00000100:00100000:1.0:1746065198.977470:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260486400:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065198.977475:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0ce00/2, rc 0, transno 17179873755 00000100:00100000:1.0:1746065198.977477:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260484736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065198.977481:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f147800/2, rc 0, transno 17179873756 00000100:00100000:1.0:1746065198.977483:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260485248:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065198.977487:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f211880/2, rc 0, transno 21474841047 00000100:00100000:1.0:1746065198.977489:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260485760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065198.977493:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b621180/2, rc 0, transno 21474841048 00000100:00100000:1.0:1746065198.977494:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260486272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.977690:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977706:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260485120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.977720:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977727:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260485632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.977737:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977743:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260486144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.977753:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977761:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065198.977764:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260486656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.977773:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977785:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977792:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260484992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.977801:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977806:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260485504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.977831:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977837:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260486016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.977846:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065198.977857:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260484608 00000100:00100000:3.0:1746065198.977861:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260484608 00000100:00100000:3.0:1746065198.977871:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260485120 00000100:00100000:3.0:1746065198.977873:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260485120 00000100:00100000:3.0:1746065198.977877:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260485632 00000100:00100000:3.0:1746065198.977878:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260485632 00000100:00100000:3.0:1746065198.977883:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260486144 00000100:00100000:3.0:1746065198.977885:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260486144 00000100:00100000:3.0:1746065198.977889:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260486656 00000100:00100000:3.0:1746065198.977890:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260486656 00000100:00100000:3.0:1746065198.977895:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260484480 00000100:00100000:3.0:1746065198.977896:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260484480 00000100:00100000:3.0:1746065198.977900:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260484992 00000100:00100000:3.0:1746065198.977901:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260484992 00000100:00100000:3.0:1746065198.977906:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260485504 00000100:00100000:3.0:1746065198.977907:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260485504 00000100:00100000:3.0:1746065198.977911:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260486016 00000100:00100000:3.0:1746065198.977912:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260486016 00000100:00100000:3.0:1746065198.977917:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15370 00000100:00100000:3.0:1746065198.977920:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881260484608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065198.977985:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065198.977987:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065198.977988:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065198.977990:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065198.977991:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065198.978008:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3298:x1830881260484608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (318us total) trans 17179873759 rc 0/0 00000100:00100000:3.0:1746065198.978012:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15370 00000100:00100000:3.0:1746065198.978019:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15371 00000100:00100000:3.0:1746065198.978022:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3298:x1830881260485120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065198.978076:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3298:x1830881260485120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (354us total) trans 17179873760 rc 0/0 00000100:00100000:3.0:1746065198.978080:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15371 00000100:00100000:3.0:1746065198.978087:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15372 00000100:00100000:3.0:1746065198.978090:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3298:x1830881260485632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065198.978143:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065198.978145:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065199 -> 1746065199 00002000:00010000:3.0:1746065198.978146:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:3.0:1746065198.978148:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065199 -> 1746065199 00002000:00010000:3.0:1746065198.978150:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065198.978162:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3298:x1830881260485632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (425us total) trans 21474841051 rc 0/0 00000100:00100000:3.0:1746065198.978166:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15372 00000100:00100000:3.0:1746065198.978173:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15373 00000100:00100000:3.0:1746065198.978176:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3298:x1830881260486144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.978227:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3298:x1830881260486144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (473us total) trans 21474841052 rc 0/0 00000100:00100000:3.0:1746065198.978232:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15373 00000100:00100000:3.0:1746065198.978238:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15374 00000100:00100000:3.0:1746065198.978241:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3298:x1830881260486656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.978291:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3298:x1830881260486656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (517us total) trans 21474841053 rc 0/0 00000100:00100000:3.0:1746065198.978295:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15374 00000100:00100000:3.0:1746065198.978301:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15375 00000100:00100000:3.0:1746065198.978304:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881260484480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065198.978351:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065198.978353:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065198.978354:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:3.0:1746065198.978356:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065198.978358:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065198.978372:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260484480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (586us total) trans 17179873761 rc 0/0 00000100:00100000:3.0:1746065198.978377:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15375 00000100:00100000:3.0:1746065198.978383:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15376 00000100:00100000:3.0:1746065198.978386:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3297:x1830881260484992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065198.978430:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065198.978431:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065198.978433:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065198.978434:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065198.978435:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746065198.978448:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3297:x1830881260484992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (645us total) trans 17179873762 rc 0/0 00000100:00100000:3.0:1746065198.978451:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15376 00000100:00100000:3.0:1746065198.978457:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15377 00000100:00100000:3.0:1746065198.978460:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3297:x1830881260485504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065198.978508:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065198.978510:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065198.978511:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065195 -> 1746065195 00002000:00010000:3.0:1746065198.978513:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065198 -> 1746065198 00002000:00010000:3.0:1746065198.978514:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:3.0:1746065198.978527:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3297:x1830881260485504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (695us total) trans 21474841054 rc 0/0 00000100:00100000:3.0:1746065198.978530:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15377 00000100:00100000:3.0:1746065198.978536:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15378 00000100:00100000:3.0:1746065198.978539:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3297:x1830881260486016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065198.978591:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3297:x1830881260486016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (743us total) trans 21474841055 rc 0/0 00000100:00100000:3.0:1746065198.978595:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15378 00000004:00080000:3.0:1746065198.978611:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0dc00/2, rc 0, transno 17179873761 00000100:00100000:3.0:1746065198.978614:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260484480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065198.978619:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f146a00/2, rc 0, transno 17179873762 00000100:00100000:3.0:1746065198.978621:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260484992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065198.978626:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f211f80/2, rc 0, transno 21474841054 00000100:00100000:3.0:1746065198.978628:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260485504:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065198.978632:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f213100/2, rc 0, transno 21474841055 00000100:00100000:3.0:1746065198.978634:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260486016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065198.978643:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b82f800/2, rc 0, transno 21474841053 00000100:00100000:3.0:1746065198.978645:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260486656:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065198.978649:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129b0d880/2, rc 0, transno 17179873759 00000100:00100000:3.0:1746065198.978651:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260484608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065198.978655:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f145500/2, rc 0, transno 17179873760 00000100:00100000:3.0:1746065198.978657:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260485120:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065198.978660:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f210000/2, rc 0, transno 21474841051 00000100:00100000:3.0:1746065198.978675:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260485632:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065198.978688:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f212d80/2, rc 0, transno 21474841052 00000100:00100000:3.0:1746065198.978690:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260486144:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746065198.979480:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979489:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065198.979521:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:0.0:1746065198.979524:0:14644:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746065198.979536:0:14644:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979545:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979553:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979558:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979563:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979567:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f1cb200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065198.979570:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979579:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979589:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065198.979591:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065198.979594:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979598:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb200/0x14b4f8542d4fef89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979607:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979611:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979615:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979618:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f1cb400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065198.979620:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979624:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979628:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:0.0:1746065198.979629:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065198.979631:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979634:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb400/0x14b4f8542d4fef90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065198.979659:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1ca400/0x14b4f8542d4fef82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.979679:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.979684:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065198.979686:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746065198.979688:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1cb600, rc 0) 00000100:00100000:0.0:1746065198.979723:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32202:x1830881263411840:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 45664us (47239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.979728:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10157 00000100:00100000:3.0:1746065198.982598:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260484352:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065198.983018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.983077:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412608 00000100:00100000:2.0:1746065198.983083:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412608 00000100:00100000:2.0:1746065198.983111:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10160 00000100:00100000:2.0:1746065198.983117:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:32202:x1830881263412608:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.983129:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.983142:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265a00/0x14b4f8542d4fefac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e03 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.983185:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265a00/0x14b4f8542d4fefac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e03 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.983196:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265a00/0x14b4f8542d4fefac lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e03 expref: 8 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.983208:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065198.983211:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065198.983213:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b265a00, rc 0) 00000100:00100000:2.0:1746065198.983250:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32202:x1830881263412608:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 133us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.983256:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10160 00000100:00100000:3.0:1746065198.984312:0:14643:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14643:1830881260486528:192.168.202.46@tcp:105: 00000100:00100000:0.0:1746065198.984475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.984541:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412864 00000100:00100000:1.0:1746065198.984545:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412864 00010000:00010000:3.0:1746065198.984594:0:14643:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b918c00/0x14b4f8542d4fef74 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de7 expref: 250 pid: 14643 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065198.984609:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de7 expref: 249 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.984625:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5c200, rc 0) 00000100:00100000:3.0:1746065198.984648:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32194:x1830881263411712:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 50997us (52215us total) trans 8589944451 rc 0/0 00000100:00100000:3.0:1746065198.984653:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10156 00000100:00100000:3.0:1746065198.984675:0:14643:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10161 00000100:00100000:3.0:1746065198.984680:0:14643:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+7:32195:x1830881263412864:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065198.984689:0:14643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065198.984696:0:14643:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fefb3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e0a expref: -99 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.984715:0:14643:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fefb3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e0a expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.984722:0:14643:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fefb3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e0a expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065198.984730:0:14643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065198.984732:0:14643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065198.984734:0:14643:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c3f2600, rc 0) 00000100:00100000:3.0:1746065198.984745:0:14643:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26bbd020-9fba-464a-bebc-8395a287959e+8:32195:x1830881263412864:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 65us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.984749:0:14643:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10161 00000100:00100000:0.0:1746065198.987169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.987202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065198.987254:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412736 00000100:00100000:1.0:1746065198.987260:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412736 00000100:00100000:1.0:1746065198.987296:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4392 00000100:00100000:1.0:1746065198.987302:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:32198:x1830881263412736:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:1.0:1746065198.987377:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+8:32198:x1830881263412736:12345-192.168.202.46@tcp:49:cat.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065198.987381:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4392 00000100:00100000:2.0:1746065198.987959:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263412992 00000100:00100000:2.0:1746065198.987963:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263412992 00000100:00100000:2.0:1746065198.987982:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15379 00000100:00100000:2.0:1746065198.987987:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1961:x1830881263412992:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.987994:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.988007:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e11 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.988020:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988021:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065198.988022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065198.988028:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.988039:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065198.988045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065198.988052:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b264a00, rc 0) 00000100:00100000:0.0:1746065198.988058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.988072:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1961:x1830881263412992:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 85us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.988074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.988076:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15379 00000100:00100000:2.0:1746065198.988083:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413120 00000100:00100000:2.0:1746065198.988085:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413120 00000100:00100000:2.0:1746065198.988094:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413248 00000100:00100000:2.0:1746065198.988096:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413248 00000100:00100000:2.0:1746065198.988103:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413376 00000100:00100000:2.0:1746065198.988104:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413376 00000100:00100000:0.0:1746065198.988109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065198.988130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065198.988143:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413504 00000100:00100000:3.0:1746065198.988145:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413504 00000100:00100000:3.0:1746065198.988164:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4393 00000100:00100000:3.0:1746065198.988168:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32201:x1830881263413504:12345-192.168.202.46@tcp:49:cat.0 00000100:00100000:3.0:1746065198.988206:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32201:x1830881263413504:12345-192.168.202.46@tcp:49:cat.0 Request processed in 37us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.988210:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4393 00000100:00100000:2.0:1746065198.988485:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413632 00000100:00100000:2.0:1746065198.988488:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413632 00000100:00100000:2.0:1746065198.988502:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413760 00000100:00100000:2.0:1746065198.988504:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413760 00000100:00100000:2.0:1746065198.988513:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15380 00000100:00100000:2.0:1746065198.988516:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263413120:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.988523:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.988532:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e18 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.988541:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988542:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988546:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065198.988547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065198.988555:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065198.988559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065198.988565:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a60c00, rc 0) 00000100:00100000:2.0:1746065198.988579:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263413120:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 62us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.988583:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15380 00000100:00100000:0.0:1746065198.988586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065198.988590:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15381 00000100:00100000:2.0:1746065198.988594:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263413248:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.988598:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.988602:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e1f expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.988608:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988609:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988613:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065198.988615:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414144 00000100:00100000:0.0:1746065198.988618:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414144 00010000:00010000:2.0:1746065198.988619:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.988624:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b265000, rc 0) 00000100:00100000:2.0:1746065198.988636:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263413248:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 42us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.988639:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15381 00000100:00100000:0.0:1746065198.988640:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 800 00000100:00100000:0.0:1746065198.988645:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+8:1961:x1830881263414144:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.988652:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.988679:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c3f2600/0x14b4f8542d4fefb3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e0a expref: 8 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.988688:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065198.988692:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065198.988705:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:1961:x1830881263414144:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.988710:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 800 00000100:00100000:2.0:1746065198.988748:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15382 00000100:00100000:2.0:1746065198.988751:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263413376:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.988758:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.988764:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e26 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.988770:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988771:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988775:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.988781:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.988787:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b264200, rc 0) 00000100:00100000:2.0:1746065198.988797:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263413376:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 46us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.988801:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15382 00000100:00100000:2.0:1746065198.988808:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15383 00000100:00100000:2.0:1746065198.988811:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1961:x1830881263413632:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.988829:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.988833:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e2d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.988840:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988841:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988844:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.988855:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.988860:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b264c00, rc 0) 00000100:00100000:2.0:1746065198.988870:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1961:x1830881263413632:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 58us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.988873:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15383 00000100:00100000:2.0:1746065198.988879:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15384 00000100:00100000:2.0:1746065198.988882:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263413760:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065198.988886:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065198.988890:0:8427:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e34 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065198.988896:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988897:0:8427:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065198.988900:0:8427:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.988906:0:8427:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065198.988911:0:8427:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b264400, rc 0) 00000100:00100000:2.0:1746065198.988918:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263413760:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 36us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065198.988922:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15384 00000100:00100000:3.0:1746065198.989059:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263413888 00000100:00100000:3.0:1746065198.989062:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263413888 00000100:00100000:3.0:1746065198.989074:0:16801:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414016 00000100:00100000:3.0:1746065198.989075:0:16801:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414016 00000100:00100000:3.0:1746065198.989084:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4394 00000100:00100000:3.0:1746065198.989088:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32194:x1830881263413888:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:3.0:1746065198.989126:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32194:x1830881263413888:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 38us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.989130:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4394 00000100:00100000:3.0:1746065198.989150:0:16801:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4395 00000100:00100000:3.0:1746065198.989154:0:16801:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:32195:x1830881263414016:12345-192.168.202.46@tcp:49:multiop.0 00000100:00100000:3.0:1746065198.989173:0:16801:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:32195:x1830881263414016:12345-192.168.202.46@tcp:49:multiop.0 Request processed in 19us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065198.989177:0:16801:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4395 00000100:00100000:0.0:1746065199.003266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.003347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.003421:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414528 00000100:00100000:3.0:1746065199.003428:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414528 00002000:00100000:3.0:1746065199.003463:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880095355880 x1830881263414528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.003473:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355880 with x1830881263414528 ext(1048576->2097151) 00002000:00010000:3.0:1746065199.003477:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095355880 00000100:00100000:3.0:1746065199.003493:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8661 00000100:00100000:3.0:1746065199.003500:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263414528:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065199.004478:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414272 00000100:00100000:1.0:1746065199.004484:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414272 00000100:00100000:1.0:1746065199.004509:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15385 00000100:00100000:1.0:1746065199.004514:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:32194:x1830881263414272:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065199.004523:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.004536:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e3b expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.004559:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.004566:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.004571:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.004577:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.004578:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.004581:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.004605:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 36 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.004614:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 36 pid: 21998 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.004624:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260486784:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.004690:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.004697:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.004704:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260486912:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.004722:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.004728:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 13 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.004734:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260487040:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.004744:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.012250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.012457:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414784 00000100:00100000:2.0:1746065199.012464:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414784 00000100:00100000:2.0:1746065199.012571:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10162 00000100:00100000:2.0:1746065199.012579:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32202:x1830881263414784:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065199.012594:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.012609:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3200/0x14b4f8542d4fefeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e42 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.012689:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.012700:0:14644:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.012706:0:14644:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.012729:0:14644:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.012737:0:14644:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 9 pid: 14644 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065199.012746:0:14644:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260487168:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.013565:0:14644:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.021750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.022176:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260486784:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.022185:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260486912:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.022191:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260487040:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.022213:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [1683456->2097151] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.022228:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548c000, rc 0) 00000100:00100000:1.0:1746065199.022266:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:32194:x1830881263414272:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 17751us (19007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.022273:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15385 00000100:00100000:0.0:1746065199.022575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.022589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.022598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.022649:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.022682:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415040 00000100:00100000:0.0:1746065199.022686:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415040 00010000:00010000:0.0:1746065199.022706:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:3.0:1746065199.022947:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263414528:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 19446us (19598us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.022953:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8661 00002000:00100000:3.0:1746065199.022960:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880095355880 x1830881263414528/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.022968:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095355880 with x1830881263414528 ext(1048576->2097151) 00010000:00010000:3.0:1746065199.022973:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 34 pid: 21998 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.022982:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 34 pid: 21998 timeout: 898 lvb_type: 1 00002000:00010000:3.0:1746065199.022987:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095355880 00000100:00100000:2.0:1746065199.023652:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263414912 00000100:00100000:2.0:1746065199.023657:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263414912 00010000:00010000:2.0:1746065199.023679:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 9 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.023697:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415424 00000100:00100000:2.0:1746065199.023699:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415424 00010000:00010000:2.0:1746065199.023708:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 10 pid: 14644 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065199.023718:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7934 00000100:00100000:2.0:1746065199.023723:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263415040:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065199.023729:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7935 00010000:00010000:2.0:1746065199.023732:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065199.023736:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263414912:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.023744:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065199.023746:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.023753:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.023766:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 9 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.023775:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5dc00/0x14b4f8542d4feee8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d8c expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.023776:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 9 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.023786:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a60c00/0x14b4f8542d4fefc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e18 expref: 9 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.023787:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065199.023799:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065199.023803:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263415040:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 80us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.023808:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7934 00000100:00100000:0.0:1746065199.023826:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1960:x1830881263414912:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.023831:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7935 00000100:00100000:2.0:1746065199.023835:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7936 00000100:00100000:2.0:1746065199.023839:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263415424:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.023845:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065199.023848:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415168 00010000:00010000:2.0:1746065199.023849:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 10 pid: 14644 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746065199.023850:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415168 00010000:00010000:2.0:1746065199.023856:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 10 pid: 14644 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746065199.023863:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415296 00000100:00100000:0.0:1746065199.023865:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415296 00010000:00010000:2.0:1746065199.023867:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065199.023871:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065199.023876:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15386 00010000:00010000:2.0:1746065199.023877:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00000100:00100000:0.0:1746065199.023881:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263415168:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065199.023882:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.023891:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.023893:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065199.023899:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd800/0x14b4f8542d4feff9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e49 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065199.023903:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+10:1960:x1830881263415424:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.023907:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7936 00010000:00010000:0.0:1746065199.023911:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.023917:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd800/0x14b4f8542d4feff9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e49 expref: 15 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.023925:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd800/0x14b4f8542d4feff9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e49 expref: 15 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.023932:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0fd800, rc 0) 00000100:00100000:0.0:1746065199.023948:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263415168:12345-192.168.202.46@tcp:101:cat.0 Request processed in 67us (1358us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.023954:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15386 00000100:00100000:0.0:1746065199.023964:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15387 00000100:00100000:0.0:1746065199.023968:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+13:32195:x1830881263415296:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065199.023973:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.023980:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e50 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.023993:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.024000:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.024006:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.024011:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.024013:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.024016:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1327104->2097151] (req 1327104->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 14 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.024034:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.024043:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746065199.024052:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260487296:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065199.024088:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.024094:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746065199.024100:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260487424:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065199.024116:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.024122:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746065199.024128:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260487552:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065199.024137:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb900 going to sleep for 11 seconds 00010000:00010000:0.0:1746065199.024177:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cb600/0x14b4f8542d4fef97 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dee expref: 9 pid: 14644 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746065199.024185:0:14644:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14644:1830881260487168:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065199.024195:0:14644:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.024201:0:14644:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.024205:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065199.024219:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065199.024364:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302d3200/0x14b4f8542d4fefeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e42 expref: 10 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.024374:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e42 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.024379:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065199.024381:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065199.024383:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fd7800, rc 0) 00000100:00100000:0.0:1746065199.024395:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32202:x1830881263414784:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 11818us (12152us total) trans 8589944452 rc 0/0 00000100:00100000:0.0:1746065199.024400:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10162 00000100:00100000:0.0:1746065199.027777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.027856:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260487296:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.027865:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260487424:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065199.027972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.028158:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415680 00000100:00100000:0.0:1746065199.028163:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415680 00010000:00010000:0.0:1746065199.028192:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746065199.028223:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415552 00000100:00100000:0.0:1746065199.028225:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415552 00010000:00010000:0.0:1746065199.028233:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 34 pid: 21998 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.028440:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260487552:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.028465:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [1327104->2097151] (req 1327104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 14 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.028476:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0fd600, rc 0) 00000100:00100000:1.0:1746065199.028510:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+14:32195:x1830881263415296:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4541us (5910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.028516:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15387 00000100:00100000:0.0:1746065199.028712:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7937 00000100:00100000:0.0:1746065199.028717:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263415680:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.028727:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.028742:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.028750:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.028765:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b265000/0x14b4f8542d4fefc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e1f expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.028773:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.028785:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263415680:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 69us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.028789:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7937 00000100:00100000:3.0:1746065199.028883:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7938 00000100:00100000:3.0:1746065199.028889:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263415552:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.028895:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065199.028904:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 34 pid: 21998 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.028915:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 34 pid: 21998 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.028925:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cc4a000/0x14b4f8542d4fef51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dc4 expref: 34 pid: 21998 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.028936:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.028937:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.028942:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.028949:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.028969:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 33 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065199.028978:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260487680:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065199.029008:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.031243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065199.031912:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065199.032137:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416576 00000100:00100000:0.0:1746065199.032143:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416576 00000100:00100000:0.0:1746065199.032182:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10163 00000100:00100000:0.0:1746065199.032188:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32202:x1830881263416576:12345-192.168.202.46@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065199.032206:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.032209:0:14644:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065199.032227:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fd7800/0x14b4f8542d4feff2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e42 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.032243:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065199.032247:0:14644:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065199.032255:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb800/0x14b4f8542d4ff00e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e57 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.032314:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032323:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032330:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032339:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032344:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032349:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032354:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368eb400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065199.032357:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032362:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032367:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065199.032369:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065199.032373:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00000100:00100000:3.0:1746065199.032375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:0.0:1746065199.032377:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb400/0x14b4f8542d4ff015 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.032393:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb800/0x14b4f8542d4ff00e lrc: 1/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e57 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.032400:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368eb800/0x14b4f8542d4ff00e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e57 expref: 9 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.032405:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368eb800, rc 0) 00000100:00100000:3.0:1746065199.032411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.032439:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32202:x1830881263416576:12345-192.168.202.46@tcp:101:mirror_io.0 Request processed in 251us (1202us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.032444:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10163 00000100:00100000:1.0:1746065199.033058:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416064 00000100:00100000:1.0:1746065199.033063:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416064 00010000:00010000:1.0:1746065199.033080:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.033098:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7939 00000100:00100000:1.0:1746065199.033103:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+14:1960:x1830881263416064:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065199.033110:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065199.033125:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.033133:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.033144:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d800/0x14b4f8542d4feeef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d93 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.033162:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065199.033182:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263416064:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 79us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.033187:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7939 00000100:00100000:3.0:1746065199.033305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.034028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.034042:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263415936 00000100:00100000:2.0:1746065199.034045:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263415936 00002000:00100000:2.0:1746065199.034071:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008fc59180 x1830881263415936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.034078:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59180 with x1830881263415936 ext(1048576->2097151) 00010000:00010000:2.0:1746065199.034084:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 34 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.034093:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 34 pid: 8428 timeout: 898 lvb_type: 1 00002000:00010000:2.0:1746065199.034099:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc59180 00000100:00100000:3.0:1746065199.034397:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260487680:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065199.034411:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.034430:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1959:x1830881263415552:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5542us (6458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.034436:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7938 00000100:00100000:2.0:1746065199.034580:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416320 00000100:00100000:2.0:1746065199.034583:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416320 00002000:00100000:2.0:1746065199.034596:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88008fc5a300 x1830881263416320/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.034603:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5a300 with x1830881263416320 ext(5009408->5013503) 00002000:00010000:2.0:1746065199.034606:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5a300 00000100:00100000:2.0:1746065199.034620:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263416832 00000100:00100000:2.0:1746065199.034622:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263416832 00002000:00100000:2.0:1746065199.034628:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x387:0x0] (1683456->1687551) req@ffff880093ba3100 x1830881263416832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.034634:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3100 with x1830881263416832 ext(1683456->1687551) 00002000:00010000:2.0:1746065199.034636:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba3100 00000100:00100000:2.0:1746065199.034643:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2615 00000100:00100000:2.0:1746065199.034647:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263415936:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065199.036196:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8662 00000100:00100000:1.0:1746065199.036207:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263416320:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065199.036303:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263416320:12345-192.168.202.46@tcp:3:cat.0 Request processed in 99us (2997us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065199.036307:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8662 00002000:00100000:1.0:1746065199.036313:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (5009408->5013503) req@ffff88008fc5a300 x1830881263416320/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.036320:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc5a300 with x1830881263416320 ext(5009408->5013503) 00002000:00010000:1.0:1746065199.036323:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc5a300 00000100:00100000:1.0:1746065199.036334:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8663 00000100:00100000:1.0:1746065199.036338:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263416832:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065199.036385:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263416832:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 47us (2357us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065199.036389:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8663 00002000:00100000:1.0:1746065199.036392:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x387:0x0] (1683456->1687551) req@ffff880093ba3100 x1830881263416832/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.036398:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ba3100 with x1830881263416832 ext(1683456->1687551) 00002000:00010000:1.0:1746065199.036400:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ba3100 00000100:00100000:3.0:1746065199.039227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.039554:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417088 00000100:00100000:0.0:1746065199.039562:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417088 00000100:00100000:0.0:1746065199.039599:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4396 00000100:00100000:0.0:1746065199.039607:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:32202:x1830881263417088:12345-192.168.202.46@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065199.039786:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:32202:x1830881263417088:12345-192.168.202.46@tcp:35:mirror_io.0 Request processed in 179us (565us total) trans 8589944453 rc 0/0 00000100:00100000:0.0:1746065199.039793:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4396 00000100:00100000:2.0:1746065199.050167:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263415936:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 15510us (17746us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065199.050176:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2615 00002000:00100000:2.0:1746065199.050186:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88008fc59180 x1830881263415936/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.050194:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc59180 with x1830881263415936 ext(1048576->2097151) 00010000:00010000:2.0:1746065199.050206:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.050223:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 898 lvb_type: 1 00002000:00010000:2.0:1746065199.050230:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fc59180 00000100:00100000:0.0:1746065199.064200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.064239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.064268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.064348:0:7079:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417216 00000100:00100000:2.0:1746065199.064356:0:7079:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417216 00010000:00010000:2.0:1746065199.064388:0:7079:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.064414:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7940 00000100:00100000:2.0:1746065199.064421:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263417216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.064432:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065199.064450:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.064460:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.064480:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cbee00/0x14b4f8542d4fef58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dcb expref: 33 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.064510:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.064512:0:7079:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.064518:0:7079:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.064529:0:7079:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.064557:0:7079:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065199.064568:0:7079:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260487808:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065199.064634:0:7079:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.064797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.064900:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417472 00000100:00100000:3.0:1746065199.064903:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417472 00002000:00100000:3.0:1746065199.064930:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800a5880380 x1830881263417472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.064938:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880380 with x1830881263417472 ext(1048576->2097151) 00002000:00010000:3.0:1746065199.064942:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880380 00000100:00100000:3.0:1746065199.064954:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8664 00000100:00100000:3.0:1746065199.064959:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263417472:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065199.066705:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417600 00000100:00100000:1.0:1746065199.066713:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417600 00000100:00100000:1.0:1746065199.066743:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15388 00000100:00100000:1.0:1746065199.066750:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:32194:x1830881263417600:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065199.066762:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.066777:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e5e expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.066798:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.066804:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065199.066806:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065199.066809:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->1560575] (req 1048576->1560575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 34 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.066847:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 12 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.066857:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 12 pid: 2462 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065199.066867:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260487936:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.066920:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.070214:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263417856 00000100:00100000:2.0:1746065199.070226:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263417856 00000100:00100000:2.0:1746065199.070282:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4397 00000100:00100000:2.0:1746065199.070289:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+7:32198:x1830881263417856:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065199.070460:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+8:32198:x1830881263417856:12345-192.168.202.46@tcp:35:cat.0 Request processed in 171us (5662us total) trans 8589944454 rc 0/0 00000100:00100000:2.0:1746065199.070466:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4397 00000100:00100000:1.0:1746065199.073429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.073493:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418112 00000100:00100000:3.0:1746065199.073501:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418112 00002000:00100000:3.0:1746065199.073530:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1327104->1331199) req@ffff88009b82fb80 x1830881263418112/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.073539:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82fb80 with x1830881263418112 ext(1327104->1331199) 00010000:00010000:3.0:1746065199.073546:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 13 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.073558:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 13 pid: 2462 timeout: 898 lvb_type: 0 00002000:00010000:3.0:1746065199.073565:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b82fb80 00000100:00100000:0.0:1746065199.074457:0:7079:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7079:1830881260487808:192.168.202.46@tcp:105: 00010000:00010000:0.0:1746065199.074475:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.074511:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263417216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 10090us (10319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.074520:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7940 00000100:00100000:3.0:1746065199.074990:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2616 00000100:00100000:3.0:1746065199.074999:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263418112:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.075127:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263418112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 129us (1704us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065199.075132:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2616 00002000:00100000:3.0:1746065199.075137:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1327104->1331199) req@ffff88009b82fb80 x1830881263418112/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.075145:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82fb80 with x1830881263418112 ext(1327104->1331199) 00010000:00010000:3.0:1746065199.075150:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 13 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.075160:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 13 pid: 2462 timeout: 898 lvb_type: 0 00002000:00010000:3.0:1746065199.075165:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b82fb80 00000100:00100000:1.0:1746065199.076236:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260487936:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.076255:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->1560575] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 33 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.076268:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb18a00, rc 0) 00000100:00100000:1.0:1746065199.076291:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:32194:x1830881263417600:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 9541us (12022us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.076298:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15388 00000100:00100000:2.0:1746065199.076600:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263417472:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 11638us (12358us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065199.076609:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8664 00002000:00100000:2.0:1746065199.076615:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff8800a5880380 x1830881263417472/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.076621:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5880380 with x1830881263417472 ext(1048576->2097151) 00002000:00010000:2.0:1746065199.076625:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5880380 00000100:00100000:0.0:1746065199.084425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.084478:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.084691:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418368 00000100:00100000:2.0:1746065199.084701:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418368 00002000:00100000:2.0:1746065199.084737:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1327104->2097151) req@ffff8800a5882d80 x1830881263418368/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.084745:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881263418368 ext(1327104->2097151) 00010000:00010000:2.0:1746065199.084754:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 13 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.084766:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 13 pid: 2462 timeout: 898 lvb_type: 0 00002000:00010000:2.0:1746065199.084772:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5882d80 00000100:00100000:2.0:1746065199.084802:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2617 00000100:00100000:2.0:1746065199.084809:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+13:1959:x1830881263418368:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065199.085480:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418496 00000100:00100000:1.0:1746065199.085485:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418496 00000100:00100000:1.0:1746065199.085510:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15389 00000100:00100000:1.0:1746065199.085515:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+17:32195:x1830881263418496:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065199.085525:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.085538:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e65 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.085558:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.085565:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.085572:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 20 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.085578:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.085580:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.085583:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 18 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.085607:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 20 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.085621:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 20 pid: 8428 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.085632:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488064:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.085727:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.085736:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.085744:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488192:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.085768:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.085776:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.085783:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488320:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.085799:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065199.087356:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488064:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.093280:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.093298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.093301:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488192:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.093309:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.093312:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488320:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.093319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065199.093340:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 18 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065199.093349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065199.093354:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb19c00, rc 0) 00000100:00100000:1.0:1746065199.093984:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+18:32195:x1830881263418496:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8468us (9505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.093992:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15389 00000100:00100000:1.0:1746065199.094013:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418880 00000100:00100000:1.0:1746065199.094017:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418880 00000100:00100000:1.0:1746065199.094036:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419008 00000100:00100000:1.0:1746065199.094038:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419008 00000100:00100000:1.0:1746065199.094062:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15390 00000100:00100000:1.0:1746065199.094067:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263418880:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065199.094079:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.094090:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb19000/0x14b4f8542d4ff02a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e6c expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.094123:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260488448:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065199.094162:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065199.094174:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418624 00000100:00100000:1.0:1746065199.094176:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418624 00010000:00010000:1.0:1746065199.094188:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 9 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.094200:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263418752 00000100:00100000:1.0:1746065199.094202:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263418752 00010000:00010000:1.0:1746065199.094208:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 22 pid: 8428 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.094220:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419136 00000100:00100000:1.0:1746065199.094222:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419136 00010000:00010000:1.0:1746065199.094228:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.094239:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7941 00000100:00100000:1.0:1746065199.094243:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1958:x1830881263418624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065199.094251:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065199.094268:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 9 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.094277:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 9 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.094293:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b264200/0x14b4f8542d4fefcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e26 expref: 9 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.094305:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065199.094317:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7942 00000100:00100000:1.0:1746065199.094319:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1958:x1830881263418624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 76us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.094323:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263418752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065199.094323:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7941 00010000:00010000:2.0:1746065199.094330:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065199.094333:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7943 00000100:00100000:1.0:1746065199.094337:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881263419136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.094339:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 22 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.094341:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065199.094347:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 22 pid: 8428 timeout: 898 lvb_type: 1 00000100:00100000:3.0:1746065199.094499:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15391 00000100:00100000:3.0:1746065199.094507:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263419008:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065199.094514:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065199.094521:0:8429:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a0fc800/0x14b4f8542d4ff031 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e73 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.095722:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.095733:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.096188:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ce00/0x14b4f8542d4feef6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d9a expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.096202:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065199.096299:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263419136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1903us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.096309:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7943 00010000:00010000:2.0:1746065199.096536:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cbec00/0x14b4f8542d4fef5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd2 expref: 23 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.096547:0:8429:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.096557:0:8429:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a0fc800/0x14b4f8542d4ff031 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e73 expref: 22 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.096561:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.096562:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.096568:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.096575:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.096585:0:8429:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0fc800/0x14b4f8542d4ff031 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e73 expref: 22 pid: 8429 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.096601:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065199.096610:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260488576:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065199.096614:0:8429:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0fc800, rc 0) 00000100:00100000:3.0:1746065199.096635:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263419008:12345-192.168.202.46@tcp:101:cat.0 Request processed in 2129us (3314us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065199.096641:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15391 00000100:00100000:2.0:1746065199.096657:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00002000:00010000:1.0:1746065199.101373:0:2462:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime: 1746065198 -> 1746065200 00002000:00010000:1.0:1746065199.101381:0:2462:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime: 1746065198 -> 1746065200 00002000:00010000:1.0:1746065199.101383:0:2462:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime: 1746065198 -> 1746065200 00000100:00100000:2.0:1746065199.101401:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260488576:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065199.101401:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260488448:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065199.101416:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065199.101453:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263418752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7130us (8142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.101461:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7942 00000100:00100000:0.0:1746065199.101812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065199.102048:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb19000/0x14b4f8542d4ff02a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e6c expref: 34 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.102063:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb19000/0x14b4f8542d4ff02a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e6c expref: 34 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.102072:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb19000, rc 0) 00000100:00100000:1.0:1746065199.102097:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263418880:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8029us (8797us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.102103:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15390 00000100:00100000:0.0:1746065199.102245:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419392 00000100:00100000:0.0:1746065199.102251:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419392 00002000:00100000:0.0:1746065199.102278:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1212416->1216511) req@ffff8800a5881880 x1830881263419392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.102286:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881880 with x1830881263419392 ext(1212416->1216511) 00002000:00010000:0.0:1746065199.102290:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5881880 00000100:00100000:0.0:1746065199.102302:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8665 00000100:00100000:0.0:1746065199.102307:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263419392:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065199.103884:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263419392:12345-192.168.202.46@tcp:3:cat.0 Request processed in 1571us (2067us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065199.103891:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8665 00002000:00100000:0.0:1746065199.103898:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1212416->1216511) req@ffff8800a5881880 x1830881263419392/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.103906:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5881880 with x1830881263419392 ext(1212416->1216511) 00002000:00010000:0.0:1746065199.103910:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5881880 00000100:00100000:2.0:1746065199.104764:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:26bbd020-9fba-464a-bebc-8395a287959e+15:1959:x1830881263418368:12345-192.168.202.46@tcp:4:cat.0 Request processed in 19954us (20346us total) trans 17179873763 rc 0/0 00000100:00100000:2.0:1746065199.104773:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2617 00002000:00100000:2.0:1746065199.104779:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x388:0x0] (1327104->2097151) req@ffff8800a5882d80 x1830881263418368/t17179873763(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.104787:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5882d80 with x1830881263418368 ext(1327104->2097151) 00010000:00010000:2.0:1746065199.104794:0:21487:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 15 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.104806:0:21487:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 15 pid: 2462 timeout: 898 lvb_type: 0 00002000:00010000:2.0:1746065199.104812:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5882d80 00000100:00100000:0.0:1746065199.107337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.108113:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419648 00000100:00100000:1.0:1746065199.108120:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419648 00000100:00100000:1.0:1746065199.108163:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4398 00000100:00100000:1.0:1746065199.108169:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+8:32195:x1830881263419648:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:0.0:1746065199.108323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.109185:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263419776 00000100:00100000:3.0:1746065199.109189:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263419776 00010000:00010000:3.0:1746065199.109208:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 15 pid: 2462 timeout: 898 lvb_type: 0 00000100:00100000:3.0:1746065199.109238:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7944 00000100:00100000:3.0:1746065199.109244:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263419776:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.109252:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065199.109268:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 15 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.109277:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 15 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.109294:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd600/0x14b4f8542d4ff000 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e50 expref: 15 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.109307:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.109309:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.109314:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.109326:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.109349:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 32 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065199.109357:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260488704:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065199.109525:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+9:32195:x1830881263419648:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1355us (2193us total) trans 8589944455 rc 0/0 00000100:00100000:1.0:1746065199.109531:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4398 00000100:00100000:3.0:1746065199.109885:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065199.112289:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260488704:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065199.112309:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.112349:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263419776:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3104us (4024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.112359:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7944 00000100:00100000:0.0:1746065199.120068:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.120111:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420288 00000100:00100000:0.0:1746065199.120111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.120119:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420288 00000100:00100000:0.0:1746065199.120127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.120142:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420160 00002000:00100000:2.0:1746065199.120157:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009fcaf480 x1830881263420288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.120167:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaf480 with x1830881263420288 ext(3145728->4194303) 00002000:00010000:2.0:1746065199.120173:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fcaf480 00000100:00100000:2.0:1746065199.120199:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420672 00000100:00100000:2.0:1746065199.120201:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420672 00002000:00100000:2.0:1746065199.120211:0:21487:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012b45dc00 x1830881263420672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.120217:0:21487:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45dc00 with x1830881263420672 ext(2097152->3145727) 00002000:00010000:2.0:1746065199.120219:0:21487:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45dc00 00000100:00100000:2.0:1746065199.120235:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8666 00000100:00100000:2.0:1746065199.120241:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263420288:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065199.120342:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420160 00002000:00100000:0.0:1746065199.120360:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880095354000 x1830881263420160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.120368:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354000 with x1830881263420160 ext(2097152->3145727) 00002000:00010000:0.0:1746065199.120371:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095354000 00000100:00100000:0.0:1746065199.120383:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8667 00000100:00100000:0.0:1746065199.120388:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1960:x1830881263420672:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.120488:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8668 00000100:00100000:3.0:1746065199.120498:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263420160:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065199.121171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.121214:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263420800 00000100:00100000:1.0:1746065199.121218:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263420800 00002000:00100000:1.0:1746065199.121234:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45ca80 x1830881263420800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.121241:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ca80 with x1830881263420800 ext(3145728->4194303) 00002000:00010000:1.0:1746065199.121244:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ca80 00000100:00100000:1.0:1746065199.121254:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8669 00000100:00100000:1.0:1746065199.121259:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+34:1961:x1830881263420800:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065199.121418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.122125:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421184 00000100:00100000:1.0:1746065199.122130:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421184 00002000:00100000:1.0:1746065199.122146:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x388:0x0] (1556480->1560575) req@ffff88012b45d500 x1830881263421184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.122153:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d500 with x1830881263421184 ext(1556480->1560575) 00002000:00010000:1.0:1746065199.122157:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45d500 00000100:00100000:1.0:1746065199.122174:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8670 00000100:00100000:1.0:1746065199.122180:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263421184:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065199.122285:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263421184:12345-192.168.202.46@tcp:3:cat.0 Request processed in 104us (866us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065199.122294:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8670 00002000:00100000:1.0:1746065199.122311:0:4012:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x388:0x0] (1556480->1560575) req@ffff88012b45d500 x1830881263421184/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.122318:0:4012:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45d500 with x1830881263421184 ext(1556480->1560575) 00002000:00010000:1.0:1746065199.122321:0:4012:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45d500 00000100:00100000:3.0:1746065199.127977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.129272:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421440 00000100:00100000:1.0:1746065199.129281:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421440 00000100:00100000:1.0:1746065199.129332:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4399 00000100:00100000:1.0:1746065199.129340:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32194:x1830881263421440:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065199.129503:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32194:x1830881263421440:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 164us (1534us total) trans 8589944456 rc 0/0 00000100:00100000:1.0:1746065199.129508:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4399 00000100:00100000:2.0:1746065199.155506:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263420672:12345-192.168.202.46@tcp:3:cat.0 Request processed in 35107us (35368us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065199.155521:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8667 00002000:00100000:2.0:1746065199.155531:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88012b45dc00 x1830881263420672/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.155540:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45dc00 with x1830881263420672 ext(2097152->3145727) 00002000:00010000:2.0:1746065199.155545:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45dc00 00000100:00100000:1.0:1746065199.159932:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263420800:12345-192.168.202.46@tcp:3:cat.0 Request processed in 38663us (38752us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065199.159943:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8669 00002000:00100000:1.0:1746065199.159953:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88012b45ca80 x1830881263420800/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.159962:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ca80 with x1830881263420800 ext(3145728->4194303) 00002000:00010000:1.0:1746065199.159967:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45ca80 00000100:00100000:3.0:1746065199.161514:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263420160:12345-192.168.202.46@tcp:3:cat.0 Request processed in 41015us (41397us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.161523:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8668 00002000:00100000:3.0:1746065199.161531:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff880095354000 x1830881263420160/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.161538:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095354000 with x1830881263420160 ext(2097152->3145727) 00002000:00010000:3.0:1746065199.161542:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095354000 00000100:00100000:1.0:1746065199.169952:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1961:x1830881263420288:12345-192.168.202.46@tcp:3:cat.0 Request processed in 49703us (50054us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065199.169962:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8666 00002000:00100000:1.0:1746065199.169971:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009fcaf480 x1830881263420288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.169981:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fcaf480 with x1830881263420288 ext(3145728->4194303) 00002000:00010000:1.0:1746065199.169986:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fcaf480 00000100:00100000:0.0:1746065199.176235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.176394:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421568 00000100:00100000:1.0:1746065199.176400:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421568 00000100:00100000:1.0:1746065199.176445:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15392 00000100:00100000:1.0:1746065199.176451:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263421568:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065199.176465:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.176478:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff038 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e7a expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.176518:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488832:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065199.177770:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00002000:00010000:1.0:1746065199.180012:0:2462:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime: 1746065199 -> 1746065200 00002000:00010000:1.0:1746065199.180016:0:2462:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime: 1746065195 -> 1746065200 00002000:00010000:1.0:1746065199.180018:0:2462:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime: 1746065199 -> 1746065200 00000100:00100000:1.0:1746065199.180038:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488832:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065199.180064:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff038 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e7a expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.180075:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff038 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e7a expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.182319:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fafce00, rc 0) 00000100:00100000:1.0:1746065199.182454:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263421568:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5999us (6222us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.182466:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15392 00000100:00100000:0.0:1746065199.193286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.193522:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421824 00000100:00100000:1.0:1746065199.193530:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421824 00002000:00100000:1.0:1746065199.193566:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88012b45c000 x1830881263421824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.193575:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c000 with x1830881263421824 ext(4194304->5013503) 00002000:00010000:1.0:1746065199.193580:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45c000 00000100:00100000:1.0:1746065199.193613:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8671 00000100:00100000:1.0:1746065199.193620:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263421824:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065199.204197:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263421824:12345-192.168.202.46@tcp:3:cat.0 Request processed in 10569us (10910us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746065199.204208:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8671 00002000:00100000:1.0:1746065199.204217:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88012b45c000 x1830881263421824/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.204225:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c000 with x1830881263421824 ext(4194304->5013503) 00002000:00010000:1.0:1746065199.204230:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45c000 00000100:00100000:0.0:1746065199.213756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.214753:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263421952 00000100:00100000:1.0:1746065199.214761:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263421952 00000100:00100000:1.0:1746065199.214806:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15393 00000100:00100000:1.0:1746065199.214824:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263421952:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065199.214838:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.214851:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fafc200/0x14b4f8542d4ff03f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e81 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.214898:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488960:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065199.214984:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065199.222414:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260488960:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065199.222445:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fafc200/0x14b4f8542d4ff03f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e81 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.222457:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fafc200/0x14b4f8542d4ff03f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e81 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.222479:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fafc200, rc 0) 00000100:00100000:1.0:1746065199.222516:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1958:x1830881263421952:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7703us (8765us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.222522:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15393 00000100:00100000:0.0:1746065199.229673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.232038:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.232330:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422080 00000100:00100000:1.0:1746065199.232341:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422080 00000100:00100000:2.0:1746065199.232374:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422208 00000100:00100000:2.0:1746065199.232378:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422208 00000100:00100000:1.0:1746065199.232386:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15394 00000100:00100000:1.0:1746065199.232393:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263422080:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065199.232403:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746065199.232407:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1683456->2097151) req@ffff88012b45c700 x1830881263422208/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065199.232416:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fafc000/0x14b4f8542d4ff046 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e88 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065199.232417:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c700 with x1830881263422208 ext(1683456->2097151) 00002000:00010000:2.0:1746065199.232422:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45c700 00000100:00100000:2.0:1746065199.232435:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8672 00000100:00100000:2.0:1746065199.232441:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+33:1961:x1830881263422208:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065199.232460:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260489088:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065199.232527:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065199.234247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.235017:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422336 00000100:00100000:2.0:1746065199.235024:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422336 00002000:00100000:2.0:1746065199.235056:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1048576->1560575) req@ffff88009b82e300 x1830881263422336/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.235064:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82e300 with x1830881263422336 ext(1048576->1560575) 00002000:00010000:2.0:1746065199.235069:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82e300 00000100:00100000:2.0:1746065199.235094:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8673 00000100:00100000:2.0:1746065199.235101:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263422336:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:1.0:1746065199.237417:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260489088:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065199.237446:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fafc000/0x14b4f8542d4ff046 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e88 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.237458:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fafc000/0x14b4f8542d4ff046 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e88 expref: 21 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.237485:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fafc000, rc 0) 00000100:00100000:1.0:1746065199.237517:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263422080:12345-192.168.202.46@tcp:101:cat.0 Request processed in 5124us (7860us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.237523:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15394 00000100:00100000:2.0:1746065199.243806:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263422208:12345-192.168.202.46@tcp:4:cat.0 Request processed in 11356us (11766us total) trans 17179873764 rc 0/0 00000100:00100000:2.0:1746065199.243840:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8672 00002000:00100000:2.0:1746065199.243849:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1683456->2097151) req@ffff88012b45c700 x1830881263422208/t17179873764(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.243858:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45c700 with x1830881263422208 ext(1683456->2097151) 00002000:00010000:2.0:1746065199.243863:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45c700 00000100:00100000:0.0:1746065199.247846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.248196:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422592 00000100:00100000:1.0:1746065199.248203:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422592 00000100:00100000:1.0:1746065199.248244:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4400 00000100:00100000:1.0:1746065199.248252:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b87b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32201:x1830881263422592:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065199.248424:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b87b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32201:x1830881263422592:12345-192.168.202.46@tcp:35:cat.0 Request processed in 172us (586us total) trans 8589944457 rc 0/0 00000100:00100000:1.0:1746065199.248431:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4400 00000100:00100000:3.0:1746065199.248648:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263422336:12345-192.168.202.46@tcp:4:cat.0 Request processed in 13546us (14404us total) trans 17179873765 rc 0/0 00000100:00100000:3.0:1746065199.248656:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8673 00002000:00100000:3.0:1746065199.248674:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x388:0x0] (1048576->1560575) req@ffff88009b82e300 x1830881263422336/t17179873765(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.248683:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b82e300 with x1830881263422336 ext(1048576->1560575) 00002000:00010000:3.0:1746065199.248687:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b82e300 00000100:00100000:0.0:1746065199.265793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.266365:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422848 00000100:00100000:2.0:1746065199.266372:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422848 00000100:00100000:2.0:1746065199.266422:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10164 00000100:00100000:2.0:1746065199.266429:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32209:x1830881263422848:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065199.266447:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.266462:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18600/0x14b4f8542d4ff04d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e8f expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.266546:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266556:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266564:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266574:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266578:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266583:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266682:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266689:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266695:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065199.266702:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065199.266769:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266775:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266779:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266784:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb19200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065199.266787:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266793:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266802:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065199.266804:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065199.266808:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266813:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19200/0x14b4f8542d4ff054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266857:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266862:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266865:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266869:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb18400 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065199.266871:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266875:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266881:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5a36e00) 00010000:00010000:2.0:1746065199.266883:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065199.266885:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266888:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18400/0x14b4f8542d4ff05b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.266921:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb18600/0x14b4f8542d4ff04d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 254 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.266931:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.266936:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065199.266939:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065199.266940:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb19800, rc 0) 00000100:00100000:2.0:1746065199.266982:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32209:x1830881263422848:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 554us (1195us total) trans 8589944458 rc 0/0 00000100:00100000:2.0:1746065199.266988:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10164 00000100:00100000:0.0:1746065199.298486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.298570:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263422976 00000100:00100000:1.0:1746065199.298578:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263422976 00000100:00100000:1.0:1746065199.298863:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15395 00000100:00100000:1.0:1746065199.298871:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:32209:x1830881263422976:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065199.298885:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.298898:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e96 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.298926:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.298933:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.298939:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 38 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.298944:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.298945:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.298948:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3260416->3686399] (req 3260416->3686399) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 38 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.298971:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 38 pid: 2463 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.298980:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 38 pid: 2463 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.298991:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260489216:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.299996:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.300067:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 6 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.300077:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260489344:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.300482:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 13 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.300555:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 13 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.300603:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260489472:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.301428:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065199.303645:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260489216:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.306162:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260489344:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.306841:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:2462:1830881260489472:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.306869:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [3260416->3686399] (req 3260416->3686399) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 38 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.306884:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fafc600, rc 0) 00000100:00100000:1.0:1746065199.307168:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:32209:x1830881263422976:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8296us (8687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.307175:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15395 00000100:00100000:0.0:1746065199.308388:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.308770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.308860:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423104 00000100:00100000:3.0:1746065199.308869:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423104 00010000:00010000:3.0:1746065199.308899:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.308957:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423232 00000100:00100000:1.0:1746065199.308960:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423232 00010000:00010000:1.0:1746065199.308972:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.308992:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7945 00000100:00100000:1.0:1746065199.308998:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1958:x1830881263423104:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065199.309142:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7946 00000100:00100000:0.0:1746065199.309148:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+14:1958:x1830881263423232:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.309159:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.309177:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.309187:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.309206:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb5d400/0x14b4f8542d4fef04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da8 expref: 14 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.309223:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.309248:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+13:1958:x1830881263423232:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 101us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.309253:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7946 00010000:00010000:1.0:1746065199.309459:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065199.309470:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.309478:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.309488:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b264400/0x14b4f8542d4fefdd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e34 expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.309769:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065199.309788:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1958:x1830881263423104:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 789us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.309793:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7945 00000100:00100000:1.0:1746065199.311484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.311698:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423360 00000100:00100000:0.0:1746065199.311706:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423360 00010000:00010000:0.0:1746065199.311729:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 38 pid: 2463 timeout: 898 lvb_type: 1 00000100:00100000:3.0:1746065199.312476:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7947 00000100:00100000:3.0:1746065199.312485:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263423360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.312496:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065199.312514:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 38 pid: 2463 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.312525:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 38 pid: 2463 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.312541:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cbe400/0x14b4f8542d4fef6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de0 expref: 38 pid: 2463 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.312563:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.312565:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.312571:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.312578:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.312604:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065199.312614:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260489600:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065199.312685:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.314472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.314603:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423616 00000100:00100000:1.0:1746065199.314610:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423616 00000100:00100000:1.0:1746065199.314642:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10165 00000100:00100000:1.0:1746065199.314648:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:32212:x1830881263423616:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065199.314675:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.314687:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61e9d expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.314764:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.314772:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.314779:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.314788:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.314793:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.314797:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.314894:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.314901:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.314905:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:3.0:1746065199.315131:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260489600:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065199.315145:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.315178:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263423360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2694us (3696us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.315185:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7947 00000004:00200000:1.0:1746065199.316264:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065199.316343:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316349:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316358:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316363:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fafdc00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065199.316366:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316372:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316382:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065199.316384:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065199.316387:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316391:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafdc00/0x14b4f8542d4ff07e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316411:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316416:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316420:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316424:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fafca00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065199.316426:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316430:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316439:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205500) 00010000:00010000:1.0:1746065199.316440:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065199.316442:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316446:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff085 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.316480:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.316490:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 11 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.316495:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065199.316497:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065199.316499:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fafce00, rc 0) 00000100:00100000:1.0:1746065199.316538:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:32212:x1830881263423616:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1890us (2069us total) trans 8589944459 rc 0/0 00000100:00100000:1.0:1746065199.316544:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10165 00000100:00100000:0.0:1746065199.316623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.316703:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263423872 00000100:00100000:0.0:1746065199.316707:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263423872 00002000:00100000:0.0:1746065199.316732:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (3260416->3264511) req@ffff880094ff7800 x1830881263423872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.316740:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7800 with x1830881263423872 ext(3260416->3264511) 00002000:00010000:0.0:1746065199.316743:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff7800 00000100:00100000:0.0:1746065199.316757:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8674 00000100:00100000:0.0:1746065199.316762:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263423872:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065199.316895:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263423872:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 131us (271us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065199.316900:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8674 00002000:00100000:0.0:1746065199.316904:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (3260416->3264511) req@ffff880094ff7800 x1830881263423872/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.316910:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7800 with x1830881263423872 ext(3260416->3264511) 00002000:00010000:0.0:1746065199.316913:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff7800 00000100:00100000:0.0:1746065199.322519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.323669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.323697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.323717:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424000 00000100:00100000:0.0:1746065199.323724:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424000 00000100:00100000:0.0:1746065199.323755:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424128 00000100:00100000:0.0:1746065199.323757:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424128 00000100:00100000:0.0:1746065199.323766:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424256 00000100:00100000:0.0:1746065199.323768:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424256 00000100:00100000:0.0:1746065199.323781:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15396 00000100:00100000:0.0:1746065199.323788:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263424000:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065199.323803:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.323830:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4ff09a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ea4 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.323875:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260489728:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065199.323949:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.323969:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15397 00000100:00100000:0.0:1746065199.323975:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263424128:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065199.323981:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.323988:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4ff0a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61eab expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.324009:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260489856:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065199.324028:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.324042:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15398 00000100:00100000:0.0:1746065199.324047:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263424256:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065199.324052:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.324059:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4ff0a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61eb2 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.324075:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260489984:192.168.202.46@tcp:106: 00000100:00100000:0.0:1746065199.324091:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.324125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.324141:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424512 00000100:00100000:0.0:1746065199.324144:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424512 00002000:00100000:0.0:1746065199.324163:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x389:0x0] (3682304->3686399) req@ffff880094ff7b80 x1830881263424512/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.324170:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7b80 with x1830881263424512 ext(3682304->3686399) 00002000:00010000:0.0:1746065199.324174:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff7b80 00000100:00100000:0.0:1746065199.324190:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8675 00000100:00100000:0.0:1746065199.324195:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263424512:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:0.0:1746065199.326144:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263424512:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 1942us (2011us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065199.326158:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8675 00002000:00100000:0.0:1746065199.326167:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x389:0x0] (3682304->3686399) req@ffff880094ff7b80 x1830881263424512/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.326174:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff7b80 with x1830881263424512 ext(3682304->3686399) 00002000:00010000:0.0:1746065199.326178:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff7b80 00002000:00010000:2.0:1746065199.329168:0:25185:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime: 1746065198 -> 1746065200 00002000:00010000:2.0:1746065199.329175:0:25185:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime: 1746065195 -> 1746065200 00002000:00010000:2.0:1746065199.329177:0:25185:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime: 1746065198 -> 1746065200 00000100:00100000:2.0:1746065199.329196:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260489728:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065199.329222:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4ff09a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ea4 expref: 18 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.329234:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cbb000/0x14b4f8542d4ff09a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ea4 expref: 18 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.329254:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cbb000, rc 0) 00000100:00100000:1.0:1746065199.329947:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260489856:192.168.202.46@tcp:106: 00010000:00010000:1.0:1746065199.329965:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4ff0a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eab expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.329973:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ed4400/0x14b4f8542d4ff0a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eab expref: 17 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.329988:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4400, rc 0) 00000100:00100000:2.0:1746065199.330806:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263424000:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7015us (8291us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065199.330824:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15396 00000100:00100000:1.0:1746065199.332155:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263424128:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8175us (8491us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.332161:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15397 00000100:00100000:1.0:1746065199.332278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.332298:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263424768 00000100:00100000:1.0:1746065199.332303:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263424768 00000100:00100000:1.0:1746065199.332331:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4401 00000100:00100000:1.0:1746065199.332336:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32209:x1830881263424768:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:1.0:1746065199.332479:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:32209:x1830881263424768:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 142us (200us total) trans 8589944460 rc 0/0 00000100:00100000:1.0:1746065199.332484:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4401 00002000:00010000:0.0:1746065199.332703:0:9716:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime: 1746065199 -> 1746065200 00002000:00010000:0.0:1746065199.332707:0:9716:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime: 1746065197 -> 1746065200 00002000:00010000:0.0:1746065199.332709:0:9716:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime: 1746065199 -> 1746065200 00000100:00100000:0.0:1746065199.332721:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260489984:192.168.202.46@tcp:106: 00010000:00010000:0.0:1746065199.332741:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4ff0a8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eb2 expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.332750:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c733c00/0x14b4f8542d4ff0a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eb2 expref: 14 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.332760:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c733c00, rc 0) 00000100:00100000:0.0:1746065199.332776:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:1961:x1830881263424256:12345-192.168.202.46@tcp:101:cat.0 Request processed in 8728us (9077us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.332781:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15398 00000100:00100000:0.0:1746065199.338641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.339180:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425024 00000100:00100000:2.0:1746065199.339188:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425024 00002000:00100000:2.0:1746065199.339222:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880094ff4a80 x1830881263425024/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.339232:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4a80 with x1830881263425024 ext(0->1048575) 00002000:00010000:2.0:1746065199.339236:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff4a80 00000100:00100000:2.0:1746065199.339259:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8676 00000100:00100000:2.0:1746065199.339266:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263425024:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065199.353750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.354149:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425280 00000100:00100000:1.0:1746065199.354157:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425280 00000100:00100000:1.0:1746065199.355234:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10166 00000100:00100000:1.0:1746065199.355247:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+11:32214:x1830881263425280:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:1.0:1746065199.355263:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.355278:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbec00/0x14b4f8542d4ff0af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61eb9 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.355346:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.355358:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.355367:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.355372:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.355395:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.355404:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 12 pid: 14645 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065199.355413:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260490112:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065199.355491:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 253 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.355497:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 253 pid: 14644 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065199.355504:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260490240:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.355522:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065199.357244:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263425024:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17973us (18604us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.357253:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8676 00002000:00100000:3.0:1746065199.357264:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff880094ff4a80 x1830881263425024/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.357272:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff4a80 with x1830881263425024 ext(0->1048575) 00002000:00010000:3.0:1746065199.357277:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094ff4a80 00000100:00100000:2.0:1746065199.363231:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b82ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260490112:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.363243:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260490240:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.363266:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065199.365495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.365556:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425408 00000100:00100000:3.0:1746065199.365564:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425408 00000100:00100000:0.0:1746065199.365576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.365626:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425536 00000100:00100000:1.0:1746065199.365630:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425536 00010000:00010000:1.0:1746065199.365856:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 254 pid: 14644 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065199.365884:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7948 00000100:00100000:1.0:1746065199.365891:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+254:1960:x1830881263425536:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065199.365902:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065199.365906:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 254 pid: 14644 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.365915:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 254 pid: 14644 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.365933:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb19800/0x14b4f8542d4ff062 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e8f expref: 254 pid: 14644 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.365948:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065199.365952:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.365959:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065199.365963:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065199.365996:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:1960:x1830881263425536:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 106us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.366001:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7948 00010000:00010000:3.0:1746065199.366103:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 13 pid: 14645 timeout: 898 lvb_type: 0 00000100:00100000:3.0:1746065199.366121:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7949 00000100:00100000:3.0:1746065199.366126:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:1960:x1830881263425408:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.366133:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065199.366136:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 13 pid: 14645 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.366144:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 13 pid: 14645 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.366154:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafce00/0x14b4f8542d4ff08c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e9d expref: 13 pid: 14645 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.366759:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065199.366763:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065199.366769:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065199.366775:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065199.367764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.367785:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425664 00000100:00100000:0.0:1746065199.367791:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425664 00000100:00100000:0.0:1746065199.367833:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15399 00000100:00100000:0.0:1746065199.367838:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+13:32212:x1830881263425664:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065199.367851:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.367863:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ec0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.367882:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.367887:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065199.367888:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065199.367891:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.367909:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 36 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.367919:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 36 pid: 25185 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746065199.367929:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260490368:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065199.367973:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800945eb6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065199.368900:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.368937:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:1960:x1830881263425408:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2810us (3446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.368945:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7949 00010000:00010000:2.0:1746065199.369052:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.369058:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:2.0:1746065199.369074:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065199.369188:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbec00/0x14b4f8542d4ff0af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eb9 expref: 13 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.369218:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eb9 expref: 12 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.369225:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065199.369227:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065199.369229:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cbe400, rc 0) 00000100:00100000:2.0:1746065199.369251:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+12:32214:x1830881263425280:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 14010us (15510us total) trans 8589944461 rc 0/0 00000100:00100000:2.0:1746065199.369257:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10166 00000100:00100000:0.0:1746065199.371361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.371439:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263425792 00000100:00100000:1.0:1746065199.371445:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263425792 00010000:00010000:1.0:1746065199.371469:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 37 pid: 25185 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065199.371513:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7950 00000100:00100000:1.0:1746065199.371519:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263425792:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065199.371530:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065199.371548:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 37 pid: 25185 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.371558:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 37 pid: 25185 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.371575:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.371577:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.371582:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.371588:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.371611:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.371626:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260490496:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065199.371795:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013548c000/0x14b4f8542d4fefe4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1683456->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e3b expref: 37 pid: 25185 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065199.371811:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260490368:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.371856:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.371863:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930cc400, rc 0) 00000100:00100000:1.0:1746065199.372468:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.372518:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+14:32212:x1830881263425664:12345-192.168.202.46@tcp:101:cat.0 Request processed in 4678us (4754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.372524:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15399 00000100:00100000:1.0:1746065199.375404:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260490496:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065199.375423:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065199.375532:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1960:x1830881263425792:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 4010us (4173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.375541:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7950 00000100:00100000:0.0:1746065199.377506:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.377909:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426048 00000100:00100000:3.0:1746065199.377916:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426048 00002000:00100000:3.0:1746065199.377952:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880094ff5180 x1830881263426048/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.377960:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff5180 with x1830881263426048 ext(1048576->2097151) 00002000:00010000:3.0:1746065199.377964:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff5180 00000100:00100000:3.0:1746065199.377993:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8677 00000100:00100000:3.0:1746065199.377999:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263426048:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.389786:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+14:1961:x1830881263426048:12345-192.168.202.46@tcp:3:cat.0 Request processed in 11777us (12275us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.389798:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8677 00002000:00100000:3.0:1746065199.389808:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff880094ff5180 x1830881263426048/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.389843:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094ff5180 with x1830881263426048 ext(1048576->2097151) 00002000:00010000:3.0:1746065199.389848:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094ff5180 00000100:00100000:0.0:1746065199.394246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.394312:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426176 00000100:00100000:2.0:1746065199.394321:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426176 00000100:00100000:2.0:1746065199.394368:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15400 00000100:00100000:2.0:1746065199.394375:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:32214:x1830881263426176:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065199.394391:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.394404:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ec7 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.394429:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.394437:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.394444:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.394453:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.394455:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.394458:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 6/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3874816->4116479] (req 3874816->4116479) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.394481:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 19 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.394491:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 19 pid: 8428 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.394501:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260490624:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.395389:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 7 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.395399:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.395408:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260490752:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.395435:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 18 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.395443:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.395456:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260490880:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.395469:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.399545:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260490624:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.399556:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260490752:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.399562:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260490880:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.399588:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [3874816->4116479] (req 3874816->4116479) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 18 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.399602:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb18c00, rc 0) 00000100:00100000:2.0:1746065199.399638:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+18:32214:x1830881263426176:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 5262us (5399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.399645:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15400 00000100:00100000:0.0:1746065199.401317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.401373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.401406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.401437:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426560 00000100:00100000:3.0:1746065199.401447:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426560 00000100:00100000:3.0:1746065199.401479:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15401 00000100:00100000:3.0:1746065199.401485:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+14:32212:x1830881263426560:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065199.401499:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065199.401511:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ece expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.401531:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 35 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.401538:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065199.401540:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065199.401542:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.401564:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 35 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.401573:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 35 pid: 2462 timeout: 898 lvb_type: 0 00000100:00100000:3.0:1746065199.401582:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260491008:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.401605:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426432 00000100:00100000:2.0:1746065199.401609:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426432 00010000:00010000:2.0:1746065199.401626:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.401647:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426304 00000100:00100000:2.0:1746065199.401649:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426304 00010000:00010000:2.0:1746065199.401656:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.401683:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7951 00000100:00100000:2.0:1746065199.401688:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1961:x1830881263426432:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.401697:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065199.401715:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.401723:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.401739:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5ca00/0x14b4f8542d4feefd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61da1 expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746065199.402095:0:7079:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7952 00000100:00100000:0.0:1746065199.402102:0:7079:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1959:x1830881263426304:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.402110:0:7079:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.402120:0:7079:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.402127:0:7079:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.402137:0:7079:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b264c00/0x14b4f8542d4fefd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e2d expref: 8 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.402232:0:7079:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065199.402285:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.402512:0:7079:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263426304:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 409us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.402518:0:7079:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7952 00000100:00100000:3.0:1746065199.402524:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.402566:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5befc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263426432:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 877us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.402572:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7951 00000100:00100000:3.0:1746065199.405146:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260491008:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065199.405170:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.405183:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0fc200, rc 0) 00000100:00100000:3.0:1746065199.405228:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+15:32212:x1830881263426560:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3743us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.405235:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15401 00000100:00100000:0.0:1746065199.405926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.406104:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426688 00000100:00100000:2.0:1746065199.406109:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426688 00010000:00010000:2.0:1746065199.406127:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 36 pid: 2462 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065199.406278:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7953 00000100:00100000:2.0:1746065199.406284:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263426688:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.406295:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065199.406310:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 36 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.406319:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 36 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.406336:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb18a00/0x14b4f8542d4ff01c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e5e expref: 36 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.406346:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.406348:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.406353:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.406360:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.406381:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 14 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065199.406389:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260491136:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065199.406446:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.406984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.407091:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263426816 00000100:00100000:3.0:1746065199.407095:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263426816 00010000:00010000:3.0:1746065199.407109:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 20 pid: 8428 timeout: 898 lvb_type: 1 00000100:00100000:3.0:1746065199.407132:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7954 00000100:00100000:3.0:1746065199.407136:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263426816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.407144:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065199.407155:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 20 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.407163:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 20 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.407174:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cbe800/0x14b4f8542d4fef66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dd9 expref: 20 pid: 8428 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.407198:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.407199:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.407203:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.407209:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.407224:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065199.407230:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260491264:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065199.407269:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.413273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.413433:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260491264:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065199.413452:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.413498:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1960:x1830881263426816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6360us (6513us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.413508:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7954 00000100:00100000:3.0:1746065199.413539:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427328 00000100:00100000:3.0:1746065199.413543:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427328 00002000:00100000:3.0:1746065199.413572:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1216512->2097151) req@ffff88009c3fa680 x1830881263427328/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.413580:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881263427328 ext(1216512->2097151) 00002000:00010000:3.0:1746065199.413584:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:3.0:1746065199.413606:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8678 00000100:00100000:3.0:1746065199.413611:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263427328:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065199.414676:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260491136:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065199.414693:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065199.414717:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1961:x1830881263426688:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8432us (8792us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.414723:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7953 00000100:00100000:0.0:1746065199.421081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.421109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.421190:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427200 00000100:00100000:1.0:1746065199.421198:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427200 00002000:00100000:1.0:1746065199.421234:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009c3f9180 x1830881263427200/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.421244:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830881263427200 ext(1048576->2097151) 00002000:00010000:1.0:1746065199.421248:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:1.0:1746065199.421278:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427584 00000100:00100000:1.0:1746065199.421281:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427584 00002000:00100000:1.0:1746065199.421292:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (3874816->3878911) req@ffff88012dc4ac50 x1830881263427584/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.421299:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc4ac50 with x1830881263427584 ext(3874816->3878911) 00002000:00010000:1.0:1746065199.421302:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc4ac50 00000100:00100000:1.0:1746065199.421312:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8679 00000100:00100000:1.0:1746065199.421318:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263427200:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065199.422287:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8680 00000100:00100000:1.0:1746065199.422294:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263427584:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065199.422377:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263427584:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 84us (1268us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065199.422383:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8680 00002000:00100000:1.0:1746065199.422388:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (3874816->3878911) req@ffff88012dc4ac50 x1830881263427584/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.422395:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc4ac50 with x1830881263427584 ext(3874816->3878911) 00002000:00010000:1.0:1746065199.422398:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc4ac50 00000100:00100000:3.0:1746065199.432743:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263427328:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 19124us (19470us total) trans 0 rc 880640/880640 00000100:00100000:3.0:1746065199.432753:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8678 00002000:00100000:3.0:1746065199.432762:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x382:0x0] (1216512->2097151) req@ffff88009c3fa680 x1830881263427328/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 880640/880640 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.432771:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881263427328 ext(1216512->2097151) 00002000:00010000:3.0:1746065199.432776:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:1.0:1746065199.435763:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263427200:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 14437us (14683us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065199.435777:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8679 00002000:00100000:1.0:1746065199.435787:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009c3f9180 x1830881263427200/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.435795:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830881263427200 ext(1048576->2097151) 00002000:00010000:1.0:1746065199.435800:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:0.0:1746065199.439002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.439080:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263427840 00000100:00100000:1.0:1746065199.439087:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263427840 00002000:00100000:1.0:1746065199.439122:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4112384->4116479) req@ffff88009c3f9500 x1830881263427840/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.439131:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9500 with x1830881263427840 ext(4112384->4116479) 00002000:00010000:1.0:1746065199.439135:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9500 00000100:00100000:1.0:1746065199.439425:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8681 00000100:00100000:1.0:1746065199.439433:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263427840:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:1.0:1746065199.440155:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1958:x1830881263427840:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 722us (1158us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065199.440162:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8681 00002000:00100000:1.0:1746065199.440168:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4112384->4116479) req@ffff88009c3f9500 x1830881263427840/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.440175:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9500 with x1830881263427840 ext(4112384->4116479) 00002000:00010000:1.0:1746065199.440178:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9500 00000100:00100000:0.0:1746065199.444218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.444406:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428096 00000100:00100000:1.0:1746065199.444414:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428096 00002000:00100000:1.0:1746065199.444450:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009c3f8380 x1830881263428096/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.444458:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8380 with x1830881263428096 ext(2097152->3145727) 00002000:00010000:1.0:1746065199.444463:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f8380 00000100:00100000:1.0:1746065199.444809:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8682 00000100:00100000:1.0:1746065199.445022:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263428096:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065199.453677:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263428096:12345-192.168.202.46@tcp:3:cat.0 Request processed in 8640us (9449us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065199.453688:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8682 00002000:00100000:1.0:1746065199.453698:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88009c3f8380 x1830881263428096/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.453707:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8380 with x1830881263428096 ext(2097152->3145727) 00002000:00010000:1.0:1746065199.453712:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f8380 00000100:00100000:0.0:1746065199.458688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.459531:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428224 00000100:00100000:3.0:1746065199.459540:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428224 00000100:00100000:3.0:1746065199.459575:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15402 00000100:00100000:3.0:1746065199.459580:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+15:32212:x1830881263428224:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065199.459595:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065199.459608:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc600/0x14b4f8542d4ff0d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ed5 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.459638:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 34 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.459644:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065199.459645:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065199.459648:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc600/0x14b4f8542d4ff0d9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ed5 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.459700:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 34 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.459710:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 34 pid: 2462 timeout: 898 lvb_type: 0 00000100:00100000:3.0:1746065199.459721:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260491392:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065199.459801:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065199.463037:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9716:1830881260491392:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065199.463065:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc600/0x14b4f8542d4ff0d9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ed5 expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.463080:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0fc600, rc 0) 00000100:00100000:3.0:1746065199.463118:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:26bbd020-9fba-464a-bebc-8395a287959e+16:32212:x1830881263428224:12345-192.168.202.46@tcp:101:cat.0 Request processed in 3536us (4436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.463126:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15402 00000100:00100000:0.0:1746065199.463585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.463729:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428352 00000100:00100000:2.0:1746065199.463735:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428352 00002000:00100000:2.0:1746065199.463766:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3260416->3686399) req@ffff88009c3fa300 x1830881263428352/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.463780:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830881263428352 ext(3260416->3686399) 00010000:00010000:2.0:1746065199.463786:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 35 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.463798:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 35 pid: 2462 timeout: 898 lvb_type: 0 00002000:00010000:2.0:1746065199.463804:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3fa300 00000100:00100000:2.0:1746065199.463845:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2618 00000100:00100000:2.0:1746065199.463852:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+35:1960:x1830881263428352:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:3.0:1746065199.476410:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263428352:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 12551us (12818us total) trans 17179873766 rc 0/0 00000100:00100000:3.0:1746065199.476421:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2618 00002000:00100000:3.0:1746065199.476431:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3260416->3686399) req@ffff88009c3fa300 x1830881263428352/t17179873766(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.476440:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830881263428352 ext(3260416->3686399) 00010000:00010000:3.0:1746065199.476449:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.476462:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 898 lvb_type: 0 00002000:00010000:3.0:1746065199.476468:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3fa300 00000100:00100000:0.0:1746065199.481857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.482029:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428608 00000100:00100000:2.0:1746065199.482038:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428608 00000100:00100000:2.0:1746065199.482077:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10167 00000100:00100000:2.0:1746065199.482083:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+253:32219:x1830881263428608:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065199.482101:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.482114:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad600/0x14b4f8542d4ff0e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61edc expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.482194:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.482204:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.482213:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.482226:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.482230:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.482241:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483098:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01adc00/0x14b4f8542d4ff0f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483109:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01adc00/0x14b4f8542d4ff0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483115:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01adc00/0x14b4f8542d4ff0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:2.0:1746065199.483123:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065199.483194:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483200:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483205:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483211:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01ad800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065199.483214:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483219:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483229:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065199.483231:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065199.483235:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483239:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad800/0x14b4f8542d4ff0e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483261:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483266:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483270:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483274:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01ada00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065199.483276:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483280:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483286:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5a36e00) 00010000:00010000:2.0:1746065199.483288:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065199.483290:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483294:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff0ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065199.483325:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ad600/0x14b4f8542d4ff0e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61edc expref: 256 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.483336:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01adc00/0x14b4f8542d4ff0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61edc expref: 255 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.483341:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065199.483343:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065199.483345:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01adc00, rc 0) 00000100:00100000:2.0:1746065199.483392:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:32219:x1830881263428608:12345-192.168.202.46@tcp:101:cat.0 Request processed in 1309us (1541us total) trans 8589944462 rc 0/0 00000100:00100000:2.0:1746065199.483397:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10167 00000100:00100000:1.0:1746065199.484131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.484287:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428736 00000100:00100000:3.0:1746065199.484292:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428736 00010000:00010000:3.0:1746065199.484314:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 898 lvb_type: 0 00000100:00100000:3.0:1746065199.484344:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7955 00000100:00100000:3.0:1746065199.484350:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1961:x1830881263428736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.484360:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065199.484376:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.484386:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.484405:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fafc600/0x14b4f8542d4ff070 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3260416->3686399) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e96 expref: 37 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:3.0:1746065199.484419:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.484420:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.484425:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc600/0x14b4f8542d4ff0d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ed5 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.484433:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc600/0x14b4f8542d4ff0d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ed5 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.484457:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc600/0x14b4f8542d4ff0d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ed5 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065199.484467:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260491520:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065199.484517:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065199.486289:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260491520:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065199.486306:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.486954:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+36:1961:x1830881263428736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2600us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.486964:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7955 00000100:00100000:1.0:1746065199.489953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.490002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.490082:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428864 00000100:00100000:3.0:1746065199.490091:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428864 00000100:00100000:3.0:1746065199.490128:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263428992 00000100:00100000:3.0:1746065199.490129:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263428992 00000100:00100000:3.0:1746065199.490205:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15403 00000100:00100000:3.0:1746065199.490215:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+37:1960:x1830881263428864:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065199.490234:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065199.490352:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ee3 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.490372:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.490374:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.490381:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 38 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065199.490394:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 38 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065199.490404:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0fdc00, rc 0) 00000100:00100000:3.0:1746065199.490440:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263428864:12345-192.168.202.46@tcp:101:cat.0 Request processed in 227us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.490479:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15404 00000100:00100000:3.0:1746065199.490484:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15403 00000100:00100000:2.0:1746065199.490489:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263428992:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:2.0:1746065199.490496:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.490504:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61eea expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.490515:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.490516:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.490520:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 38 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.490529:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 38 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.490536:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ad400, rc 0) 00000100:00100000:2.0:1746065199.490555:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1961:x1830881263428992:12345-192.168.202.46@tcp:101:cat.0 Request processed in 69us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.490563:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15404 00000100:00100000:0.0:1746065199.490949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.490992:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263429120 00000100:00100000:0.0:1746065199.490992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.490996:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263429120 00000100:00100000:2.0:1746065199.491026:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263429248 00000100:00100000:2.0:1746065199.491028:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263429248 00000100:00100000:2.0:1746065199.491040:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15405 00000100:00100000:2.0:1746065199.491045:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263429120:12345-192.168.202.46@tcp:101:cat.0 00000100:00100000:0.0:1746065199.491048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065199.491052:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.491061:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff111 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ef1 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.491104:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263429376 00000100:00100000:1.0:1746065199.491108:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263429376 00000100:00100000:1.0:1746065199.491126:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15406 00000100:00100000:1.0:1746065199.491131:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1961:x1830881263429248:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065199.491137:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.491143:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c800/0x14b4f8542d4ff118 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61ef8 expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.491177:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260491648:192.168.202.46@tcp:106: 00000100:00100000:2.0:1746065199.491195:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260491776:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065199.491231:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.491236:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.491696:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15407 00000100:00100000:0.0:1746065199.491703:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263429376:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:0.0:1746065199.491709:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.491716:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61eff expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.491726:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.491727:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.491731:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 39 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.491740:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 39 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.491747:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cbec00, rc 0) 00000100:00100000:0.0:1746065199.491776:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263429376:12345-192.168.202.46@tcp:101:cat.0 Request processed in 74us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.491780:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15407 00002000:00010000:1.0:1746065199.497843:0:2462:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime: 1746065199 -> 1746065200 00002000:00010000:1.0:1746065199.497849:0:2462:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime: 1746065199 -> 1746065200 00002000:00010000:1.0:1746065199.497851:0:2462:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime: 1746065199 -> 1746065200 00000100:00100000:2.0:1746065199.497857:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260491776:192.168.202.46@tcp:106: 00000100:00100000:1.0:1746065199.497857:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260491648:192.168.202.46@tcp:106: 00010000:00010000:2.0:1746065199.497883:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff111 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ef1 expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.497883:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c800/0x14b4f8542d4ff118 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ef8 expref: 22 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.497894:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01ada00/0x14b4f8542d4ff111 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ef1 expref: 22 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.497894:0:2462:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c800/0x14b4f8542d4ff118 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ef8 expref: 22 pid: 2462 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.497906:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ada00, rc 0) 00010000:00010000:1.0:1746065199.497906:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb5c800, rc 0) 00000100:00100000:2.0:1746065199.497941:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263429120:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6895us (6992us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065199.497948:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15405 00000100:00100000:1.0:1746065199.498094:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263429248:12345-192.168.202.46@tcp:101:cat.0 Request processed in 6962us (7101us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.498100:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15406 00000100:00100000:0.0:1746065199.500479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.500552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.500890:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263429632 00000100:00100000:3.0:1746065199.500899:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263429632 00002000:00100000:3.0:1746065199.500937:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009c3fad80 x1830881263429632/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.500946:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881263429632 ext(2097152->3145727) 00002000:00010000:3.0:1746065199.500950:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:3.0:1746065199.500969:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263429888 00000100:00100000:3.0:1746065199.500972:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263429888 00002000:00100000:3.0:1746065199.500982:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009c3f9880 x1830881263429888/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.500994:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830881263429888 ext(3145728->4194303) 00002000:00010000:3.0:1746065199.500996:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00000100:00100000:3.0:1746065199.501005:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8683 00000100:00100000:3.0:1746065199.501011:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263429632:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.502126:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8684 00000100:00100000:3.0:1746065199.502134:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263429888:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065199.506703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.506787:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430144 00000100:00100000:2.0:1746065199.506795:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430144 00002000:00100000:2.0:1746065199.506846:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009c3fa680 x1830881263430144/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 504/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.506855:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881263430144 ext(3145728->4194303) 00002000:00010000:2.0:1746065199.506859:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:2.0:1746065199.506876:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8685 00000100:00100000:2.0:1746065199.506882:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263430144:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065199.527401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.527448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.528102:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263429632:12345-192.168.202.46@tcp:3:cat.0 Request processed in 27087us (27624us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.528113:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8683 00002000:00100000:3.0:1746065199.528124:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009c3fad80 x1830881263429632/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.528133:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830881263429632 ext(2097152->3145727) 00002000:00010000:3.0:1746065199.528138:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:3.0:1746065199.528159:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430400 00000100:00100000:3.0:1746065199.528165:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430400 00002000:00100000:3.0:1746065199.528187:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009c3f9180 x1830881263430400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.528194:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830881263430400 ext(0->1048575) 00002000:00010000:3.0:1746065199.528196:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:3.0:1746065199.528208:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430656 00000100:00100000:3.0:1746065199.528210:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430656 00002000:00100000:3.0:1746065199.528221:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009ba1ed80 x1830881263430656/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.528232:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ed80 with x1830881263430656 ext(1048576->2097151) 00002000:00010000:3.0:1746065199.528235:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1ed80 00000100:00100000:3.0:1746065199.528246:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8686 00000100:00100000:3.0:1746065199.528252:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263430400:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065199.528994:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8687 00000100:00100000:1.0:1746065199.529003:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263430656:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065199.531751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.536250:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263429888:12345-192.168.202.46@tcp:3:cat.0 Request processed in 34109us (35688us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.536260:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8684 00002000:00100000:3.0:1746065199.536271:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009c3f9880 x1830881263429888/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.536279:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830881263429888 ext(3145728->4194303) 00002000:00010000:3.0:1746065199.536284:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00000100:00100000:3.0:1746065199.536304:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263430912 00000100:00100000:3.0:1746065199.536310:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263430912 00000100:00100000:0.0:1746065199.536328:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263430144:12345-192.168.202.46@tcp:3:cat.0 Request processed in 29444us (29630us total) trans 0 rc 806912/806912 00002000:00100000:3.0:1746065199.536335:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009bee0000 x1830881263430912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065199.536336:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8685 00002000:00100000:3.0:1746065199.536341:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0000 with x1830881263430912 ext(1048576->2097151) 00002000:00100000:0.0:1746065199.536341:0:8433:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88009c3fa680 x1830881263430144/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 504/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 806912/806912 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746065199.536344:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee0000 00002000:00100000:0.0:1746065199.536349:0:8433:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830881263430144 ext(3145728->4194303) 00002000:00010000:0.0:1746065199.536352:0:8433:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:3.0:1746065199.536359:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8688 00000100:00100000:3.0:1746065199.536364:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263430912:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.550184:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263430400:12345-192.168.202.46@tcp:3:cat.0 Request processed in 21920us (22780us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.550197:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8686 00002000:00100000:3.0:1746065199.550212:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x380:0x0] (0->1048575) req@ffff88009c3f9180 x1830881263430400/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.550220:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830881263430400 ext(0->1048575) 00002000:00010000:3.0:1746065199.550225:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:1.0:1746065199.552760:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263430656:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23750us (25303us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065199.552769:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8687 00002000:00100000:1.0:1746065199.552779:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1048576->2097151) req@ffff88009ba1ed80 x1830881263430656/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.552788:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1ed80 with x1830881263430656 ext(1048576->2097151) 00002000:00010000:1.0:1746065199.552792:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba1ed80 00000100:00100000:0.0:1746065199.567735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.567781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.567851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.568002:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431168 00000100:00100000:2.0:1746065199.568010:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431168 00000100:00100000:2.0:1746065199.568051:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 218 00000100:00100000:2.0:1746065199.568058:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263431168:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:2.0:1746065199.568108:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1960:x1830881263431168:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 51us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.568113:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 218 00000100:00100000:0.0:1746065199.568128:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263430912:12345-192.168.202.46@tcp:3:cat.0 Request processed in 31762us (36382us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065199.568134:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8688 00002000:00100000:0.0:1746065199.568143:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1048576->2097151) req@ffff88009bee0000 x1830881263430912/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.568151:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee0000 with x1830881263430912 ext(1048576->2097151) 00002000:00010000:0.0:1746065199.568156:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bee0000 00000100:00100000:0.0:1746065199.568168:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431424 00000100:00100000:0.0:1746065199.568171:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431424 00002000:00100000:2.0:1746065199.568205:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009ba1fb80 x1830881263431424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.568213:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1fb80 with x1830881263431424 ext(4194304->5013503) 00002000:00010000:2.0:1746065199.568216:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1fb80 00000100:00100000:2.0:1746065199.568226:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8689 00000100:00100000:2.0:1746065199.568229:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263431424:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.568488:0:14641:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431040 00000100:00100000:3.0:1746065199.568492:0:14641:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431040 00000100:00100000:3.0:1746065199.568514:0:14641:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 227 00000100:00100000:3.0:1746065199.568519:0:14641:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edf50a1e-6d84-485b-9392-04c729e87e94+15:1960:x1830881263431040:12345-192.168.202.46@tcp:400:kworker.0 00000100:00100000:3.0:1746065199.568601:0:14641:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edf50a1e-6d84-485b-9392-04c729e87e94+15:1960:x1830881263431040:12345-192.168.202.46@tcp:400:kworker.0 Request processed in 80us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.568606:0:14641:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 227 00000100:00100000:2.0:1746065199.582493:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263431424:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14253us (14632us total) trans 0 rc 819200/819200 00000100:00100000:2.0:1746065199.582504:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8689 00002000:00100000:2.0:1746065199.582516:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009ba1fb80 x1830881263431424/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.582524:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1fb80 with x1830881263431424 ext(4194304->5013503) 00002000:00010000:2.0:1746065199.582529:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1fb80 00000100:00100000:0.0:1746065199.587583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.588091:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431680 00000100:00100000:2.0:1746065199.588100:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431680 00000100:00100000:2.0:1746065199.588152:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10168 00000100:00100000:2.0:1746065199.588159:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+255:32222:x1830881263431680:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065199.588179:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.588194:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1a00/0x14b4f8542d4ff126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f06 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.588284:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588295:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588304:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588315:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588321:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588326:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588415:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1400/0x14b4f8542d4ff13b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588423:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1400/0x14b4f8542d4ff13b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588428:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1400/0x14b4f8542d4ff13b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:2.0:1746065199.588434:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:2.0:1746065199.588500:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588505:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588510:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588515:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356c1800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065199.588518:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588524:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588533:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065199.588536:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065199.588539:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.588544:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1800/0x14b4f8542d4ff12d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.589441:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.589453:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.589457:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.589460:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801356c1600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065199.589463:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.589467:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.589473:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5a36e00) 00010000:00010000:2.0:1746065199.589475:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065199.589477:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.589481:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1600/0x14b4f8542d4ff134 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:2.0:1746065199.589515:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1a00/0x14b4f8542d4ff126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f06 expref: 258 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.589525:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1400/0x14b4f8542d4ff13b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f06 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.589530:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065199.589532:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065199.589534:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c1400, rc 0) 00000100:00100000:2.0:1746065199.590790:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:32222:x1830881263431680:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 2623us (3207us total) trans 8589944463 rc 0/0 00000100:00100000:2.0:1746065199.590801:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10168 00000100:00100000:0.0:1746065199.591086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.591200:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263431808 00000100:00100000:1.0:1746065199.591207:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263431808 00000100:00100000:1.0:1746065199.591247:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15408 00000100:00100000:1.0:1746065199.591254:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:32219:x1830881263431808:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:1.0:1746065199.591267:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.591279:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f0d expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.591299:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.591305:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065199.591307:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065199.591310:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.591332:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 16 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.591342:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 16 pid: 2462 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065199.591352:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260491904:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065199.591410:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.595270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.595346:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432064 00000100:00100000:1.0:1746065199.595353:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432064 00000100:00100000:1.0:1746065199.596566:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4402 00000100:00100000:1.0:1746065199.596579:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+12:32212:x1830881263432064:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:1.0:1746065199.596802:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+13:32212:x1830881263432064:12345-192.168.202.46@tcp:35:cat.0 Request processed in 226us (1537us total) trans 8589944464 rc 0/0 00000100:00100000:1.0:1746065199.596808:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4402 00000100:00100000:2.0:1746065199.598744:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260491904:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.598770:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.598785:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f763000, rc 0) 00000100:00100000:2.0:1746065199.598848:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:32219:x1830881263431808:12345-192.168.202.46@tcp:101:cat.0 Request processed in 7594us (7762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.598855:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15408 00000100:00100000:0.0:1746065199.609102:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.610837:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432192 00000100:00100000:2.0:1746065199.610848:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432192 00002000:00100000:2.0:1746065199.610893:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1216511) req@ffff88009ba1c000 x1830881263432192/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.610903:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c000 with x1830881263432192 ext(1048576->1216511) 00010000:00010000:2.0:1746065199.610912:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 17 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.610924:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 17 pid: 2462 timeout: 898 lvb_type: 0 00002000:00010000:2.0:1746065199.610930:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba1c000 00000100:00100000:2.0:1746065199.610960:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2619 00000100:00100000:2.0:1746065199.610967:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263432192:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065199.614545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.614626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.615869:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432576 00000100:00100000:0.0:1746065199.615877:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432576 00000100:00100000:0.0:1746065199.615922:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10169 00000100:00100000:0.0:1746065199.615929:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+13:32223:x1830881263432576:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:0.0:1746065199.615948:0:14644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.615962:0:14644:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafcc00/0x14b4f8542d4ff150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f14 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.616046:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616057:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616065:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616076:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616081:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616086:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616169:0:14644:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff165 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616177:0:14644:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff165 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616182:0:14644:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff165 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14644 initiator: MDT0 00000004:00200000:0.0:1746065199.616189:0:14644:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:0.0:1746065199.616262:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616268:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616273:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616278:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fafc600 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065199.616281:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616286:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616294:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:0.0:1746065199.616297:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065199.616300:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616304:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafc600/0x14b4f8542d4ff157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616318:0:14644:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616322:0:14644:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616327:0:14644:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616331:0:14644:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fafde00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:0.0:1746065199.616333:0:14644:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616337:0:14644:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616342:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5eedd00) 00010000:00010000:0.0:1746065199.616344:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065199.616346:0:14644:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616349:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafde00/0x14b4f8542d4ff15e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14644 initiator: MDT0 00010000:00010000:0.0:1746065199.616378:0:14644:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafcc00/0x14b4f8542d4ff150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f14 expref: 16 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.616387:0:14644:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff165 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f14 expref: 15 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.616392:0:14644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:0.0:1746065199.616394:0:14644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065199.616396:0:14644:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fafca00, rc 0) 00000100:00100000:0.0:1746065199.616436:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:32223:x1830881263432576:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 507us (1809us total) trans 8589944465 rc 0/0 00000100:00100000:0.0:1746065199.616441:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10169 00000100:00100000:0.0:1746065199.617553:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263432192:12345-192.168.202.46@tcp:4:cat.0 Request processed in 6584us (8457us total) trans 21474841056 rc 0/0 00000100:00100000:0.0:1746065199.617561:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2619 00002000:00100000:0.0:1746065199.617569:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1216511) req@ffff88009ba1c000 x1830881263432192/t21474841056(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.617583:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1c000 with x1830881263432192 ext(1048576->1216511) 00010000:00010000:0.0:1746065199.617590:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 19 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:0.0:1746065199.617602:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 19 pid: 2462 timeout: 898 lvb_type: 0 00002000:00010000:0.0:1746065199.617607:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ba1c000 00000100:00100000:3.0:1746065199.617838:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432320 00000100:00100000:3.0:1746065199.617844:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432320 00000100:00100000:3.0:1746065199.617877:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 801 00000100:00100000:3.0:1746065199.617882:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:1960:x1830881263432320:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.617891:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065199.617903:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801356c1400/0x14b4f8542d4ff13b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f06 expref: 257 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.617925:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065199.617928:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.617946:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:1960:x1830881263432320:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (3408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.617951:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 801 00000100:00100000:0.0:1746065199.632584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.632632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.632645:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432704 00000100:00100000:1.0:1746065199.632653:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432704 00010000:00010000:1.0:1746065199.632690:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 19 pid: 2462 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065199.632729:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7956 00000100:00100000:1.0:1746065199.632741:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263432704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065199.632754:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065199.632776:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 19 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.632788:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 19 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.632808:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb19c00/0x14b4f8542d4ff023 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e65 expref: 19 pid: 2462 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.632864:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.632867:0:7080:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.632874:0:7080:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 19 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.632881:0:7080:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 19 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.632919:0:7080:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 19 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.632930:0:7080:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260492032:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065199.633021:0:7080:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4d42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.633120:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263432960 00000100:00100000:2.0:1746065199.633129:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263432960 00000100:00100000:2.0:1746065199.633154:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4403 00000100:00100000:2.0:1746065199.633159:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+15:32223:x1830881263432960:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065199.633316:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26bbd020-9fba-464a-bebc-8395a287959e+16:32223:x1830881263432960:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 156us (683us total) trans 8589944466 rc 0/0 00000100:00100000:2.0:1746065199.633321:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4403 00000100:00100000:0.0:1746065199.640550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.640685:0:7080:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7080:1830881260492032:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065199.640702:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065199.640738:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263432704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 8001us (8159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.640747:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7956 00000100:00100000:2.0:1746065199.641374:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433216 00000100:00100000:2.0:1746065199.641380:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433216 00002000:00100000:2.0:1746065199.641415:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009ba1d500 x1830881263433216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.641424:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d500 with x1830881263433216 ext(1048576->2097151) 00002000:00010000:2.0:1746065199.641428:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1d500 00000100:00100000:2.0:1746065199.641456:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8690 00000100:00100000:2.0:1746065199.641463:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263433216:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065199.655788:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263433216:12345-192.168.202.46@tcp:3:cat.0 Request processed in 14315us (15235us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065199.655800:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8690 00002000:00100000:2.0:1746065199.655811:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->2097151) req@ffff88009ba1d500 x1830881263433216/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.655831:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba1d500 with x1830881263433216 ext(1048576->2097151) 00002000:00010000:2.0:1746065199.655836:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba1d500 00000100:00100000:0.0:1746065199.662299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.663450:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433344 00000100:00100000:2.0:1746065199.663458:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433344 00000100:00100000:2.0:1746065199.663510:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15409 00000100:00100000:2.0:1746065199.663518:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:32222:x1830881263433344:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065199.663533:0:2462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.663548:0:2462:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f1b expref: -99 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.663574:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.663582:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.663592:0:2462:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.663598:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.663600:0:2462:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.663603:0:2462:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [790528->1048575] (req 790528->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 21 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.663628:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 21 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.663638:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 21 pid: 21998 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.663648:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260492160:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.663737:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.663749:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 6 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.663759:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260492288:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.664477:0:2462:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 17 pid: 8851 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.664487:0:2462:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 17 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.664495:0:2462:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260492416:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.664514:0:2462:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.665362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.665470:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433472 00000100:00100000:3.0:1746065199.665475:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433472 00000100:00100000:3.0:1746065199.665517:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15410 00000100:00100000:3.0:1746065199.665523:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:32219:x1830881263433472:12345-192.168.202.46@tcp:101:cat.0 00010000:00010000:3.0:1746065199.665534:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065199.665545:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f22 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.665562:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.665568:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065199.665569:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065199.665571:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 23 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.665587:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 17 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.665595:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 17 pid: 9716 timeout: 898 lvb_type: 0 00000100:00100000:3.0:1746065199.665603:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260492544:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065199.665640:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.669353:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260492160:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.669364:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260492288:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.669371:0:2462:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:2462:1830881260492416:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.669395:0:2462:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [790528->1048575] (req 790528->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 23 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.669411:0:2462:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c1000, rc 0) 00000100:00100000:0.0:1746065199.671492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.671569:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433600 00000100:00100000:1.0:1746065199.671578:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433600 00010000:00010000:1.0:1746065199.671607:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 24 pid: 21998 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746065199.671617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.671647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.671938:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:32222:x1830881263433344:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8419us (9647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.671945:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15409 00000100:00100000:1.0:1746065199.672010:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433856 00000100:00100000:1.0:1746065199.672013:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433856 00010000:00010000:1.0:1746065199.672026:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.672039:0:7080:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263433728 00000100:00100000:1.0:1746065199.672041:0:7080:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263433728 00010000:00010000:1.0:1746065199.672048:0:7080:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065199.672063:0:7080:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7957 00000100:00100000:1.0:1746065199.672070:0:7080:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263433600:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065199.672071:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7958 00000100:00100000:0.0:1746065199.672078:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+18:1959:x1830881263433856:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065199.672079:0:7080:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.672085:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065199.672096:0:7080:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 23 pid: 21998 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.672097:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.672105:0:7080:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 23 pid: 21998 timeout: 898 lvb_type: 1 00000100:00100000:3.0:1746065199.672467:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7959 00000100:00100000:3.0:1746065199.672475:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+7:1959:x1830881263433728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.672482:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.672534:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.672560:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb5c600/0x14b4f8542d4feee1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61d7e expref: 18 pid: 8851 timeout: 898 lvb_type: 1 00010000:00010000:0.0:1746065199.672578:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.672611:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:1959:x1830881263433856:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 534us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.672617:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7958 00010000:00010000:1.0:1746065199.673456:0:7080:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cc4be00/0x14b4f8542d4fef4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dbd expref: 23 pid: 21998 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065199.673477:0:7080:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065199.673500:0:7080:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263433600:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1430us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.673505:0:7080:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7957 00010000:00010000:3.0:1746065199.674389:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.674405:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.674418:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b264a00/0x14b4f8542d4fefba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e11 expref: 7 pid: 8427 timeout: 898 lvb_type: 1 00010000:00010000:3.0:1746065199.674442:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.674444:0:7078:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.674449:0:7078:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 21 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.674456:0:7078:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 21 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.674486:0:7078:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 21 pid: 2462 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065199.674497:0:7078:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260492672:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065199.674542:0:7078:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065199.682640:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260492544:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065199.682676:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 21 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.682693:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0fd800, rc 0) 00000100:00100000:3.0:1746065199.682730:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:32219:x1830881263433472:12345-192.168.202.46@tcp:101:cat.0 Request processed in 17206us (17368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.682738:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15410 00000100:00100000:0.0:1746065199.686172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.686468:0:7078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7078:1830881260492672:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065199.686487:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065199.687009:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434112 00000100:00100000:2.0:1746065199.687015:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434112 00002000:00100000:2.0:1746065199.687049:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x380:0x0] (790528->794623) req@ffff88012d7fc000 x1830881263434112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.687059:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc000 with x1830881263434112 ext(790528->794623) 00002000:00010000:2.0:1746065199.687063:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fc000 00000100:00100000:3.0:1746065199.687175:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1959:x1830881263433728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 14700us (15527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.687184:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7959 00000100:00100000:2.0:1746065199.687921:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8691 00000100:00100000:2.0:1746065199.687929:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263434112:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:2.0:1746065199.688052:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263434112:12345-192.168.202.46@tcp:3:cat.0 Request processed in 125us (1889us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065199.688058:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8691 00002000:00100000:2.0:1746065199.688062:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x380:0x0] (790528->794623) req@ffff88012d7fc000 x1830881263434112/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.688070:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fc000 with x1830881263434112 ext(790528->794623) 00002000:00010000:2.0:1746065199.688073:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fc000 00000100:00100000:2.0:1746065199.690206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.690263:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434240 00000100:00100000:1.0:1746065199.690270:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434240 00002000:00100000:1.0:1746065199.690301:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (3874816->4116479) req@ffff88009bee1180 x1830881263434240/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.690310:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1180 with x1830881263434240 ext(3874816->4116479) 00010000:00010000:1.0:1746065199.690318:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 17 pid: 9716 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.690330:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 17 pid: 9716 timeout: 898 lvb_type: 0 00002000:00010000:1.0:1746065199.690337:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bee1180 00000100:00100000:1.0:1746065199.690364:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2620 00000100:00100000:1.0:1746065199.690370:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+17:1961:x1830881263434240:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065199.692552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.693366:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434368 00000100:00100000:3.0:1746065199.693373:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434368 00000100:00100000:3.0:1746065199.693423:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15411 00000100:00100000:3.0:1746065199.693430:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:32222:x1830881263434368:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:3.0:1746065199.693444:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065199.693458:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f29 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.693481:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.693489:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 40 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065199.693495:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.693496:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.693499:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [1048576->1273855] (req 1048576->1273855) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 40 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.693523:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 40 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065199.693533:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 40 pid: 9716 timeout: 898 lvb_type: 1 00000100:00100000:3.0:1746065199.693543:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260492800:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065199.693613:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 15 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.693621:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 15 pid: 9716 timeout: 898 lvb_type: 0 00000100:00100000:3.0:1746065199.693629:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260492928:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065199.693647:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92ada80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065199.700092:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263434240:12345-192.168.202.46@tcp:4:cat.0 Request processed in 9711us (9879us total) trans 21474841057 rc 0/0 00000100:00100000:1.0:1746065199.700104:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2620 00002000:00100000:1.0:1746065199.700115:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (3874816->4116479) req@ffff88009bee1180 x1830881263434240/t21474841057(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.700125:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bee1180 with x1830881263434240 ext(3874816->4116479) 00010000:00010000:1.0:1746065199.700134:0:21484:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 19 pid: 9716 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065199.700146:0:21484:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 19 pid: 9716 timeout: 898 lvb_type: 0 00002000:00010000:1.0:1746065199.700153:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bee1180 00000100:00100000:2.0:1746065199.700950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.700983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.701004:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434496 00000100:00100000:2.0:1746065199.701011:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434496 00010000:00010000:2.0:1746065199.701038:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 16 pid: 9716 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065199.701059:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434624 00000100:00100000:2.0:1746065199.701062:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434624 00010000:00010000:2.0:1746065199.701072:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 41 pid: 9716 timeout: 898 lvb_type: 1 00000100:00100000:2.0:1746065199.701088:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7960 00000100:00100000:2.0:1746065199.701094:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263434496:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.701107:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065199.701129:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 16 pid: 9716 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.701138:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 16 pid: 9716 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.701161:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065199.701196:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+16:1960:x1830881263434496:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 102us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.701202:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7960 00000100:00100000:2.0:1746065199.701213:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7961 00000100:00100000:2.0:1746065199.701218:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263434624:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.701224:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065199.701231:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 41 pid: 9716 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.701239:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 41 pid: 9716 timeout: 898 lvb_type: 1 00010000:00010000:2.0:1746065199.701251:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.701252:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.701259:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 41 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.701267:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 41 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.701297:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 41 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065199.701308:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260493056:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065199.701358:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746065199.701917:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fdc00/0x14b4f8542d4ff103 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ee3 expref: 41 pid: 9716 timeout: 898 lvb_type: 1 00000100:00100000:0.0:1746065199.701941:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260492800:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065199.701950:0:21998:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930cc400/0x14b4f8542d4ff0bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec0 expref: 15 pid: 9716 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746065199.701957:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260492928:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065199.701976:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 40 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.701984:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0fd200, rc 0) 00000100:00100000:0.0:1746065199.702002:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:32222:x1830881263434368:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 8572us (9456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.702007:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15411 00000100:00100000:2.0:1746065199.703502:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10991:1830881260493056:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065199.703514:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065199.703550:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263434624:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2330us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.703557:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7961 00000100:00100000:0.0:1746065199.707246:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.707317:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435008 00000100:00100000:1.0:1746065199.707325:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435008 00002000:00100000:1.0:1746065199.707362:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1269760->1273855) req@ffff88012d7fed80 x1830881263435008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.707371:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fed80 with x1830881263435008 ext(1269760->1273855) 00002000:00010000:1.0:1746065199.707375:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fed80 00000100:00100000:1.0:1746065199.707400:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8692 00000100:00100000:1.0:1746065199.707407:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881263435008:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065199.707549:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1959:x1830881263435008:12345-192.168.202.46@tcp:3:cat.0 Request processed in 141us (308us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065199.707555:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8692 00002000:00100000:1.0:1746065199.707560:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x387:0x0] (1269760->1273855) req@ffff88012d7fed80 x1830881263435008/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.707566:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fed80 with x1830881263435008 ext(1269760->1273855) 00002000:00010000:1.0:1746065199.707569:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d7fed80 00000100:00100000:0.0:1746065199.710118:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.710443:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435264 00000100:00100000:2.0:1746065199.710450:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435264 00000100:00100000:2.0:1746065199.710483:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4404 00000100:00100000:2.0:1746065199.710489:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+256:32222:x1830881263435264:12345-192.168.202.46@tcp:35:multiop.0 00000100:00100000:2.0:1746065199.711618:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:32222:x1830881263435264:12345-192.168.202.46@tcp:35:multiop.0 Request processed in 1126us (1504us total) trans 8589944467 rc 0/0 00000100:00100000:2.0:1746065199.711625:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4404 00000100:00100000:0.0:1746065199.714318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.714794:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263434752 00000100:00100000:2.0:1746065199.714801:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263434752 00010000:00010000:2.0:1746065199.714859:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 19 pid: 9716 timeout: 898 lvb_type: 0 00000100:00100000:2.0:1746065199.715256:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7962 00000100:00100000:2.0:1746065199.715265:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263434752:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.715282:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065199.715309:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 19 pid: 9716 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.715322:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 19 pid: 9716 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.715344:0:10991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb18c00/0x14b4f8542d4ff0cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3874816->4116479) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ec7 expref: 19 pid: 9716 timeout: 898 lvb_type: 0 00010000:00010000:2.0:1746065199.715357:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.715359:0:10991:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.715365:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.715372:0:10991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.715397:0:10991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 20 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065199.715407:0:10991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260493184:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065199.717674:0:10991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.721766:0:10991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10991:1830881260493184:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065199.721783:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065199.721838:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:26bbd020-9fba-464a-bebc-8395a287959e+18:1960:x1830881263434752:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6573us (7526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.721846:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7962 00000100:00100000:0.0:1746065199.727714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.727752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065199.727808:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435520 00000100:00100000:1.0:1746065199.727832:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435520 00002000:00100000:1.0:1746065199.727869:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012d7ff800 x1830881263435520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.727878:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff800 with x1830881263435520 ext(2097152->3145727) 00002000:00010000:1.0:1746065199.727882:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7ff800 00000100:00100000:1.0:1746065199.727906:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263435776 00000100:00100000:1.0:1746065199.727908:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263435776 00002000:00100000:1.0:1746065199.727918:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012d7fe300 x1830881263435776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.727923:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fe300 with x1830881263435776 ext(3145728->4194303) 00002000:00010000:1.0:1746065199.727926:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fe300 00000100:00100000:1.0:1746065199.727937:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8693 00000100:00100000:1.0:1746065199.727943:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263435520:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.729027:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8694 00000100:00100000:3.0:1746065199.729036:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263435776:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:0.0:1746065199.736273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065199.736309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.736372:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436032 00000100:00100000:2.0:1746065199.736380:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436032 00002000:00100000:2.0:1746065199.736412:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fb12300 x1830881263436032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.736422:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830881263436032 ext(2097152->3145727) 00002000:00010000:2.0:1746065199.736427:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb12300 00000100:00100000:2.0:1746065199.736439:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436288 00000100:00100000:2.0:1746065199.736440:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436288 00002000:00100000:2.0:1746065199.736447:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb13800 x1830881263436288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.736453:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13800 with x1830881263436288 ext(3145728->4194303) 00002000:00010000:2.0:1746065199.736455:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13800 00000100:00100000:2.0:1746065199.738701:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8695 00000100:00100000:2.0:1746065199.738717:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+40:1960:x1830881263436032:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.739918:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8696 00000100:00100000:3.0:1746065199.739928:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263436288:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:1.0:1746065199.745413:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263435520:12345-192.168.202.46@tcp:3:cat.0 Request processed in 17458us (17695us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065199.745425:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8693 00002000:00100000:1.0:1746065199.745436:0:21484:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x383:0x0] (2097152->3145727) req@ffff88012d7ff800 x1830881263435520/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.745450:0:21484:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7ff800 with x1830881263435520 ext(2097152->3145727) 00002000:00010000:1.0:1746065199.745455:0:21484:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7ff800 00000100:00100000:3.0:1746065199.749797:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263435776:12345-192.168.202.46@tcp:3:cat.0 Request processed in 20750us (22031us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.749810:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8694 00002000:00100000:3.0:1746065199.749860:0:21481:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x383:0x0] (3145728->4194303) req@ffff88012d7fe300 x1830881263435776/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.749869:0:21481:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d7fe300 with x1830881263435776 ext(3145728->4194303) 00002000:00010000:3.0:1746065199.749876:0:21481:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d7fe300 00000100:00100000:2.0:1746065199.754448:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+41:1960:x1830881263436032:12345-192.168.202.46@tcp:3:cat.0 Request processed in 15729us (18174us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065199.754457:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8695 00002000:00100000:2.0:1746065199.754467:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x389:0x0] (2097152->3145727) req@ffff88009fb12300 x1830881263436032/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.754476:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830881263436032 ext(2097152->3145727) 00002000:00010000:2.0:1746065199.754481:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb12300 00000100:00100000:3.0:1746065199.763176:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263436288:12345-192.168.202.46@tcp:3:cat.0 Request processed in 23242us (26857us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065199.763185:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8696 00002000:00100000:3.0:1746065199.763195:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x389:0x0] (3145728->4194303) req@ffff88009fb13800 x1830881263436288/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.763203:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb13800 with x1830881263436288 ext(3145728->4194303) 00002000:00010000:3.0:1746065199.763207:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb13800 00000100:00100000:0.0:1746065199.773633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.773704:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436544 00000100:00100000:3.0:1746065199.773711:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436544 00002000:00100000:3.0:1746065199.773747:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb11880 x1830881263436544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.773756:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11880 with x1830881263436544 ext(4194304->5013503) 00002000:00010000:3.0:1746065199.773760:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb11880 00000100:00100000:3.0:1746065199.773790:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8697 00000100:00100000:3.0:1746065199.773795:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263436544:12345-192.168.202.46@tcp:3:cat.0 00000100:00100000:3.0:1746065199.783415:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1958:x1830881263436544:12345-192.168.202.46@tcp:3:cat.0 Request processed in 9611us (9779us total) trans 0 rc 819200/819200 00000100:00100000:3.0:1746065199.783426:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8697 00002000:00100000:3.0:1746065199.783435:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x383:0x0] (4194304->5013503) req@ffff88009fb11880 x1830881263436544/t0(0) o3->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.783445:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11880 with x1830881263436544 ext(4194304->5013503) 00002000:00010000:3.0:1746065199.783449:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb11880 00000100:00100000:0.0:1746065199.791144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.791206:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436800 00000100:00100000:2.0:1746065199.791214:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436800 00000100:00100000:2.0:1746065199.791260:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4405 00000100:00100000:2.0:1746065199.791266:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+257:32219:x1830881263436800:12345-192.168.202.46@tcp:35:cat.0 00000100:00100000:2.0:1746065199.791451:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:32219:x1830881263436800:12345-192.168.202.46@tcp:35:cat.0 Request processed in 184us (312us total) trans 8589944468 rc 0/0 00000100:00100000:2.0:1746065199.791457:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4405 00000100:00100000:0.0:1746065199.852087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.852408:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263436928 00000100:00100000:2.0:1746065199.852415:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263436928 00000100:00100000:2.0:1746065199.852456:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15412 00000100:00100000:2.0:1746065199.852464:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+15:32223:x1830881263436928:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065199.852480:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.852495:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801356c0a00/0x14b4f8542d4ff188 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f30 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.852520:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.852528:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 38 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.852533:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.852534:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.852537:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c0a00/0x14b4f8542d4ff188 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1847296->2097151] (req 1847296->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f30 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.852565:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 38 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065199.852575:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 38 pid: 25185 timeout: 899 lvb_type: 1 00000100:00100000:2.0:1746065199.852584:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260493312:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.852681:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 16 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.852688:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 16 pid: 9716 timeout: 899 lvb_type: 0 00000100:00100000:2.0:1746065199.852694:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260493440:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.852710:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.856454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.856478:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260493312:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.856488:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21998:1830881260493440:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065199.856497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:2.0:1746065199.856510:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801356c0a00/0x14b4f8542d4ff188 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [1847296->2097151] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f30 expref: 16 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.856524:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c0a00, rc 0) 00000100:00100000:0.0:1746065199.856529:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437056 00000100:00100000:0.0:1746065199.856534:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437056 00010000:00010000:0.0:1746065199.856555:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 39 pid: 25185 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065199.856572:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437184 00000100:00100000:2.0:1746065199.856573:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+16:32223:x1830881263436928:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 4109us (4494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.856574:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437184 00010000:00010000:0.0:1746065199.856580:0:7078:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 17 pid: 9716 timeout: 899 lvb_type: 0 00000100:00100000:2.0:1746065199.856583:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15412 00000100:00100000:0.0:1746065199.856591:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7963 00000100:00100000:0.0:1746065199.856596:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+39:1960:x1830881263437056:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.856605:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065199.856610:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7964 00000100:00100000:2.0:1746065199.856614:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263437184:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065199.856618:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.856621:0:7078:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 39 pid: 25185 timeout: 899 lvb_type: 1 00010000:00010000:2.0:1746065199.856625:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 16 pid: 9716 timeout: 899 lvb_type: 0 00010000:00010000:2.0:1746065199.856633:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 16 pid: 9716 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065199.857154:0:7078:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 39 pid: 25185 timeout: 899 lvb_type: 1 00010000:00010000:0.0:1746065199.857173:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01ad400/0x14b4f8542d4ff10a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eea expref: 39 pid: 25185 timeout: 899 lvb_type: 1 00010000:00010000:0.0:1746065199.857191:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.857211:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+38:1960:x1830881263437056:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 615us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.857217:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7963 00010000:00010000:2.0:1746065199.857994:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc200/0x14b4f8542d4ff0d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ece expref: 16 pid: 9716 timeout: 899 lvb_type: 0 00010000:00010000:2.0:1746065199.858015:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.858017:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.858023:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356c0a00/0x14b4f8542d4ff188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f30 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.858029:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801356c0a00/0x14b4f8542d4ff188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f30 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.858054:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801356c0a00/0x14b4f8542d4ff188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f30 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065199.858064:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260493568:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065199.863956:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.865512:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.865584:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437440 00000100:00100000:3.0:1746065199.865592:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437440 00002000:00100000:3.0:1746065199.865628:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1847296->1851391) req@ffff88009fb11c00 x1830881263437440/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.865638:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881263437440 ext(1847296->1851391) 00002000:00010000:3.0:1746065199.865642:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00000100:00100000:3.0:1746065199.865673:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8698 00000100:00100000:3.0:1746065199.865681:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263437440:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:2.0:1746065199.866146:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:15963:1830881260493568:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065199.866161:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.866242:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+16:1961:x1830881263437440:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 561us (735us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065199.866249:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8698 00002000:00100000:3.0:1746065199.866254:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x388:0x0] (1847296->1851391) req@ffff88009fb11c00 x1830881263437440/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.866260:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830881263437440 ext(1847296->1851391) 00002000:00010000:3.0:1746065199.866263:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00000100:00100000:2.0:1746065199.869551:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:26bbd020-9fba-464a-bebc-8395a287959e+15:1961:x1830881263437184:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 12925us (13042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.869563:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7964 00000100:00100000:0.0:1746065199.874091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.874201:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437568 00000100:00100000:2.0:1746065199.874209:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437568 00000100:00100000:2.0:1746065199.874243:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15413 00000100:00100000:2.0:1746065199.874249:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+18:32223:x1830881263437568:12345-192.168.202.46@tcp:101:multiop.0 00010000:00010000:2.0:1746065199.874265:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065199.874280:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801356c0000/0x14b4f8542d4ff18f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f37 expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.874304:0:21998:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.874310:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.874312:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065199.874315:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c0000/0x14b4f8542d4ff18f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->1761279] (req 1048576->1761279) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f37 expref: 19 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.874339:0:21998:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 20 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.874349:0:21998:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 20 pid: 2462 timeout: 899 lvb_type: 0 00000100:00100000:2.0:1746065199.874359:0:21998:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260493696:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065199.875669:0:21998:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4832e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065199.875693:0:21998:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21998:1830881260493696:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065199.875714:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801356c0000/0x14b4f8542d4ff18f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->1761279] (req 1048576->1761279) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f37 expref: 19 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065199.875725:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801356c0000, rc 0) 00000100:00100000:2.0:1746065199.875752:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+19:32223:x1830881263437568:12345-192.168.202.46@tcp:101:multiop.0 Request processed in 1502us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065199.875758:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15413 00000100:00100000:0.0:1746065199.878311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.878474:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437696 00000100:00100000:3.0:1746065199.878481:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437696 00010000:00010000:3.0:1746065199.878509:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 21 pid: 2462 timeout: 899 lvb_type: 0 00000100:00100000:3.0:1746065199.878789:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7965 00000100:00100000:3.0:1746065199.878797:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263437696:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065199.878809:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065199.878847:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 21 pid: 2462 timeout: 899 lvb_type: 0 00010000:00010000:3.0:1746065199.878861:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 21 pid: 2462 timeout: 899 lvb_type: 0 00010000:00010000:3.0:1746065199.878877:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f763000/0x14b4f8542d4ff149 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f0d expref: 21 pid: 2462 timeout: 899 lvb_type: 0 00010000:00010000:3.0:1746065199.878986:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.878988:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065199.878995:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356c0000/0x14b4f8542d4ff18f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f37 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.879002:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c0000/0x14b4f8542d4ff18f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f37 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065199.879031:0:15963:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801356c0000/0x14b4f8542d4ff18f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f37 expref: 18 pid: 21998 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065199.879040:0:15963:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260493824:192.168.202.46@tcp:105: 00000100:00100000:3.0:1746065199.879120:0:15963:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a92adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065199.884348:0:15963:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:15963:1830881260493824:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065199.884366:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065199.884474:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263437696:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 5675us (6166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065199.884483:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7965 00000100:00100000:0.0:1746065199.893198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065199.893427:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263437952 00000100:00100000:3.0:1746065199.893434:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263437952 00002000:00100000:3.0:1746065199.893469:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1757184->1761279) req@ffff88009fb11500 x1830881263437952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.893478:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881263437952 ext(1757184->1761279) 00002000:00010000:3.0:1746065199.893483:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb11500 00000100:00100000:3.0:1746065199.893507:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8699 00000100:00100000:3.0:1746065199.893513:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263437952:12345-192.168.202.46@tcp:3:multiop.0 00000100:00100000:3.0:1746065199.893649:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+19:1961:x1830881263437952:12345-192.168.202.46@tcp:3:multiop.0 Request processed in 135us (459us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065199.893663:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8699 00002000:00100000:3.0:1746065199.893668:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1757184->1761279) req@ffff88009fb11500 x1830881263437952/t0(0) o3->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.893673:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11500 with x1830881263437952 ext(1757184->1761279) 00002000:00010000:3.0:1746065199.893675:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb11500 00000100:00100000:0.0:1746065199.953253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.957968:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438208 00000100:00100000:2.0:1746065199.957984:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438208 00002000:00100000:2.0:1746065199.958035:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1761279) req@ffff88009fb11f80 x1830881263438208/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.958045:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11f80 with x1830881263438208 ext(1048576->1761279) 00002000:00010000:2.0:1746065199.958050:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb11f80 00000100:00100000:3.0:1746065199.958192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065199.958534:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438080 00000100:00100000:2.0:1746065199.958537:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438080 00002000:00100000:2.0:1746065199.958553:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1847296->2097151) req@ffff880135cdf800 x1830881263438080/t0(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.958560:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf800 with x1830881263438080 ext(1847296->2097151) 00002000:00010000:2.0:1746065199.958563:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf800 00000100:00100000:3.0:1746065199.958756:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8700 00000100:00100000:3.0:1746065199.958764:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+19:1960:x1830881263438208:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065199.959715:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8701 00000100:00100000:2.0:1746065199.959723:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+15:1960:x1830881263438080:12345-192.168.202.46@tcp:4:multiop.0 00000100:00100000:2.0:1746065199.970721:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1960:x1830881263438080:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 10991us (12521us total) trans 17179873767 rc 0/0 00000100:00100000:2.0:1746065199.970734:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8701 00002000:00100000:2.0:1746065199.970744:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x388:0x0] (1847296->2097151) req@ffff880135cdf800 x1830881263438080/t17179873767(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065199.970752:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cdf800 with x1830881263438080 ext(1847296->2097151) 00002000:00010000:2.0:1746065199.970757:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135cdf800 00000100:00100000:3.0:1746065199.972002:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:26bbd020-9fba-464a-bebc-8395a287959e+21:1960:x1830881263438208:12345-192.168.202.46@tcp:4:multiop.0 Request processed in 13235us (18758us total) trans 21474841058 rc 0/0 00000100:00100000:3.0:1746065199.972010:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8700 00002000:00100000:3.0:1746065199.972016:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x382:0x0] (1048576->1761279) req@ffff88009fb11f80 x1830881263438208/t21474841058(0) o4->26bbd020-9fba-464a-bebc-8395a287959e@192.168.202.46@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065199.972024:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11f80 with x1830881263438208 ext(1048576->1761279) 00002000:00010000:3.0:1746065199.972029:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb11f80 00010000:00010000:2.0:1746065200.034110:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746065200.235066:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873737 is committed 00000001:00080000:1.0:1746065200.235099:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873758 is committed 00000001:00080000:1.0:1746065200.235115:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873743 is committed 00000001:00080000:1.0:1746065200.235125:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873723 is committed 00000001:00080000:1.0:1746065200.235144:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873767 is committed 00000001:00080000:1.0:1746065200.235150:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873766 is committed 00000001:00080000:1.0:1746065200.235190:0:2107:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873762 is committed 00000001:00080000:1.0:1746065200.257088:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841056 is committed 00000001:00080000:1.0:1746065200.257340:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841028 is committed 00000001:00080000:1.0:1746065200.257368:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841057 is committed 00000001:00080000:1.0:1746065200.257373:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841050 is committed 00000001:00080000:1.0:1746065200.257385:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841036 is committed 00000001:00080000:1.0:1746065200.257430:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841058 is committed 00000001:00080000:1.0:1746065200.257436:0:408:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841055 is committed 00000100:00100000:0.0:1746065200.661872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065200.661908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065200.661927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065200.661954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065200.661967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065200.661992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065200.662010:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438464 00000100:00100000:1.0:1746065200.662011:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438720 00000100:00100000:1.0:1746065200.662017:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438720 00000100:00100000:0.0:1746065200.662017:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438464 00000100:00100000:1.0:1746065200.662061:0:2462:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438976 00000100:00100000:1.0:1746065200.662064:0:2462:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438976 00000100:00100000:0.0:1746065200.663137:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438336 00000100:00100000:0.0:1746065200.663142:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438336 00000100:00100000:0.0:1746065200.663157:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438592 00000100:00100000:0.0:1746065200.663159:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438592 00000100:00100000:0.0:1746065200.663171:0:8429:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263438848 00000100:00100000:0.0:1746065200.663172:0:8429:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263438848 00000100:00100000:2.0:1746065200.663181:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15414 00000100:00100000:1.0:1746065200.663190:0:2462:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15415 00000100:00100000:2.0:1746065200.663191:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263438720:12345-192.168.202.46@tcp:16:kworker.0 00000100:00100000:1.0:1746065200.663196:0:2462:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263438464:12345-192.168.202.46@tcp:16:kworker.0 00000100:00100000:3.0:1746065200.663197:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15416 00000100:00100000:0.0:1746065200.663203:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15417 00000100:00100000:3.0:1746065200.663206:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263438976:12345-192.168.202.46@tcp:16:kworker.0 00000100:00100000:0.0:1746065200.663209:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263438336:12345-192.168.202.46@tcp:16:kworker.0 00000100:00100000:3.0:1746065200.663269:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263438976:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 65us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065200.663269:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263438720:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 81us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.663269:0:2462:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263438464:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 73us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.663269:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+9:1960:x1830881263438336:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 60us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.663274:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15417 00000100:00100000:3.0:1746065200.663277:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15416 00000100:00100000:1.0:1746065200.663280:0:2462:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15415 00000100:00100000:2.0:1746065200.663284:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15414 00000100:00100000:0.0:1746065200.663290:0:8429:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15418 00000100:00100000:3.0:1746065200.663293:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15419 00000100:00100000:0.0:1746065200.663293:0:8429:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263438592:12345-192.168.202.46@tcp:16:kworker.0 00000100:00100000:3.0:1746065200.663299:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263438848:12345-192.168.202.46@tcp:16:kworker.0 00000100:00080000:1.0:1746065200.663303:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065200.663306:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065200.663318:0:8429:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263438592:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 24us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.663323:0:8429:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15418 00000100:00100000:3.0:1746065200.663328:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:1960:x1830881263438848:12345-192.168.202.46@tcp:16:kworker.0 Request processed in 30us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065200.663332:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15419 00000100:00100000:0.0:1746065200.676734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065200.676856:0:1385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439232 00000100:00100000:2.0:1746065200.676868:0:1385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439232 00000100:00100000:2.0:1746065200.676942:0:1385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4406 00000100:00100000:2.0:1746065200.676950:0:1385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+16:32248:x1830881263439232:12345-192.168.202.46@tcp:35:umount.0 00000100:00100000:2.0:1746065200.677180:0:1385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:26bbd020-9fba-464a-bebc-8395a287959e+17:32248:x1830881263439232:12345-192.168.202.46@tcp:35:umount.0 Request processed in 230us (455us total) trans 8589944469 rc 0/0 00000100:00100000:2.0:1746065200.677187:0:1385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4406 00000100:00080000:0.0:1746065200.677561:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065200.679969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065200.680300:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439360 00000100:00100000:3.0:1746065200.680312:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439360 00000100:00100000:3.0:1746065200.680378:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 802 00000100:00100000:3.0:1746065200.680385:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+15:1961:x1830881263439360:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065200.680395:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065200.680411:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f14fa00/0x14b4f8542d4f501f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c05c expref: 15 pid: 14641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065200.680434:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065200.680500:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+14:1961:x1830881263439360:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 115us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065200.680506:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 802 00000100:00100000:0.0:1746065200.681723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065200.681748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065200.681838:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065200.681992:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439616 00000100:00100000:3.0:1746065200.681998:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439616 00000100:00100000:3.0:1746065200.682019:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263439488 00000100:00100000:3.0:1746065200.682021:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263439488 00000100:00100000:3.0:1746065200.682033:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 803 00000100:00100000:3.0:1746065200.682038:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+15:1961:x1830881263439616:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065200.682045:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065200.682055:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f0b4400/0x14b4f8542d4f502d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c08d expref: 15 pid: 14642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065200.682064:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065200.682088:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+14:1961:x1830881263439616:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065200.682093:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 803 00000100:00100000:3.0:1746065200.682100:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 804 00000100:00100000:3.0:1746065200.682104:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+13:1961:x1830881263439488:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065200.682108:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065200.682113:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f0b4000/0x14b4f8542d4f5026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c086 expref: 13 pid: 14642 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065200.682118:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065200.682125:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:edf50a1e-6d84-485b-9392-04c729e87e94+12:1961:x1830881263439488:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 21us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065200.682129:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 804 00000100:00100000:2.0:1746065200.683254:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440000 00000100:00100000:2.0:1746065200.683263:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440000 00000100:00100000:2.0:1746065200.683312:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15420 00000100:00100000:2.0:1746065200.683319:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+7:1957:x1830881263440000:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1746065200.683349:0:25185:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4f5042 00000020:00010000:2.0:1746065200.683359:0:25185:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f42c000: total 0 00000100:00080000:2.0:1746065200.683363:0:25185:0:(import.c:66:import_set_state_nolock()) ffff88009f42c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065200.683399:0:25185:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873767 00000100:00100000:2.0:1746065200.683659:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:26bbd020-9fba-464a-bebc-8395a287959e+5:1957:x1830881263440000:12345-192.168.202.46@tcp:9:umount.0 Request processed in 340us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065200.683666:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15420 00000020:00010000:1.0:1746065200.683830:0:14603:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f42c000: total 0 00010000:00010000:1.0:1746065200.683864:0:14603:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f42c000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1746065200.683914:0:14603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fc600/0x14b4f8542d4ff0d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61ed5 expref: 4 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.683955:0:14603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356c0a00/0x14b4f8542d4ff188 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f30 expref: 3 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.683978:0:14603:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f42c000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1746065200.683987:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065200.683989:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065200.683990:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065200.697745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065200.697856:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440384 00000100:00100000:2.0:1746065200.697866:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440384 00000100:00100000:2.0:1746065200.697925:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15421 00000100:00100000:2.0:1746065200.697933:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+7:1957:x1830881263440384:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1746065200.697967:0:8428:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4f503b 00000020:00010000:2.0:1746065200.697977:0:8428:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f977000: total 0 00000100:00080000:2.0:1746065200.697981:0:8428:0:(import.c:66:import_set_state_nolock()) ffff88009f974800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065200.698026:0:8428:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841058 00000020:00010000:3.0:1746065200.698076:0:7081:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f977000: total 0 00010000:00010000:3.0:1746065200.698126:0:7081:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f977000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746065200.698176:0:7081:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356c0000/0x14b4f8542d4ff18f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x44801000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f37 expref: 6 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065200.698227:0:7081:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935dd800/0x14b4f8542d4f518b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c16d expref: 6 pid: 8427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065200.698248:0:7081:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f977000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746065200.698258:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065200.698259:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065200.698260:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065200.698311:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:26bbd020-9fba-464a-bebc-8395a287959e+2:1957:x1830881263440384:12345-192.168.202.46@tcp:9:umount.0 Request processed in 377us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065200.698318:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15421 00000100:00100000:0.0:1746065200.704630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065200.705065:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440768 00000100:00100000:1.0:1746065200.705073:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440768 00000100:00100000:1.0:1746065200.705217:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10170 00000100:00100000:1.0:1746065200.705225:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+17:1957:x1830881263440768:12345-192.168.202.46@tcp:39:umount.0 00000020:00000080:1.0:1746065200.705255:0:14645:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4f5034 00000020:00010000:1.0:1746065200.705262:0:14645:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880094d53800: total 0 00000100:00080000:1.0:1746065200.705265:0:14645:0:(import.c:66:import_set_state_nolock()) ffff880094d57800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746065200.705292:0:14645:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944469 00000100:00100000:1.0:1746065200.705516:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26bbd020-9fba-464a-bebc-8395a287959e+16:1957:x1830881263440768:12345-192.168.202.46@tcp:39:umount.0 Request processed in 292us (893us total) trans 8589944470 rc 0/0 00000100:00100000:1.0:1746065200.705522:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10170 00000020:00010000:2.0:1746065200.705857:0:7082:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880094d53800: total 0 00010000:00010000:2.0:1746065200.705889:0:7082:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880094d53800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1746065200.705912:0:7082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065200.705915:0:7082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065200.705920:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cba00/0x14b4f8542d4fefa5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61dfc expref: 15 pid: 20754 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065200.705937:0:7082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065200.705939:0:7082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065200.705942:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129cbe400/0x14b4f8542d4ff0b6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eb9 expref: 14 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065200.705962:0:7082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:2.0:1746065200.705964:0:7082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065200.705966:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090a0c400/0x14b4f8542d4f50dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c12e expref: 13 pid: 16767 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065200.705976:0:7082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065200.705977:0:7082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065200.705980:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fafca00/0x14b4f8542d4ff165 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f14 expref: 12 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065200.705989:0:7082:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880094d53800, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1746065200.705995:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065200.705997:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065200.705998:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065201.037081:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065201.266050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.266090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.266126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.266223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.266265:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441408 00000100:00100000:0.0:1746065201.266275:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441408 00000100:00100000:1.0:1746065201.266441:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441024 00000100:00100000:1.0:1746065201.266446:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441024 00000100:00100000:1.0:1746065201.266478:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263440896 00000100:00100000:1.0:1746065201.266480:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263440896 00000100:00100000:1.0:1746065201.266492:0:7078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441152 00000100:00100000:1.0:1746065201.266493:0:7078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441152 00000100:00100000:1.0:1746065201.266511:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 805 00000100:00100000:1.0:1746065201.266518:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edf50a1e-6d84-485b-9392-04c729e87e94+14:1961:x1830881263441024:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.266531:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.266551:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800b48f8c00/0x14b4f8542d4f5050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c0e1 expref: 14 pid: 14642 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.266570:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.266614:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edf50a1e-6d84-485b-9392-04c729e87e94+13:1961:x1830881263441024:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 97us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.266620:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 805 00000100:00100000:1.0:1746065201.266635:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 806 00000100:00100000:1.0:1746065201.266640:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edf50a1e-6d84-485b-9392-04c729e87e94+12:1960:x1830881263440896:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.266657:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.266664:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880135cd9000/0x14b4f8542d4f5049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c0b7 expref: 12 pid: 14641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.266678:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.266704:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edf50a1e-6d84-485b-9392-04c729e87e94+11:1960:x1830881263440896:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 64us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.266709:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 806 00000100:00100000:1.0:1746065201.266718:0:7078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 807 00000100:00100000:1.0:1746065201.266723:0:7078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edf50a1e-6d84-485b-9392-04c729e87e94+10:1960:x1830881263441152:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.266729:0:7078:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.266737:0:7078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880135cd8c00/0x14b4f8542d4f5057 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c0e8 expref: 10 pid: 14641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.266744:0:7078:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.266757:0:7078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edf50a1e-6d84-485b-9392-04c729e87e94+9:1960:x1830881263441152:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 33us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.266762:0:7078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 807 00000100:00080000:3.0:1746065201.266939:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065201.267739:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15422 00000100:00100000:2.0:1746065201.267751:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1957:x1830881263441408:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1746065201.267781:0:25185:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4f506c 00000020:00010000:2.0:1746065201.267788:0:25185:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f42e800: total 0 00000100:00080000:2.0:1746065201.267792:0:25185:0:(import.c:66:import_set_state_nolock()) ffff88009f42b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065201.267849:0:25185:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873767 00000020:00010000:0.0:1746065201.267900:0:14603:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f42e800: total 0 00010000:00010000:0.0:1746065201.267904:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065201.267932:0:14603:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f42e800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746065201.267977:0:14603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946e1600/0x14b4f8542d4f52b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c21c expref: 6 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.268013:0:14603:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f42e800, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1746065201.268014:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+3:1957:x1830881263441408:12345-192.168.202.46@tcp:9:umount.0 Request processed in 267us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.268020:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15422 00010000:00010000:0.0:1746065201.268021:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065201.268022:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065201.268024:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065201.270524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.270579:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263441664 00000100:00100000:2.0:1746065201.270588:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263441664 00000100:00080000:3.0:1746065201.270637:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065201.270659:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15423 00000100:00100000:2.0:1746065201.270668:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+6:1957:x1830881263441664:12345-192.168.202.46@tcp:9:umount.0 00000020:00000080:2.0:1746065201.270697:0:25185:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4f5065 00000020:00010000:2.0:1746065201.270702:0:25185:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f970800: total 0 00000100:00080000:2.0:1746065201.270705:0:25185:0:(import.c:66:import_set_state_nolock()) ffff88009f972000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065201.270740:0:25185:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841058 00000020:00010000:3.0:1746065201.270761:0:7081:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f970800: total 0 00010000:00010000:3.0:1746065201.270797:0:7081:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f970800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1746065201.270863:0:7081:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4f52b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c223 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.270900:0:7081:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f970800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1746065201.270910:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065201.270911:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065201.270913:0:7081:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065201.270931:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3b2f22f6-12f3-444f-91d0-7389d1a69692+2:1957:x1830881263441664:12345-192.168.202.46@tcp:9:umount.0 Request processed in 264us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.270938:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15423 00000100:00100000:0.0:1746065201.275542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.275657:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442048 00000100:00100000:2.0:1746065201.275666:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442048 00000100:00100000:2.0:1746065201.275898:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10171 00000100:00100000:2.0:1746065201.275907:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+9:1957:x1830881263442048:12345-192.168.202.46@tcp:39:umount.0 00000020:00000080:2.0:1746065201.275942:0:14644:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x14b4f8542d4f505e 00000020:00010000:2.0:1746065201.275949:0:14644:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880094d55000: total 0 00000100:00080000:2.0:1746065201.275954:0:14644:0:(import.c:66:import_set_state_nolock()) ffff880094d51800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065201.275975:0:14644:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944470 00000100:00080000:3.0:1746065201.276192:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1746065201.276218:0:7082:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880094d55000: total 0 00000100:00100000:2.0:1746065201.276222:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b2f22f6-12f3-444f-91d0-7389d1a69692+8:1957:x1830881263442048:12345-192.168.202.46@tcp:39:umount.0 Request processed in 316us (691us total) trans 8589944471 rc 0/0 00000100:00100000:2.0:1746065201.276229:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10171 00010000:00010000:3.0:1746065201.276263:0:7082:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880094d55000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746065201.276294:0:7082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:3.0:1746065201.276297:0:7082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746065201.276304:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c744000/0x14b4f8542d4f507a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e5c112 expref: 7 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.276323:0:7082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065201.276325:0:7082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065201.276328:0:7082:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b265a00/0x14b4f8542d4fefac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61e03 expref: 6 pid: 14644 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.276342:0:7082:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880094d55000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746065201.276351:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065201.276353:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065201.276354:0:7082:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065201.308420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.308871:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442176 00000100:00100000:1.0:1746065201.308881:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442176 00000100:00100000:1.0:1746065201.309327:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10172 00000100:00100000:1.0:1746065201.309335:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+258:32270:x1830881263442176:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065201.309359:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.309377:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b600/0x14b4f8542d4ff196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f3e expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.309435:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.309447:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.309458:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.309471:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.309476:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.309482:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.309793:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.309802:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.309809:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00080000:3.0:1746065201.310539:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1746065201.310802:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:1.0:1746065201.310808:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065201.310856:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310868:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310875:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310880:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310885:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310891:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f46a200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065201.310895:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310901:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310912:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012c8fa500) 00010000:00010000:1.0:1746065201.310914:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065201.310918:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310923:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff19d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310949:0:14645:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310954:0:14645:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310959:0:14645:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310963:0:14645:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f46b200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:1.0:1746065201.310965:0:14645:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310969:0:14645:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310975:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880133205900) 00010000:00010000:1.0:1746065201.310977:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065201.310979:0:14645:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.310983:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b200/0x14b4f8542d4ff1a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.311019:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46b600/0x14b4f8542d4ff196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 260 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.311031:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 259 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.311036:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065201.311039:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065201.311041:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f46ae00, rc 0) 00000100:00100000:1.0:1746065201.311122:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:32270:x1830881263442176:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1788us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.311130:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10172 00000100:00100000:0.0:1746065201.315385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.315479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.315653:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442304 00000100:00100000:1.0:1746065201.315662:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442304 00000100:00100000:2.0:1746065201.315761:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442432 00000100:00100000:2.0:1746065201.315764:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442432 00000100:00100000:1.0:1746065201.315845:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15424 00000100:00100000:1.0:1746065201.315855:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263442304:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065201.315875:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.315895:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f45 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065201.315922:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d730, atime: 0x6812d730, ctime: 0x6812d730, blocks: 0x821 00010000:00010000:1.0:1746065201.315942:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.315944:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.315955:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.315971:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 21 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.315982:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f46b600, rc 0) 00000100:00100000:1.0:1746065201.316031:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1959:x1830881263442304:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 178us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.316037:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15424 00000100:00100000:2.0:1746065201.316243:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15425 00000100:00100000:2.0:1746065201.316248:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+12:1959:x1830881263442432:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065201.316255:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065201.316267:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f4c expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065201.316288:0:25185:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d730, atime: 0x6812d730, ctime: 0x6812d730, blocks: 0x821 00010000:00010000:2.0:1746065201.316297:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.316298:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.316303:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065201.316312:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 13 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065201.316318:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094896200, rc 0) 00000100:00080000:3.0:1746065201.316627:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746065201.316631:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065201.316759:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1959:x1830881263442432:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 89us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.316768:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15425 00000100:00100000:0.0:1746065201.327738:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.328998:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442688 00000100:00100000:1.0:1746065201.329016:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442688 00000100:00100000:1.0:1746065201.329091:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10173 00000100:00100000:1.0:1746065201.329100:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+259:32270:x1830881263442688:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065201.329123:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.329145:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff1c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f53 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.329251:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.329267:0:14645:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 260 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.329274:0:14645:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.329311:0:14645:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 260 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.329323:0:14645:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 260 pid: 14645 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065201.329336:0:14645:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260493952:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065201.329452:0:14645:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.333141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.333540:0:10991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263442816 00000100:00100000:2.0:1746065201.333554:0:10991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263442816 00010000:00010000:2.0:1746065201.333599:0:10991:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 261 pid: 14645 timeout: 900 lvb_type: 0 00000100:00100000:2.0:1746065201.333656:0:10991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7966 00000100:00100000:2.0:1746065201.333664:0:10991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1961:x1830881263442816:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065201.333680:0:10991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065201.333686:0:10991:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 261 pid: 14645 timeout: 900 lvb_type: 0 00010000:00010000:2.0:1746065201.333697:0:10991:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 261 pid: 14645 timeout: 900 lvb_type: 0 00010000:00010000:2.0:1746065201.333725:0:10991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065201.333730:0:10991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.333739:0:10991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.333745:0:10991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.333763:0:10991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065201.333810:0:10991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:1961:x1830881263442816:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 148us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.333844:0:10991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7966 00010000:00010000:1.0:1746065201.334928:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff1ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f3e expref: 260 pid: 14645 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065201.334970:0:14645:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14645:1830881260493952:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065201.334990:0:14645:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.334999:0:14645:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.335004:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065201.335024:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065201.335178:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a200/0x14b4f8542d4ff1c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f53 expref: 261 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.335194:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f53 expref: 260 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.335201:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065201.335204:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065201.335206:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f46a000, rc 0) 00000100:00100000:1.0:1746065201.335241:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:32270:x1830881263442688:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 6143us (7510us total) trans 8589944472 rc 0/0 00000100:00100000:1.0:1746065201.335248:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10173 00000100:00100000:0.0:1746065201.341169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.343414:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443072 00000100:00100000:1.0:1746065201.343430:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443072 00000100:00100000:1.0:1746065201.343505:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10174 00000100:00100000:1.0:1746065201.343514:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:32270:x1830881263443072:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065201.343539:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.343543:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065201.343573:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f46a000/0x14b4f8542d4ff1c7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x30c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f53 expref: 260 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.343617:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065201.343621:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065201.343635:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4ff1d5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f5a expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.343747:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4ff1dc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.343759:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4ff1dc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.343767:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4ff1dc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065201.343778:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00010000:00010000:1.0:1746065201.343934:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b0400/0x14b4f8542d4ff1d5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f5a expref: 262 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.343946:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4ff1dc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f5a expref: 261 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.343952:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065201.343954:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065201.343957:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ad3b1c00, rc 0) 00000100:00100000:1.0:1746065201.344721:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:32270:x1830881263443072:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1205us (3556us total) trans 8589944473 rc 0/0 00000100:00100000:1.0:1746065201.344729:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10174 00000100:00100000:0.0:1746065201.346971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.347002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.347034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.347062:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443200 00000100:00100000:0.0:1746065201.347071:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443200 00000100:00100000:0.0:1746065201.347151:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443328 00000100:00100000:0.0:1746065201.347154:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443328 00000100:00100000:0.0:1746065201.347164:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443456 00000100:00100000:0.0:1746065201.347165:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443456 00000100:00100000:0.0:1746065201.347188:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15426 00000100:00100000:0.0:1746065201.347194:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1959:x1830881263443200:12345-192.168.202.46@tcp:1:lfs.0 00000100:00100000:3.0:1746065201.347215:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15427 00000100:00100000:3.0:1746065201.347226:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263443328:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065201.347238:0:8428:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.347250:0:2463:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.347260:0:8428:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 13 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.347261:0:2463:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.347266:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065201.347267:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065201.347268:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065201.347269:0:2463:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065201.347271:0:2463:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.347271:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.347297:0:2463:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.347297:0:8428:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 13 pid: 2462 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.347306:0:8428:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 13 pid: 2462 timeout: 900 lvb_type: 0 00010000:00010000:3.0:1746065201.347307:0:2463:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 900 lvb_type: 0 00000100:00100000:3.0:1746065201.347319:0:2463:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260494080:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065201.347319:0:8428:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260494208:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065201.347416:0:4544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15428 00000100:00100000:1.0:1746065201.347425:0:4544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263443456:12345-192.168.202.46@tcp:1:lfs.0 00000100:00100000:3.0:1746065201.347434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:1.0:1746065201.347444:0:4544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.347450:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443584 00000100:00100000:3.0:1746065201.347453:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443584 00010000:00010000:1.0:1746065201.347455:0:4544:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 22 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.347460:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.347461:0:4544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.347463:0:4544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.347472:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15429 00000100:00100000:3.0:1746065201.347477:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1959:x1830881263443584:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065201.347478:0:4544:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 22 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.347485:0:4544:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 22 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:3.0:1746065201.347493:0:4545:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.347493:0:4544:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260494336:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065201.347504:0:4545:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.347510:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.347511:0:4545:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.347513:0:4545:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.347529:0:4545:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 14 pid: 25185 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.347538:0:4545:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 14 pid: 25185 timeout: 900 lvb_type: 1 00000100:00100000:3.0:1746065201.347546:0:4545:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260494464:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065201.347582:0:8428:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.347614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.347636:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.347662:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443712 00000100:00100000:0.0:1746065201.347664:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443712 00000100:00100000:0.0:1746065201.347681:0:9716:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443840 00000100:00100000:0.0:1746065201.347682:0:9716:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443840 00000100:00100000:0.0:1746065201.347695:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15430 00000100:00100000:0.0:1746065201.347699:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263443712:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:0.0:1746065201.347714:0:9716:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.347746:0:4544:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065201.347747:0:4545:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800943053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065201.347762:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15431 00000100:00100000:1.0:1746065201.347767:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263443840:12345-192.168.202.46@tcp:1:lfs.0 00010000:00010000:1.0:1746065201.347783:0:8851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347793:0:8851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.347803:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.347804:0:8851:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.347806:0:8851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347841:0:8851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.347848:0:8851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 23 pid: 8428 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746065201.347857:0:8851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260494592:192.168.202.46@tcp:104: 00000100:00100000:1.0:1746065201.347896:0:8851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a89c2c00 going to sleep for 11 seconds 00010000:00010000:0.0:1746065201.347970:0:9716:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.347981:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.347982:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.347985:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.348002:0:9716:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 15 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.348009:0:9716:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 15 pid: 21998 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746065201.348016:0:9716:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260494720:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065201.348036:0:9716:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a09ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065201.348082:0:2463:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.352601:0:4545:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4545:1830881260494464:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065201.352636:0:4545:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.352713:0:2463:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2463:1830881260494080:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065201.352728:0:2463:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.352734:0:4544:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4544:1830881260494336:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065201.352752:0:4544:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.352837:0:8428:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1830881260494208:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065201.352851:0:8428:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.354019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.354067:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263443968 00000100:00100000:3.0:1746065201.354075:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263443968 00002000:00100000:3.0:1746065201.354118:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x380:0x0] (790528->1048575) req@ffff88008fd06680 x1830881263443968/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:117/0 lens 488/0 e 0 to 0 dl 1746065212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065201.354125:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06680 with x1830881263443968 ext(790528->1048575) 00010000:00010000:3.0:1746065201.354131:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 16 pid: 2462 timeout: 900 lvb_type: 0 00010000:00010000:3.0:1746065201.354141:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 16 pid: 2462 timeout: 900 lvb_type: 0 00002000:00010000:3.0:1746065201.354146:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd06680 00000100:00100000:3.0:1746065201.354164:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2621 00000100:00100000:3.0:1746065201.354169:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263443968:12345-192.168.202.46@tcp:4:cat.0 00000100:00100000:0.0:1746065201.355443:0:9716:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9716:1830881260494720:192.168.202.46@tcp:104: 00010000:00010000:0.0:1746065201.355474:0:9716:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.355555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.355585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.355613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.355664:0:8851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8851:1830881260494592:192.168.202.46@tcp:104: 00010000:00010000:1.0:1746065201.355682:0:8851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.355794:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444096 00000100:00100000:2.0:1746065201.355800:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444096 00000100:00100000:3.0:1746065201.355809:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444352 00000100:00100000:3.0:1746065201.355813:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444352 00002000:00100000:2.0:1746065201.355845:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1273855) req@ffff880135cde680 x1830881263444096/t0(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:117/0 lens 488/0 e 0 to 0 dl 1746065212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065201.355849:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 18 pid: 25185 timeout: 900 lvb_type: 1 00002000:00100000:2.0:1746065201.355854:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde680 with x1830881263444096 ext(1048576->1273855) 00010000:00010000:2.0:1746065201.355861:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 24 pid: 21998 timeout: 900 lvb_type: 0 00000100:00100000:3.0:1746065201.355867:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444224 00000100:00100000:3.0:1746065201.355869:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444224 00010000:00010000:2.0:1746065201.355875:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 25 pid: 21998 timeout: 900 lvb_type: 0 00010000:00010000:3.0:1746065201.355878:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 25 pid: 8428 timeout: 900 lvb_type: 1 00002000:00010000:2.0:1746065201.355880:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135cde680 00000100:00100000:3.0:1746065201.355891:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7967 00000100:00100000:2.0:1746065201.355893:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 2622 00000100:00100000:3.0:1746065201.355898:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881263444352:12345-192.168.202.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065201.355898:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263444096:12345-192.168.202.46@tcp:4:cat.0 00010000:00010000:3.0:1746065201.355908:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065201.355928:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 18 pid: 25185 timeout: 900 lvb_type: 1 00010000:00010000:3.0:1746065201.355937:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 18 pid: 25185 timeout: 900 lvb_type: 1 00010000:00010000:3.0:1746065201.355958:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094896200/0x14b4f8542d4ff1b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f4c expref: 18 pid: 25185 timeout: 900 lvb_type: 1 00010000:00010000:3.0:1746065201.355975:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.355977:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.355982:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.355990:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.356008:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065201.356036:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263444352:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 138us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.356041:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7967 00000100:00100000:3.0:1746065201.356056:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7968 00000100:00100000:3.0:1746065201.356061:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263444224:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065201.356069:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065201.356080:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 25 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:3.0:1746065201.356088:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 26 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:3.0:1746065201.356100:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f46b600/0x14b4f8542d4ff1b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f45 expref: 26 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:3.0:1746065201.356109:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.356111:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.356113:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.356119:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.356132:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065201.356147:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263444224:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 86us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.356152:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7968 00010000:00010000:0.0:1746065201.356237:0:4545:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356247:0:4545:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356267:0:4545:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356274:0:4545:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356280:0:4545:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356286:0:4545:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f716a00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065201.356289:0:4545:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356295:0:4545:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356303:0:4545:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356339:0:4545:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f716a00/0x14b4f8542d4ff1ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.356388:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1959:x1830881263443584:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 8910us (8954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.356396:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15429 00010000:00010000:0.0:1746065201.356432:0:4544:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356439:0:4544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356453:0:4544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356459:0:4544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356465:0:4544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356471:0:4544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800ad3b1800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065201.356473:0:4544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356479:0:4544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356487:0:4544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.356494:0:4544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800ad3b1800/0x14b4f8542d4ff1f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.356781:0:4544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263443456:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 9356us (9743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.356786:0:4544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15428 00000100:00100000:0.0:1746065201.360928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.362680:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263443968:12345-192.168.202.46@tcp:4:cat.0 Request processed in 8505us (8659us total) trans 21474841059 rc 0/0 00000100:00100000:3.0:1746065201.362692:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2621 00002000:00100000:3.0:1746065201.362718:0:21485:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x380:0x0] (790528->1048575) req@ffff88008fd06680 x1830881263443968/t21474841059(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:117/0 lens 488/448 e 0 to 0 dl 1746065212 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065201.362734:0:21485:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fd06680 with x1830881263443968 ext(790528->1048575) 00010000:00010000:3.0:1746065201.362744:0:21485:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 16 pid: 2462 timeout: 900 lvb_type: 0 00010000:00010000:3.0:1746065201.362759:0:21485:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 16 pid: 2462 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065201.363123:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444480 00000100:00100000:1.0:1746065201.363132:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444480 00010000:00010000:1.0:1746065201.363163:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746065201.363194:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7969 00000100:00100000:1.0:1746065201.363201:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1959:x1830881263444480:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.363215:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.363234:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746065201.363244:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746065201.363266:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cbec00/0x14b4f8542d4ff11f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61eff expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746065201.363294:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.363296:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.363300:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363308:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363328:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.363338:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.363347:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1959:x1830881263444480:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 147us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.363352:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7969 00000100:00100000:1.0:1746065201.363367:0:15963:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444608 00000100:00100000:1.0:1746065201.363370:0:15963:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444608 00010000:00010000:1.0:1746065201.363379:0:15963:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 17 pid: 21998 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065201.363392:0:15963:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7970 00000100:00100000:1.0:1746065201.363397:0:15963:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263444608:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.363403:0:15963:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.363415:0:15963:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 17 pid: 21998 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065201.363422:0:15963:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 17 pid: 21998 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065201.363433:0:15963:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0fd800/0x14b4f8542d4ff17a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f22 expref: 17 pid: 21998 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065201.363441:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.363443:0:15963:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.363445:0:15963:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363451:0:15963:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363461:0:15963:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.363475:0:15963:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263444608:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.363480:0:15963:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7970 00010000:00010000:1.0:1746065201.363498:0:8851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363504:0:8851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363520:0:8851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363526:0:8851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363532:0:8851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363539:0:8851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f46ae00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065201.363542:0:8851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363549:0:8851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363558:0:8851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.363564:0:8851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f46ae00/0x14b4f8542d4ff20d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.363594:0:9716:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.363602:0:9716:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.363606:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1959:x1830881263443840:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 15839us (15969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.363613:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15431 00010000:00010000:0.0:1746065201.363617:0:9716:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.363624:0:9716:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.363630:0:9716:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.363635:0:9716:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd34000 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065201.363637:0:9716:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.363659:0:9716:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.363669:0:9716:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.363675:0:9716:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd34000/0x14b4f8542d4ff206 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.363715:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1959:x1830881263443712:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 16014us (16105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.363721:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15430 00000100:00100000:0.0:1746065201.366899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.367036:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444736 00000100:00100000:2.0:1746065201.367046:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444736 00010000:00010000:2.0:1746065201.367083:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 15 pid: 2462 timeout: 900 lvb_type: 0 00000100:00100000:2.0:1746065201.367115:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7971 00000100:00100000:2.0:1746065201.367122:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1958:x1830881263444736:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065201.367136:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065201.367155:0:8444:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065198 -> 1746065200 00002000:00010000:2.0:1746065201.367157:0:8444:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065198 -> 1746065200 00010000:00010000:2.0:1746065201.367163:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 15 pid: 2462 timeout: 900 lvb_type: 0 00010000:00010000:2.0:1746065201.367173:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 15 pid: 2462 timeout: 900 lvb_type: 0 00010000:00010000:2.0:1746065201.367196:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801356c1000/0x14b4f8542d4ff173 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 790528->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f1b expref: 15 pid: 2462 timeout: 900 lvb_type: 0 00010000:00010000:2.0:1746065201.367219:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.367222:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.367226:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.367234:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.367255:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065201.367293:0:8428:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.367295:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1958:x1830881263444736:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 173us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.367301:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7971 00010000:00010000:0.0:1746065201.367301:0:8428:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.367323:0:8428:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.367330:0:8428:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.367336:0:8428:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.367343:0:8428:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd35800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065201.367346:0:8428:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.367353:0:8428:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.367363:0:8428:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.367369:0:8428:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd35800/0x14b4f8542d4ff1ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.367416:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+13:1959:x1830881263443200:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 20221us (20452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.367424:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15426 00002000:00010000:3.0:1746065201.367525:0:21485:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fd06680 00000100:00100000:1.0:1746065201.368937:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263444096:12345-192.168.202.46@tcp:4:cat.0 Request processed in 13035us (13380us total) trans 17179873768 rc 0/0 00000100:00100000:1.0:1746065201.368946:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 2622 00002000:00100000:1.0:1746065201.368956:0:8435:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x387:0x0] (1048576->1273855) req@ffff880135cde680 x1830881263444096/t17179873768(0) o4->7471aa0c-7b2a-4d2f-bfd9-d331bc906f82@192.168.202.46@tcp:117/0 lens 488/448 e 0 to 0 dl 1746065212 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065201.368965:0:8435:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135cde680 with x1830881263444096 ext(1048576->1273855) 00010000:00010000:1.0:1746065201.368974:0:8435:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065201.368985:0:8435:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 900 lvb_type: 0 00002000:00010000:1.0:1746065201.368992:0:8435:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135cde680 00000100:00100000:2.0:1746065201.373696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.374026:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263444864 00000100:00100000:0.0:1746065201.374035:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263444864 00010000:00010000:0.0:1746065201.374288:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746065201.374334:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7972 00000100:00100000:0.0:1746065201.374342:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5beec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1960:x1830881263444864:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.374358:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.374384:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065201.374397:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50000400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065201.374423:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0fd200/0x14b4f8542d4ff181 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x44801400020020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f29 expref: 22 pid: 21998 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065201.374438:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.374441:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.374445:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.374453:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.376280:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.376358:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5beec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263444864:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 2010us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.376370:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7972 00010000:00010000:3.0:1746065201.376531:0:2463:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.376542:0:2463:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.376571:0:2463:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.376578:0:2463:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.376585:0:2463:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.376590:0:2463:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f717800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065201.376593:0:2463:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.376605:0:2463:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.376622:0:2463:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.376627:0:2463:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f717800/0x14b4f8542d4ff1f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2463 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.376697:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1959:x1830881263443328:12345-192.168.202.46@tcp:1:lfs.0 Request processed in 29474us (29693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.376703:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15427 00000100:00100000:2.0:1746065201.383064:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.383259:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445120 00000100:00100000:1.0:1746065201.383269:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445120 00000100:00100000:1.0:1746065201.383874:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10175 00000100:00100000:1.0:1746065201.383886:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+261:32270:x1830881263445120:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:1.0:1746065201.383943:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065201.383972:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01adc00/0x14b4f8542d4ff0f5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61edc expref: 261 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.384311:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb5c200/0x14b4f8542d4fef7b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61de7 expref: 260 pid: 14643 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.384326:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1cbc00/0x14b4f8542d4fef9e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61df5 expref: 259 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.384336:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065201.384340:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065201.384375:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.384387:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.384395:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000040:00080000:1.0:1746065201.385146:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3193, 88 off270424 00000004:00080000:1.0:1746065201.385175:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676359449ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385220:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3207, 88 off271832 00000004:00080000:1.0:1746065201.385225:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800676409208ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065201.385273:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3208, 88 off271920 00000004:00080000:1.0:1746065201.385277:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800676461838ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065201.385288:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3194, 88 off270512 00000004:00080000:1.0:1746065201.385290:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676475014ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385296:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3195, 88 off270600 00000004:00080000:1.0:1746065201.385298:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676482674ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385303:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3209, 88 off272008 00000004:00080000:1.0:1746065201.385307:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800676491121ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065201.385315:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3210, 88 off272096 00000004:00080000:1.0:1746065201.385318:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800676502401ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065201.385326:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3211, 88 off272184 00000004:00080000:1.0:1746065201.385329:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800676513588ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065201.385337:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3196, 88 off270688 00000004:00080000:1.0:1746065201.385340:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676524535ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385346:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3212, 88 off272272 00000004:00080000:1.0:1746065201.385348:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800676533009ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065201.385356:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3197, 88 off270776 00000004:00080000:1.0:1746065201.385359:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676543631ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385364:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3213, 88 off272360 00000004:00080000:1.0:1746065201.385367:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800676551523ns, next at 737095943431ns, rc = 0 00000040:00080000:1.0:1746065201.385375:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3198, 88 off270864 00000004:00080000:1.0:1746065201.385377:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676561683ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385382:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3199, 88 off270952 00000004:00080000:1.0:1746065201.385384:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676568890ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385389:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3200, 88 off271040 00000004:00080000:1.0:1746065201.385391:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676575803ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385396:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3201, 88 off271128 00000004:00080000:1.0:1746065201.385399:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800676583633ns, next at 737048221954ns, rc = 0 00000040:00080000:1.0:1746065201.385405:0:14645:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3214, 88 off272448 00000004:00080000:1.0:1746065201.385407:0:14645:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800676591649ns, next at 737095943431ns, rc = 0 00000004:00010000:1.0:1746065201.415236:0:14645:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009bee3800 reply state ffff8800aa09cc00 transno 8589944474 ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065201.415287:0:14645:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065201.415419:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+260:32270:x1830881263445120:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 31530us (32362us total) trans 8589944474 rc 0/0 00000100:00100000:1.0:1746065201.415428:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10175 00000001:00080000:1.0:1746065201.415468:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944465 is committed 00000001:00080000:1.0:1746065201.415478:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944453 is committed 00000001:00080000:1.0:1746065201.415491:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944474 is committed 00000004:00080000:1.0:1746065201.415496:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2494 committed 00000004:00080000:1.0:1746065201.415508:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2480 committed 00000004:00080000:1.0:1746065201.415514:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2479 committed 00000004:00080000:1.0:1746065201.415516:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2478 committed 00000004:00080000:1.0:1746065201.415517:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2477 committed 00000004:00080000:1.0:1746065201.415519:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2493 committed 00000004:00080000:1.0:1746065201.415521:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2476 committed 00000004:00080000:1.0:1746065201.415522:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2492 committed 00000004:00080000:1.0:1746065201.415524:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2475 committed 00000004:00080000:1.0:1746065201.415525:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2491 committed 00000004:00080000:1.0:1746065201.415527:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2490 committed 00000004:00080000:1.0:1746065201.415529:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2489 committed 00000004:00080000:1.0:1746065201.415530:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2474 committed 00000004:00080000:1.0:1746065201.415532:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2473 committed 00000004:00080000:1.0:1746065201.415533:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2488 committed 00000004:00080000:1.0:1746065201.415535:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2487 committed 00000004:00080000:1.0:1746065201.415537:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2472 committed 00000001:00100000:1.0:1746065201.415547:0:14720:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 26bbd020-9fba-464a-bebc-8395a287959e 00000100:00100000:0.0:1746065201.415653:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260495232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.415696:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.415733:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260495744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.415743:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.415754:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065201.415757:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260494848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.415764:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.415770:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260495360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.415777:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.415793:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260495232 00000100:00100000:0.0:1746065201.415799:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260495232 00000100:00100000:0.0:1746065201.415851:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260495744 00000100:00100000:0.0:1746065201.415854:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260495744 00000100:00100000:0.0:1746065201.415863:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260494848 00000100:00100000:0.0:1746065201.415864:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260494848 00000100:00100000:0.0:1746065201.415872:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260495360 00000100:00100000:0.0:1746065201.415874:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260495360 00000100:00100000:0.0:1746065201.415886:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15432 00000100:00100000:0.0:1746065201.415892:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260495232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065201.416070:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065201.416073:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065201.416075:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:0.0:1746065201.416077:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:0.0:1746065201.416078:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746065201.416102:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260495232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (405us total) trans 17179873769 rc 0/0 00000100:00100000:0.0:1746065201.416108:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15432 00000100:00100000:0.0:1746065201.416125:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15433 00000100:00100000:0.0:1746065201.416129:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260495744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.416211:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260495744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (465us total) trans 17179873770 rc 0/0 00000100:00100000:0.0:1746065201.416216:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15433 00000100:00100000:0.0:1746065201.416227:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15434 00000100:00100000:0.0:1746065201.416231:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260494848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.416315:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260494848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (549us total) trans 17179873771 rc 0/0 00000100:00100000:0.0:1746065201.416320:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15434 00000100:00100000:0.0:1746065201.416331:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15435 00000100:00100000:0.0:1746065201.416334:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260495360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.416407:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260495360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (628us total) trans 17179873772 rc 0/0 00000100:00100000:0.0:1746065201.416413:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15435 00000100:00100000:0.0:1746065201.416485:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873762 gen 2 00000004:00080000:0.0:1746065201.416489:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82c000, transno 17179873714 00000004:00080000:0.0:1746065201.416494:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82ce00, transno 17179873715 00000004:00080000:0.0:1746065201.416496:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82c380, transno 17179873716 00000004:00080000:0.0:1746065201.416498:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82d180, transno 17179873717 00000004:00080000:0.0:1746065201.416500:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82c700, transno 17179873718 00000004:00080000:0.0:1746065201.416502:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82d500, transno 17179873719 00000004:00080000:0.0:1746065201.416503:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82ca80, transno 17179873720 00000004:00080000:0.0:1746065201.416505:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82d880, transno 17179873721 00000004:00080000:0.0:1746065201.416506:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f145180, transno 17179873727 00000004:00080000:0.0:1746065201.416508:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f144a80, transno 17179873728 00000004:00080000:0.0:1746065201.416510:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f144e00, transno 17179873729 00000004:00080000:0.0:1746065201.416512:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f144380, transno 17179873730 00000004:00080000:0.0:1746065201.416513:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f146d80, transno 17179873731 00000004:00080000:0.0:1746065201.416516:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f147480, transno 17179873732 00000004:00080000:0.0:1746065201.416517:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f144700, transno 17179873733 00000004:00080000:0.0:1746065201.416519:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f145f80, transno 17179873734 00000004:00080000:0.0:1746065201.416521:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fbb80, transno 17179873735 00000004:00080000:0.0:1746065201.416523:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f210700, transno 17179873736 00000004:00080000:0.0:1746065201.416525:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fb100, transno 17179873737 00000004:00080000:0.0:1746065201.416527:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fb800, transno 17179873738 00000004:00080000:0.0:1746065201.416529:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb10e00, transno 17179873739 00000004:00080000:0.0:1746065201.416531:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fb480, transno 17179873740 00000004:00080000:0.0:1746065201.416533:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa77b80, transno 17179873741 00000004:00080000:0.0:1746065201.416535:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f212a00, transno 17179873742 00000004:00080000:0.0:1746065201.416537:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9e8700, transno 17179873747 00000004:00080000:0.0:1746065201.416539:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9ea300, transno 17179873748 00000004:00080000:0.0:1746065201.416540:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9eaa00, transno 17179873749 00000004:00080000:0.0:1746065201.416542:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9eb800, transno 17179873750 00000004:00080000:0.0:1746065201.416544:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9ebb80, transno 17179873751 00000004:00080000:0.0:1746065201.416546:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9e9500, transno 17179873752 00000004:00080000:0.0:1746065201.416548:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9ea680, transno 17179873753 00000004:00080000:0.0:1746065201.416550:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9e9880, transno 17179873754 00000004:00080000:0.0:1746065201.416552:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0ce00, transno 17179873755 00000004:00080000:0.0:1746065201.416553:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f147800, transno 17179873756 00000004:00080000:0.0:1746065201.416555:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0fb80, transno 17179873757 00000004:00080000:0.0:1746065201.416557:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f146680, transno 17179873758 00000004:00080000:0.0:1746065201.416559:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0d880, transno 17179873759 00000004:00080000:0.0:1746065201.416561:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f145500, transno 17179873760 00000004:00080000:0.0:1746065201.416563:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129b0dc00, transno 17179873761 00000004:00080000:0.0:1746065201.416564:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f146a00, transno 17179873762 00000100:00100000:0.0:1746065201.416570:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008fd07b80 x1830881260494848/t17179873771(17179873771) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065217 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065201.416579:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd07b80/2, rc 0, transno 17179873771 00000100:00100000:0.0:1746065201.416583:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260494848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.416591:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05f80/2, rc 0, transno 17179873772 00000100:00100000:0.0:1746065201.416594:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260495360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.416601:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd07800/2, rc 0, transno 17179873769 00000100:00100000:0.0:1746065201.416603:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260495232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.416608:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05c00/2, rc 0, transno 17179873770 00000100:00100000:0.0:1746065201.416611:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260495744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.417116:0:14686:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 40 done 00000001:00080000:1.0:1746065201.417185:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944470 is committed 00000001:00100000:1.0:1746065201.417219:0:14720:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b2f22f6-12f3-444f-91d0-7389d1a69692 00000001:00080000:1.0:1746065201.417225:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944471 is committed 00000020:00000080:1.0:1746065201.417227:0:14720:0:(genops.c:904:class_export_put()) final put ffff880094d55000/3b2f22f6-12f3-444f-91d0-7389d1a69692 00000020:00000080:1.0:1746065201.417256:0:14720:0:(genops.c:904:class_export_put()) final put ffff880094d53800/26bbd020-9fba-464a-bebc-8395a287959e 00000100:00100000:1.0:1746065201.417272:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260494976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.417301:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.417322:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260494976 00000100:00100000:0.0:1746065201.417326:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260494976 00000100:00100000:1.0:1746065201.417338:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260495488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.417345:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15436 00000100:00100000:0.0:1746065201.417349:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830881260494976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.417354:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.417369:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065201.417373:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260495104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.417386:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.417397:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260495616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.417408:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.417430:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260495488 00000100:00100000:1.0:1746065201.417434:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260495488 00000100:00100000:1.0:1746065201.417450:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260495104 00000100:00100000:1.0:1746065201.417451:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260495104 00000100:00100000:1.0:1746065201.417460:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260495616 00000100:00100000:1.0:1746065201.417462:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260495616 00000100:00100000:1.0:1746065201.417474:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15437 00000100:00100000:1.0:1746065201.417478:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260495488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.417493:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260494976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (191us total) trans 17179873773 rc 0/0 00000100:00100000:0.0:1746065201.417499:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15436 00000100:00100000:0.0:1746065201.417509:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15438 00000100:00100000:0.0:1746065201.417514:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260495104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.417620:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260495104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (232us total) trans 17179873774 rc 0/0 00000100:00100000:0.0:1746065201.417625:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15438 00000100:00100000:0.0:1746065201.417636:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15439 00000100:00100000:0.0:1746065201.417651:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830881260495616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.417726:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260495616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (316us total) trans 17179873775 rc 0/0 00000100:00100000:0.0:1746065201.417731:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15439 00000020:00000080:2.0:1746065201.417740:0:66:0:(genops.c:863:class_export_destroy()) destroying export ffff880094d55000/3b2f22f6-12f3-444f-91d0-7389d1a69692 for lustre-MDT0000 00000020:00000080:2.0:1746065201.417791:0:66:0:(genops.c:863:class_export_destroy()) destroying export ffff880094d53800/26bbd020-9fba-464a-bebc-8395a287959e for lustre-MDT0000 00000020:00000080:2.0:1746065201.417837:0:66:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880094d51800 for lustre-MDT0000 00000020:00000080:2.0:1746065201.417841:0:66:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880094d57800 for lustre-MDT0000 00000100:00100000:2.0:1746065201.417855:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260496256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.417880:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.417897:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260496768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.417899:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260496256 00000100:00100000:0.0:1746065201.417903:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260496256 00000100:00100000:2.0:1746065201.417910:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.417922:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065201.417922:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260496768 00000100:00100000:2.0:1746065201.417925:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260495872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.417925:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260496768 00000100:00100000:0.0:1746065201.417933:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15440 00000100:00100000:0.0:1746065201.417937:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1830881260496256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.417938:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.417960:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260496384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.417974:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.417989:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260495872 00000100:00100000:2.0:1746065201.417992:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260495872 00000100:00100000:2.0:1746065201.418007:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260496384 00000100:00100000:2.0:1746065201.418009:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260496384 00000100:00100000:2.0:1746065201.418019:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15441 00000100:00100000:2.0:1746065201.418023:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260496768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.418055:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260496256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (173us total) trans 21474841060 rc 0/0 00000100:00100000:0.0:1746065201.418059:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15440 00000100:00100000:0.0:1746065201.418069:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15442 00000100:00100000:0.0:1746065201.418073:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3297:x1830881260495872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.418121:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260496768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (209us total) trans 21474841061 rc 0/0 00000100:00100000:2.0:1746065201.418126:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15441 00000100:00100000:2.0:1746065201.418138:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15443 00000100:00100000:2.0:1746065201.418143:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260496384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.418155:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3297:x1830881260495872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (215us total) trans 21474841062 rc 0/0 00000100:00100000:0.0:1746065201.418160:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15442 00000100:00100000:0.0:1746065201.418273:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260496128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.418293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.418306:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260496640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.418324:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.418327:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830881260495488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 847us (970us total) trans 17179873776 rc 0/0 00000100:00100000:1.0:1746065201.418332:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15437 00000100:00100000:0.0:1746065201.418335:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065201.418340:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260496128 00000100:00100000:0.0:1746065201.418340:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260496000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.418342:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260496128 00000100:00100000:1.0:1746065201.418352:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260496640 00000100:00100000:1.0:1746065201.418354:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260496640 00000100:00100000:0.0:1746065201.418355:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.418362:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260496000 00000100:00100000:1.0:1746065201.418364:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260496000 00000100:00100000:0.0:1746065201.418365:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260496512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.418370:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15444 00000100:00100000:1.0:1746065201.418374:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1830881260496128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.418380:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.418395:0:4545:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260496512 00000100:00100000:0.0:1746065201.418397:0:4545:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260496512 00000100:00100000:0.0:1746065201.418410:0:4545:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15445 00000100:00100000:1.0:1746065201.418481:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260496128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (187us total) trans 21474841064 rc 0/0 00000100:00100000:1.0:1746065201.418487:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15444 00000100:00100000:1.0:1746065201.418495:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15446 00000100:00100000:1.0:1746065201.418499:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260496000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.418509:0:4545:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3296:x1830881260496640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.418587:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3296:x1830881260496000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (230us total) trans 21474841065 rc 0/0 00000100:00100000:1.0:1746065201.418592:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15446 00000100:00100000:0.0:1746065201.418594:0:4545:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3296:x1830881260496640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (269us total) trans 21474841066 rc 0/0 00000100:00100000:0.0:1746065201.418599:0:4545:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15445 00000100:00100000:1.0:1746065201.418601:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15447 00000100:00100000:1.0:1746065201.418605:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260496512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.418690:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3296:x1830881260496512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (308us total) trans 21474841067 rc 0/0 00000100:00100000:1.0:1746065201.418694:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15447 00000100:00100000:0.0:1746065201.418714:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841055 gen 2 00000004:00080000:0.0:1746065201.418718:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3d180, transno 21474841003 00000004:00080000:0.0:1746065201.418724:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba2d80, transno 21474841004 00000004:00080000:0.0:1746065201.418726:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3c700, transno 21474841005 00000004:00080000:0.0:1746065201.418727:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ba0000, transno 21474841006 00000004:00080000:0.0:1746065201.418730:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d95180, transno 21474841007 00000004:00080000:0.0:1746065201.418732:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3ce00, transno 21474841008 00000004:00080000:0.0:1746065201.418735:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3f100, transno 21474841009 00000004:00080000:0.0:1746065201.418737:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba3d880, transno 21474841010 00000004:00080000:0.0:1746065201.418739:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b620000, transno 21474841011 00000004:00080000:0.0:1746065201.418743:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fa300, transno 21474841015 00000004:00080000:0.0:1746065201.418745:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fd71880, transno 21474841016 00000004:00080000:0.0:1746065201.418748:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f8e00, transno 21474841017 00000004:00080000:0.0:1746065201.418750:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f8380, transno 21474841018 00000004:00080000:0.0:1746065201.418752:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f8000, transno 21474841019 00000004:00080000:0.0:1746065201.418754:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f8700, transno 21474841020 00000004:00080000:0.0:1746065201.418755:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913fad80, transno 21474841021 00000004:00080000:0.0:1746065201.418758:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800913f8a80, transno 21474841022 00000004:00080000:0.0:1746065201.418760:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5880a80, transno 21474841023 00000004:00080000:0.0:1746065201.418762:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f468e00, transno 21474841024 00000004:00080000:0.0:1746065201.418764:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba1ca80, transno 21474841025 00000004:00080000:0.0:1746065201.418766:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d136a00, transno 21474841026 00000004:00080000:0.0:1746065201.418769:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fcace00, transno 21474841027 00000004:00080000:0.0:1746065201.418771:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d134700, transno 21474841028 00000004:00080000:0.0:1746065201.418773:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095351c00, transno 21474841029 00000004:00080000:0.0:1746065201.418775:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d136d80, transno 21474841030 00000004:00080000:0.0:1746065201.418778:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095350a80, transno 21474841031 00000004:00080000:0.0:1746065201.418781:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d135500, transno 21474841032 00000004:00080000:0.0:1746065201.418783:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9eb100, transno 21474841038 00000004:00080000:0.0:1746065201.418785:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9e9180, transno 21474841039 00000100:00100000:2.0:1746065201.418786:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3297:x1830881260496384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (247us total) trans 21474841063 rc 0/0 00000004:00080000:0.0:1746065201.418787:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fcac700, transno 21474841040 00000004:00080000:0.0:1746065201.418790:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9e8380, transno 21474841041 00000100:00100000:2.0:1746065201.418791:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15443 00000004:00080000:0.0:1746065201.418792:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9e8e00, transno 21474841042 00000004:00080000:0.0:1746065201.418794:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9e9f80, transno 21474841043 00000004:00080000:0.0:1746065201.418796:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9ead80, transno 21474841044 00000004:00080000:0.0:1746065201.418798:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f9e8000, transno 21474841045 00000004:00080000:0.0:1746065201.418801:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009380e680, transno 21474841046 00000004:00080000:0.0:1746065201.418803:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f211880, transno 21474841047 00000004:00080000:0.0:1746065201.418806:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b621180, transno 21474841048 00000004:00080000:0.0:1746065201.418808:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f211500, transno 21474841049 00000004:00080000:0.0:1746065201.418810:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b622a00, transno 21474841050 00000004:00080000:0.0:1746065201.418812:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f210000, transno 21474841051 00000004:00080000:0.0:1746065201.418831:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f212d80, transno 21474841052 00000004:00080000:0.0:1746065201.418833:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b82f800, transno 21474841053 00000004:00080000:0.0:1746065201.418836:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f211f80, transno 21474841054 00000004:00080000:0.0:1746065201.418838:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f213100, transno 21474841055 00000100:00100000:0.0:1746065201.418843:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009bee0380 x1830881260496000/t21474841065(21474841065) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065217 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065201.418852:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee0380/2, rc 0, transno 21474841065 00000100:00100000:0.0:1746065201.418855:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260496000:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065201.418870:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065201.418881:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065201.418887:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065201.418892:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009534ea00 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065201.418896:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065201.418903:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065201.418919:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065201.418923:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065201.418927:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:3.0:1746065201.418932:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009534ea00/0x14b4f8542d4ff214 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00000100:00080000:3.0:1746065201.418962:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746065201.418965:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746065201.418996:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee0e00/2, rc 0, transno 21474841062 00000100:00100000:2.0:1746065201.419000:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260495872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.419005:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee2a00/2, rc 0, transno 21474841067 00000004:00080000:2.0:1746065201.419010:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee3100/2, rc 0, transno 21474841063 00000100:00100000:0.0:1746065201.419010:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260496512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.419013:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260496384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.419017:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee1500/2, rc 0, transno 21474841064 00000100:00100000:0.0:1746065201.419020:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260496128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.419026:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee1f80/2, rc 0, transno 21474841066 00000004:00080000:2.0:1746065201.419029:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee0a80/2, rc 0, transno 21474841060 00000100:00100000:0.0:1746065201.419029:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260496640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.419031:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260496256:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065201.419037:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bee2680/2, rc 0, transno 21474841061 00000100:00100000:2.0:1746065201.419039:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260496768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.419223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.419273:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445248 00000100:00100000:1.0:1746065201.419276:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445248 00000100:00100000:1.0:1746065201.419296:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10176 00000100:00100000:1.0:1746065201.419301:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:32270:x1830881263445248:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065201.419313:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.419325:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f61 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.419365:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 249 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.419376:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 249 pid: 14645 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746065201.419385:0:14683:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 45 done 00010000:00010000:1.0:1746065201.419390:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065201.419392:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065201.419395:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c395600, rc 0) 00000100:00100000:1.0:1746065201.419925:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32270:x1830881263445248:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 623us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.419930:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10176 00000100:00100000:3.0:1746065201.420014:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260496896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.420042:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06a00/2, rc 0, transno 17179873774 00000100:00100000:0.0:1746065201.420047:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260495104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.420084:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05180/2, rc 0, transno 17179873775 00000100:00100000:0.0:1746065201.420088:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260495616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065201.420092:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065201.420095:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd06d80/2, rc 0, transno 17179873773 00000100:00100000:0.0:1746065201.420098:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260494976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.420104:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fd05880/2, rc 0, transno 17179873776 00000100:00100000:0.0:1746065201.420107:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260495488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065201.420198:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260496896 00000100:00100000:2.0:1746065201.420201:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260496896 00000100:00100000:2.0:1746065201.420217:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15448 00000100:00100000:2.0:1746065201.420221:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3298:x1830881260496896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.420320:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3298:x1830881260496896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (228us total) trans 21474841068 rc 0/0 00000100:00100000:2.0:1746065201.420325:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15448 00000004:00080000:0.0:1746065201.420329:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f9cc380/2, rc 0, transno 21474841068 00000100:00100000:0.0:1746065201.420333:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830881260496896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.422924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.423004:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445376 00000100:00100000:1.0:1746065201.423015:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445376 00000100:00100000:1.0:1746065201.423066:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10177 00000100:00100000:1.0:1746065201.423073:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32270:x1830881263445376:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065201.423087:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.423102:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4ff222 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f68 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.423163:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4ff229 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.423173:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4ff229 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.423181:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4ff229 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00200000:1.0:1746065201.423200:0:14645:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x30c:0x0]: returning size 9206464 00000004:00200000:1.0:1746065201.423203:0:14645:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746065201.423212:0:14645:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4ff229 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.423229:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4600/0x14b4f8542d4ff222 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f68 expref: 251 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.423246:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4ff229 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f68 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.423254:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065201.423256:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065201.423259:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ed4800, rc 0) 00000100:00100000:1.0:1746065201.423311:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32270:x1830881263445376:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 238us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.423317:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10177 00000100:00100000:3.0:1746065201.426426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.426465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.426479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.426495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.426508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.426959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.426989:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445504 00000100:00100000:3.0:1746065201.426997:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445504 00000100:00100000:3.0:1746065201.427035:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445632 00000100:00100000:3.0:1746065201.427036:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445632 00000100:00100000:3.0:1746065201.427050:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446144 00000100:00100000:1.0:1746065201.427051:0:8428:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445888 00000100:00100000:3.0:1746065201.427052:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446144 00000100:00100000:1.0:1746065201.427062:0:8428:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445888 00000100:00100000:3.0:1746065201.427063:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263445760 00000100:00100000:3.0:1746065201.427065:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263445760 00000100:00100000:3.0:1746065201.427074:0:21998:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446016 00000100:00100000:3.0:1746065201.427076:0:21998:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446016 00000100:00100000:3.0:1746065201.427090:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15449 00000100:00100000:3.0:1746065201.427097:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+14:1961:x1830881263445504:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:1.0:1746065201.427103:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15450 00000100:00100000:1.0:1746065201.427111:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+22:1961:x1830881263445632:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065201.427115:0:21998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.427124:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065201.427134:0:21998:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f6f expref: -99 pid: 21998 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.427141:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f76 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065201.427159:0:21998:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x380:0x0] initial LVB size: 1048576, mtime: 0x6812d730, atime: 0x6812d72b, ctime: 0x6812d730, blocks: 0x7b1 00002000:00010000:1.0:1746065201.427161:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x387:0x0] initial LVB size: 2097152, mtime: 0x6812d730, atime: 0x6812d730, ctime: 0x6812d730, blocks: 0x81f 00010000:00010000:3.0:1746065201.427177:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.427178:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.427179:0:21998:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.427180:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.427186:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.427187:0:21998:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.427200:0:21998:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 15 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.427201:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.427210:0:21998:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548d600, rc 0) 00010000:00010000:1.0:1746065201.427210:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c395200, rc 0) 00000100:00100000:0.0:1746065201.427287:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15451 00000100:00100000:0.0:1746065201.427295:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263446144:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065201.427302:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065201.427312:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f92 expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065201.427326:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x389:0x0] initial LVB size: 4194304, mtime: 0x6812d730, atime: 0x6812d72d, ctime: 0x6812d730, blocks: 0x1029 00010000:00010000:0.0:1746065201.427334:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.427335:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.427340:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065201.427351:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263445632:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 240us (884us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065201.427353:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065201.427360:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15450 00010000:00010000:0.0:1746065201.427360:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092775c00, rc 0) 00000100:00100000:1.0:1746065201.427374:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15452 00000100:00100000:1.0:1746065201.427380:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263445760:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:0.0:1746065201.427380:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263446144:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 86us (884us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065201.427386:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065201.427386:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15451 00010000:00010000:1.0:1746065201.427394:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f7d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.427399:0:9716:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15453 00002000:00010000:1.0:1746065201.427404:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x388:0x0] initial LVB size: 2097152, mtime: 0x6812d730, atime: 0x6812d730, ctime: 0x6812d730, blocks: 0x821 00000100:00100000:0.0:1746065201.427404:0:9716:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263446016:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:0.0:1746065201.427409:0:9716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.427413:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.427414:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.427418:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.427418:0:9716:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f8b expref: -99 pid: 9716 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.427427:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 23 pid: 8428 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746065201.427430:0:9716:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x383:0x0] initial LVB size: 5012160, mtime: 0x6812d730, atime: 0x6812d730, ctime: 0x6812d730, blocks: 0x1689 00010000:00010000:1.0:1746065201.427433:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c732000, rc 0) 00010000:00010000:0.0:1746065201.427436:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.427438:0:9716:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.427441:0:9716:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065201.427449:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263445760:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 70us (940us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065201.427450:0:9716:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065201.427454:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15452 00010000:00010000:0.0:1746065201.427456:0:9716:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092774000, rc 0) 00000100:00100000:1.0:1746065201.427464:0:8428:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15454 00000100:00100000:1.0:1746065201.427468:0:8428:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263445888:12345-192.168.202.46@tcp:101:lfs.0 00000100:00100000:0.0:1746065201.427471:0:9716:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263446016:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 67us (513us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065201.427474:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065201.427480:0:9716:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15453 00010000:00010000:1.0:1746065201.427483:0:8428:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f84 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065201.427498:0:8428:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x382:0x0] initial LVB size: 2097152, mtime: 0x6812d730, atime: 0x6812d730, ctime: 0x6812d730, blocks: 0x821 00010000:00010000:1.0:1746065201.427504:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.427505:0:8428:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.427509:0:8428:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.427517:0:8428:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.427523:0:8428:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c733200, rc 0) 00000100:00100000:1.0:1746065201.427537:0:8428:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263445888:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 69us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.427541:0:8428:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15454 00000100:00100000:3.0:1746065201.428184:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263445504:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1086us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.428190:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15449 00000100:00100000:0.0:1746065201.445626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.445736:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446400 00000100:00100000:1.0:1746065201.445748:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446400 00000100:00100000:1.0:1746065201.446019:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8702 00000100:00100000:1.0:1746065201.446027:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263446400:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065201.446056:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.446068:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.446069:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.446074:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.446084:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.454339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.454407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.454470:0:21484:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446784 00000100:00100000:1.0:1746065201.454479:0:21484:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446784 00000100:00100000:2.0:1746065201.454497:0:21485:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263446656 00000100:00100000:2.0:1746065201.454503:0:21485:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263446656 00000100:00100000:1.0:1746065201.454535:0:21484:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8703 00000100:00100000:1.0:1746065201.454541:0:21484:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263446784:12345-192.168.202.46@tcp:3:lfs.0 00000100:00100000:2.0:1746065201.454554:0:21485:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8704 00000100:00100000:2.0:1746065201.454561:0:21485:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263446656:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:1.0:1746065201.454567:0:21484:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.454578:0:21484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.454579:0:21484:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.454583:0:21484:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.454593:0:21484:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.455193:0:21485:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.455205:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.455207:0:21485:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.455210:0:21485:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.455221:0:21485:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.459902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.460282:0:21481:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447168 00000100:00100000:2.0:1746065201.460294:0:21481:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447168 00000100:00100000:2.0:1746065201.460343:0:21481:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8705 00000100:00100000:2.0:1746065201.460349:0:21481:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263447168:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:2.0:1746065201.460386:0:21481:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.460403:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.460404:0:21481:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.460409:0:21481:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.460419:0:21481:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.461149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.461169:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.461239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.461263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.461283:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447296 00000100:00100000:0.0:1746065201.461289:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447296 00000100:00100000:0.0:1746065201.461440:0:4012:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447808 00000100:00100000:0.0:1746065201.461443:0:4012:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447808 00000100:00100000:3.0:1746065201.461470:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263447936 00000100:00100000:3.0:1746065201.461473:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263447936 00000100:00100000:3.0:1746065201.461493:0:21487:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448192 00000100:00100000:3.0:1746065201.461494:0:21487:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448192 00000100:00100000:3.0:1746065201.461508:0:21487:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8706 00000100:00100000:3.0:1746065201.461515:0:21487:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263447296:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065201.461542:0:21487:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.461555:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.461557:0:21487:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.461561:0:21487:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.461580:0:21487:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.462430:0:4012:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8707 00000100:00100000:0.0:1746065201.462439:0:4012:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263447808:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065201.462460:0:4012:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.462469:0:4012:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.462470:0:4012:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.462474:0:4012:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.462484:0:4012:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.462568:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8708 00000100:00100000:0.0:1746065201.462573:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+28:1960:x1830881263447936:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:0.0:1746065201.462590:0:8434:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.462597:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.462598:0:8434:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.462601:0:8434:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.462609:0:8434:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.462857:0:21483:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 8709 00000100:00100000:3.0:1746065201.462866:0:21483:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+20:1960:x1830881263448192:12345-192.168.202.46@tcp:3:lfs.0 00010000:00010000:3.0:1746065201.462883:0:21483:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.462890:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.462891:0:21483:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.462894:0:21483:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.462902:0:21483:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.477927:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.477946:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.477954:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.477960:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c733800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:1.0:1746065201.477964:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.477974:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.477992:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.477998:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c733800/0x14b4f8542d4ff25a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.478093:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+21:1960:x1830881263446400:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 32060us (32472us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065201.478103:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8702 00010000:00010000:3.0:1746065201.487914:0:21485:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.487929:0:21485:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.487936:0:21485:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.487941:0:21485:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800930cdc00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065201.487945:0:21485:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.487952:0:21485:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.487968:0:21485:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.487972:0:21485:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930cdc00/0x14b4f8542d4ff268 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21485 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.488056:0:21485:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+29:1960:x1830881263446656:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 33492us (33645us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065201.488065:0:21485:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8704 00010000:00010000:2.0:1746065201.497527:0:21484:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.497544:0:21484:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.497551:0:21484:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.497557:0:21484:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c732400 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065201.497560:0:21484:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.497566:0:21484:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.497582:0:21484:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.497588:0:21484:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c732400/0x14b4f8542d4ff261 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21484 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.497697:0:21484:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+27:1960:x1830881263446784:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 43150us (43365us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065201.497706:0:21484:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8703 00010000:00010000:3.0:1746065201.498879:0:21481:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.498889:0:21481:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.498896:0:21481:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.498902:0:21481:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c5a600 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065201.498905:0:21481:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.498911:0:21481:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.498925:0:21481:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.498931:0:21481:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c5a600/0x14b4f8542d4ff26f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21481 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.498991:0:21481:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+19:1961:x1830881263447168:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 38640us (39099us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065201.498997:0:21481:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8705 00010000:00010000:0.0:1746065201.506367:0:8434:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.506385:0:8434:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.506393:0:8434:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.506399:0:8434:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a56e9200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:0.0:1746065201.506403:0:8434:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.506410:0:8434:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.506427:0:8434:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.506438:0:8434:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a56e9200/0x14b4f8542d4ff284 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.506555:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1960:x1830881263447936:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 43977us (45312us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065201.506565:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8708 00010000:00010000:3.0:1746065201.512061:0:21483:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.512075:0:21483:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.512082:0:21483:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.512088:0:21483:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013548da00 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:3.0:1746065201.512093:0:21483:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.512100:0:21483:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.512117:0:21483:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.512127:0:21483:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013548da00/0x14b4f8542d4ff28b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21483 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065201.512984:0:21483:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263448192:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 50115us (51714us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065201.512994:0:21483:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8709 00010000:00010000:2.0:1746065201.518277:0:21487:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.518295:0:21487:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.518303:0:21487:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.518308:0:21487:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013548c800 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065201.518311:0:21487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.518318:0:21487:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.518332:0:21487:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.518337:0:21487:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013548c800/0x14b4f8542d4ff276 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21487 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.518410:0:21487:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263447296:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 56891us (57257us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065201.518420:0:21487:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8706 00010000:00010000:2.0:1746065201.523118:0:4012:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.523131:0:4012:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.523138:0:4012:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.523144:0:4012:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093486200 already unused, calling callback (ffffffffa0868d70) 00010000:00010000:2.0:1746065201.523148:0:4012:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.523156:0:4012:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.523170:0:4012:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.523176:0:4012:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093486200/0x14b4f8542d4ff27d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4012 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.524935:0:4012:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263447808:12345-192.168.202.46@tcp:3:lfs.0 Request processed in 62487us (63752us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065201.524946:0:4012:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 8707 00000100:00100000:0.0:1746065201.534851:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:1.0:1746065201.535615:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448448 00000100:00100000:1.0:1746065201.535625:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448448 00000100:00100000:1.0:1746065201.535692:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10178 00000100:00100000:1.0:1746065201.535700:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32270:x1830881263448448:12345-192.168.202.46@tcp:36:lfs.0 00010000:00010000:1.0:1746065201.535745:0:14645:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.535768:0:14645:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ed4800/0x14b4f8542d4ff229 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x30c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f68 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.535799:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:1.0:1746065201.535803:0:14645:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065201.535857:0:14645:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.535867:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:1.0:1746065201.535879:0:14645:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000004:00010000:1.0:1746065201.536075:0:14645:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f9cea00 reply state ffff88012c81e000 transno 8589944475 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14645 initiator: MDT0 00000100:00100000:1.0:1746065201.536087:0:14645:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065201.536953:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:32270:x1830881263448448:12345-192.168.202.46@tcp:36:lfs.0 Request processed in 1252us (3604us total) trans 8589944475 rc 0/0 00000100:00100000:1.0:1746065201.536960:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10178 00010000:00010000:2.0:1746065201.540331:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.540345:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.540351:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.540356:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e22800 already unused, calling callback (ffffffffa134b690) 00010000:00010000:2.0:1746065201.540359:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.540365:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.540377:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:2.0:1746065201.540379:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065201.540383:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00010000:00010000:2.0:1746065201.540388:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e22800/0x14b4f8542d4ff292 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14645 initiator: MDT0 00000100:00100000:0.0:1746065201.542509:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.542570:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448576 00000100:00100000:3.0:1746065201.542578:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448576 00000100:00100000:3.0:1746065201.542626:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15455 00000100:00100000:3.0:1746065201.542634:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:32270:x1830881263448576:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065201.542656:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065201.542670:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013548d000/0x14b4f8542d4ff299 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61f99 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.542692:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.542698:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.542700:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.542703:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013548d000/0x14b4f8542d4ff299 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f99 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.542726:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 16 pid: 21998 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.542736:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 16 pid: 21998 timeout: 900 lvb_type: 1 00000100:00100000:3.0:1746065201.542747:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260497024:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065201.542858:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065201.544399:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260497024:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065201.544419:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013548d000/0x14b4f8542d4ff299 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f99 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.544431:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548d000, rc 0) 00000100:00100000:3.0:1746065201.544468:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:32270:x1830881263448576:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 1835us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.544475:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15455 00000100:00100000:0.0:1746065201.546209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.547717:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448704 00000100:00100000:2.0:1746065201.547726:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448704 00010000:00010000:2.0:1746065201.547756:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 16 pid: 21998 timeout: 900 lvb_type: 1 00000100:00100000:2.0:1746065201.547792:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7973 00000100:00100000:2.0:1746065201.547799:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263448704:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065201.547809:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065201.547840:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 16 pid: 21998 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.547851:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 16 pid: 21998 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.547870:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013548d600/0x14b4f8542d4ff230 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f6f expref: 16 pid: 21998 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.548561:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.548564:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.548572:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013548d000/0x14b4f8542d4ff299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f99 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.548580:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013548d000/0x14b4f8542d4ff299 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f99 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.548609:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013548d000/0x14b4f8542d4ff299 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f99 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.548619:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260497152:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065201.549233:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065201.553747:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260497152:192.168.202.46@tcp:105: 00010000:00010000:3.0:1746065201.553767:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065201.553803:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263448704:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6003us (7597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.553825:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7973 00000100:00100000:2.0:1746065201.553942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.554083:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448832 00000100:00100000:3.0:1746065201.554088:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448832 00000100:00100000:3.0:1746065201.554117:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15456 00000100:00100000:3.0:1746065201.554123:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:32270:x1830881263448832:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065201.554137:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065201.554151:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013548c400/0x14b4f8542d4ff2a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61fa0 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.554173:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 24 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.554181:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.554183:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.554186:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013548c400/0x14b4f8542d4ff2a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa0 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.554207:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 24 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.554217:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00000100:00100000:3.0:1746065201.554226:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260497280:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065201.555355:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065201.558669:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260497280:192.168.202.46@tcp:104: 00000100:00100000:0.0:1746065201.558677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00010000:00010000:3.0:1746065201.558701:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013548c400/0x14b4f8542d4ff2a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa0 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.558717:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548c400, rc 0) 00000100:00100000:1.0:1746065201.559033:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263448960 00000100:00100000:1.0:1746065201.559040:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263448960 00000100:00100000:3.0:1746065201.559113:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:32270:x1830881263448832:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4659us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.559120:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15456 00010000:00010000:1.0:1746065201.559180:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746065201.559211:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7974 00000100:00100000:1.0:1746065201.559217:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263448960:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.559227:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.559244:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746065201.559252:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746065201.559270:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c395200/0x14b4f8542d4ff237 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x387:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f76 expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746065201.559299:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.559301:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.559306:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013548c400/0x14b4f8542d4ff2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa0 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.559312:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013548c400/0x14b4f8542d4ff2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa0 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.559335:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013548c400/0x14b4f8542d4ff2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa0 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.559344:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260497408:192.168.202.46@tcp:105: 00000100:00100000:1.0:1746065201.559395:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5a7de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065201.561149:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260497408:192.168.202.46@tcp:105: 00010000:00010000:1.0:1746065201.561167:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.561216:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263448960:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 1997us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.561223:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7974 00000100:00100000:0.0:1746065201.561853:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.562104:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449088 00000100:00100000:2.0:1746065201.562113:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449088 00000100:00100000:2.0:1746065201.562164:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15457 00000100:00100000:2.0:1746065201.562172:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:32270:x1830881263449088:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065201.562190:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065201.562759:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c5a600/0x14b4f8542d4ff2a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61fa7 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.562796:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 24 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065201.562806:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.562808:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.562811:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c5a600/0x14b4f8542d4ff2a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa7 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.562871:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 24 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065201.562884:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00000100:00100000:2.0:1746065201.562896:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260497536:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065201.562978:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065201.566021:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260497536:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065201.566046:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c5a600/0x14b4f8542d4ff2a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa7 expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.566062:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c5a600, rc 0) 00000100:00100000:2.0:1746065201.566653:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:32270:x1830881263449088:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 4480us (4804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.566661:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15457 00000100:00100000:0.0:1746065201.566808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.566948:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449216 00000100:00100000:2.0:1746065201.566955:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449216 00010000:00010000:2.0:1746065201.566975:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00000100:00100000:2.0:1746065201.567006:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7975 00000100:00100000:2.0:1746065201.567012:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263449216:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065201.567021:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065201.567037:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.567047:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.567064:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c732000/0x14b4f8542d4ff245 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x388:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f7d expref: 24 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.567301:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.567303:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.567310:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c5a600/0x14b4f8542d4ff2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa7 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.567318:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c5a600/0x14b4f8542d4ff2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa7 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.567343:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093c5a600/0x14b4f8542d4ff2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fa7 expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.567359:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260497664:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065201.568683:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065201.574094:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260497664:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065201.574113:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065201.574178:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263449216:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 7165us (7375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.574188:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7975 00000100:00100000:0.0:1746065201.574310:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.574408:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449344 00000100:00100000:2.0:1746065201.574413:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449344 00000100:00100000:2.0:1746065201.574447:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15458 00000100:00100000:2.0:1746065201.574453:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:32270:x1830881263449344:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:2.0:1746065201.574467:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065201.574481:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c5ac00/0x14b4f8542d4ff2ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61fae expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.574504:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065201.574510:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.574512:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.574515:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c5ac00/0x14b4f8542d4ff2ae lrc: 4/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fae expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.574537:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065201.574552:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 900 lvb_type: 1 00000100:00100000:2.0:1746065201.574562:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260497792:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065201.574611:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065201.577338:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260497792:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065201.577364:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c5ac00/0x14b4f8542d4ff2ae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fae expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.577377:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c5ac00, rc 0) 00000100:00100000:2.0:1746065201.578083:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:32270:x1830881263449344:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3628us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.578090:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15458 00000100:00100000:0.0:1746065201.578799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.578895:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449472 00000100:00100000:2.0:1746065201.578901:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449472 00010000:00010000:2.0:1746065201.578923:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 900 lvb_type: 1 00000100:00100000:2.0:1746065201.578943:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7976 00000100:00100000:2.0:1746065201.578948:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1960:x1830881263449472:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065201.578959:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065201.578975:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.578988:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.579005:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c733200/0x14b4f8542d4ff253 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x382:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f84 expref: 16 pid: 8428 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.579423:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.579425:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.579431:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c5ac00/0x14b4f8542d4ff2ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fae expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.579438:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c5ac00/0x14b4f8542d4ff2ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fae expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.579465:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093c5ac00/0x14b4f8542d4ff2ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fae expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.579475:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260497920:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065201.580228:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.585314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.585391:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449600 00000100:00100000:3.0:1746065201.585398:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449600 00000100:00100000:3.0:1746065201.585430:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15459 00000100:00100000:3.0:1746065201.585436:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:32270:x1830881263449600:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065201.585450:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065201.585463:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013548ca00/0x14b4f8542d4ff2b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61fb5 expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.585487:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 17 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.585494:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.585496:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.585499:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013548ca00/0x14b4f8542d4ff2b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fb5 expref: 17 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.585557:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260497920:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065201.585569:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065201.585682:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263449472:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 6731us (6889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.585689:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7976 00010000:00010000:3.0:1746065201.586056:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 16 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.586067:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 16 pid: 9716 timeout: 900 lvb_type: 1 00000100:00100000:3.0:1746065201.586077:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260498048:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065201.586259:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.588618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.588777:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449728 00000100:00100000:2.0:1746065201.588787:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449728 00010000:00010000:2.0:1746065201.588859:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 17 pid: 9716 timeout: 900 lvb_type: 1 00000100:00100000:2.0:1746065201.588895:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7977 00000100:00100000:2.0:1746065201.588902:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1960:x1830881263449728:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065201.588912:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065201.588932:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 17 pid: 9716 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.588943:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 17 pid: 9716 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.588963:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.589020:0:25185:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092774000/0x14b4f8542d4ff24c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f8b expref: 17 pid: 9716 timeout: 900 lvb_type: 1 00000100:00100000:3.0:1746065201.589036:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:25185:1830881260498048:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065201.589188:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.589195:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013548ca00/0x14b4f8542d4ff2b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fb5 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.589202:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013548ca00/0x14b4f8542d4ff2b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fb5 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.589235:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013548ca00/0x14b4f8542d4ff2b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fb5 expref: 16 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.589248:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548ca00, rc 0) 00000100:00100000:3.0:1746065201.589304:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:32270:x1830881263449600:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3868us (3997us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.589310:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15459 00010000:00010000:2.0:1746065201.589541:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013548ca00/0x14b4f8542d4ff2b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fb5 expref: 15 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.589553:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260498176:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065201.589603:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065201.592385:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1830881260498176:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065201.592414:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065201.592459:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1960:x1830881263449728:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3556us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.592469:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7977 00000100:00100000:0.0:1746065201.593100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.593173:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449856 00000100:00100000:3.0:1746065201.593182:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449856 00000100:00100000:3.0:1746065201.593227:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15460 00000100:00100000:3.0:1746065201.593233:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:32270:x1830881263449856:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:3.0:1746065201.593251:0:25185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065201.593264:0:25185:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013548ce00/0x14b4f8542d4ff2bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61fbc expref: -99 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.593291:0:25185:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.593298:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.593299:0:25185:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065201.593303:0:25185:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013548ce00/0x14b4f8542d4ff2bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fbc expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.593326:0:25185:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065201.593337:0:25185:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 900 lvb_type: 1 00000100:00100000:3.0:1746065201.593351:0:25185:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260498304:192.168.202.46@tcp:104: 00000100:00100000:3.0:1746065201.593434:0:25185:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094305d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065201.596715:0:25185:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25185:1830881260498304:192.168.202.46@tcp:104: 00010000:00010000:3.0:1746065201.596748:0:25185:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013548ce00/0x14b4f8542d4ff2bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fbc expref: 24 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065201.596766:0:25185:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013548ce00, rc 0) 00000100:00100000:3.0:1746065201.596861:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:32270:x1830881263449856:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 3627us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.596869:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15460 00000100:00100000:0.0:1746065201.597196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.597939:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263449984 00000100:00100000:2.0:1746065201.597947:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263449984 00010000:00010000:2.0:1746065201.597976:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 900 lvb_type: 1 00000100:00100000:2.0:1746065201.598001:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7978 00000100:00100000:2.0:1746065201.598007:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1960:x1830881263449984:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065201.598017:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065201.598034:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.598044:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.598065:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092775c00/0x14b4f8542d4ff23e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x389:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f92 expref: 24 pid: 9716 timeout: 900 lvb_type: 1 00010000:00010000:2.0:1746065201.598089:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.598091:0:8444:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065201.598096:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013548ce00/0x14b4f8542d4ff2bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fbc expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.598103:0:8444:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013548ce00/0x14b4f8542d4ff2bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fbc expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.598132:0:8444:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013548ce00/0x14b4f8542d4ff2bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fbc expref: 23 pid: 25185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065201.598142:0:8444:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260498432:192.168.202.46@tcp:105: 00000100:00100000:2.0:1746065201.598207:0:8444:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065201.601893:0:8444:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1830881260498432:192.168.202.46@tcp:105: 00010000:00010000:2.0:1746065201.601911:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065201.601972:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1960:x1830881263449984:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 3963us (4781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.601982:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7978 00000100:00100000:2.0:1746065201.602340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.603032:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.604332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:3.0:1746065201.605979:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450240 00000100:00100000:3.0:1746065201.605990:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450240 00000100:00100000:3.0:1746065201.606036:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450496 00000100:00100000:3.0:1746065201.606039:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450496 00000100:00100000:3.0:1746065201.606066:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15461 00000100:00100000:3.0:1746065201.606073:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+23:1961:x1830881263450240:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065201.606227:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065201.606230:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:3.0:1746065201.606232:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:3.0:1746065201.606233:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065200 -> 1746065202 00002000:00010000:3.0:1746065201.606235:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746065201.606278:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263450240:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 205us (3938us total) trans 17179873777 rc 0/0 00000100:00100000:3.0:1746065201.606284:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15461 00000100:00100000:3.0:1746065201.606298:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15462 00000100:00100000:3.0:1746065201.606303:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+15:1961:x1830881263450496:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:3.0:1746065201.606388:0:25185:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065201.606390:0:25185:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:3.0:1746065201.606392:0:25185:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:3.0:1746065201.606394:0:25185:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065200 -> 1746065202 00002000:00010000:3.0:1746065201.606395:0:25185:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746065201.606412:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263450496:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 109us (3381us total) trans 21474841069 rc 0/0 00000100:00100000:3.0:1746065201.606417:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15462 00000100:00100000:2.0:1746065201.606485:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450752 00000100:00100000:2.0:1746065201.606489:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450752 00000100:00100000:2.0:1746065201.606507:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15463 00000100:00100000:2.0:1746065201.606512:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+24:1961:x1830881263450752:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:2.0:1746065201.606583:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065201.606586:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.606587:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065197 -> 1746065200 00002000:00010000:2.0:1746065201.606589:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065200 -> 1746065202 00002000:00010000:2.0:1746065201.606591:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746065201.606607:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263450752:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 95us (2278us total) trans 17179873778 rc 0/0 00000100:00100000:2.0:1746065201.606615:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15463 00000100:00100000:2.0:1746065201.606685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.606698:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450112 00000100:00100000:2.0:1746065201.606701:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450112 00000100:00100000:2.0:1746065201.606715:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15464 00000100:00100000:2.0:1746065201.606719:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+16:1961:x1830881263450112:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:2.0:1746065201.606791:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065201.606793:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.606795:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065195 -> 1746065200 00002000:00010000:2.0:1746065201.606797:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065200 -> 1746065202 00002000:00010000:2.0:1746065201.606804:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:2.0:1746065201.606841:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263450112:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 120us (156us total) trans 21474841070 rc 0/0 00000100:00100000:2.0:1746065201.606846:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15464 00000100:00100000:2.0:1746065201.606886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.606897:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450368 00000100:00100000:2.0:1746065201.606899:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450368 00000100:00100000:2.0:1746065201.606911:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15465 00000100:00100000:2.0:1746065201.606916:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+25:1961:x1830881263450368:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:2.0:1746065201.606974:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065201.606975:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.606977:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.606979:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065200 -> 1746065202 00002000:00010000:2.0:1746065201.606980:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746065201.606996:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+26:1961:x1830881263450368:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 80us (111us total) trans 17179873779 rc 0/0 00000100:00100000:2.0:1746065201.607001:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15465 00000100:00100000:2.0:1746065201.607141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.607153:0:21235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263450624 00000100:00100000:2.0:1746065201.607155:0:21235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263450624 00000100:00100000:2.0:1746065201.607169:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 15466 00000100:00100000:2.0:1746065201.607173:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+17:1961:x1830881263450624:12345-192.168.202.46@tcp:2:lfs.0 00002000:00010000:2.0:1746065201.607241:0:21235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:2.0:1746065201.607243:0:21235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.607245:0:21235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.607246:0:21235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065200 -> 1746065202 00002000:00010000:2.0:1746065201.607248:0:21235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5769 -> 5769 00000100:00100000:2.0:1746065201.607265:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+18:1961:x1830881263450624:12345-192.168.202.46@tcp:2:lfs.0 Request processed in 90us (124us total) trans 21474841071 rc 0/0 00000100:00100000:2.0:1746065201.607270:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 15466 00000100:00100000:0.0:1746065201.612290:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.612857:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451008 00000100:00100000:2.0:1746065201.612867:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451008 00000100:00100000:2.0:1746065201.612919:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4407 00000100:00100000:2.0:1746065201.612926:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:32270:x1830881263451008:12345-192.168.202.46@tcp:35:lfs.0 00000004:00010000:2.0:1746065201.612978:0:14647:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x30c:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4ff1dc lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f5a expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.613018:0:14647:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065201.613027:0:14647:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.613038:0:14647:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065201.613062:0:14647:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065201.613073:0:14647:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 250 pid: 14645 timeout: 900 lvb_type: 0 00000100:00100000:2.0:1746065201.613083:0:14647:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14647:1830881260498560:192.168.202.46@tcp:104: 00000100:00100000:2.0:1746065201.614054:0:14647:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b525b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.620461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:2.0:1746065201.621096:0:14647:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14647:1830881260498560:192.168.202.46@tcp:104: 00010000:00010000:2.0:1746065201.621115:0:14647:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00000100:00100000:3.0:1746065201.622625:0:8444:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451136 00000100:00100000:3.0:1746065201.622633:0:8444:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451136 00010000:00010000:3.0:1746065201.622669:0:8444:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 251 pid: 14645 timeout: 900 lvb_type: 0 00000100:00100000:3.0:1746065201.622701:0:8444:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 7979 00000100:00100000:3.0:1746065201.622707:0:8444:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+251:1960:x1830881263451136:12345-192.168.202.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065201.622718:0:8444:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065201.622722:0:8444:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 251 pid: 14645 timeout: 900 lvb_type: 0 00010000:00010000:3.0:1746065201.622731:0:8444:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 251 pid: 14645 timeout: 900 lvb_type: 0 00010000:00010000:3.0:1746065201.622749:0:8444:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395600/0x14b4f8542d4ff21b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f61 expref: 251 pid: 14645 timeout: 900 lvb_type: 0 00010000:00010000:3.0:1746065201.622780:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065201.622784:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065201.622790:0:8444:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065201.622796:0:8444:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065201.622829:0:8444:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065201.622865:0:8444:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+250:1960:x1830881263451136:12345-192.168.202.46@tcp:103:ldlm_bl.0 Request processed in 159us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065201.622871:0:8444:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 7979 00010000:00010000:2.0:1746065201.622948:0:14647:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00010000:00010000:2.0:1746065201.622954:0:14647:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00000040:00080000:2.0:1746065201.623528:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3202, 88 off271216 00000004:00080000:2.0:1746065201.623533:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914717827ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623563:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3215, 88 off272536 00000004:00080000:2.0:1746065201.623566:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800914750740ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065201.623610:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3216, 88 off272624 00000004:00080000:2.0:1746065201.623614:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800914798297ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065201.623626:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3203, 88 off271304 00000004:00080000:2.0:1746065201.623629:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914813881ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623635:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3204, 88 off271392 00000004:00080000:2.0:1746065201.623637:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914821670ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623659:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3217, 88 off272712 00000004:00080000:2.0:1746065201.623662:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800914846570ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065201.623672:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3218, 88 off272800 00000004:00080000:2.0:1746065201.623674:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800914859163ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065201.623683:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3219, 88 off272888 00000004:00080000:2.0:1746065201.623685:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800914869635ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065201.623694:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3205, 88 off271480 00000004:00080000:2.0:1746065201.623697:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914881491ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623703:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3220, 88 off272976 00000004:00080000:2.0:1746065201.623705:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800914889737ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065201.623715:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3206, 88 off271568 00000004:00080000:2.0:1746065201.623718:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914902572ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623723:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3221, 88 off273064 00000004:00080000:2.0:1746065201.623726:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800914910961ns, next at 737095943431ns, rc = 0 00000040:00080000:2.0:1746065201.623735:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3207, 88 off271656 00000004:00080000:2.0:1746065201.623738:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914922448ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623743:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3208, 88 off271744 00000004:00080000:2.0:1746065201.623745:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914930307ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623751:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3209, 88 off271832 00000004:00080000:2.0:1746065201.623753:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914937668ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623758:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3210, 88 off271920 00000004:00080000:2.0:1746065201.623760:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800914944678ns, next at 737048221954ns, rc = 0 00000040:00080000:2.0:1746065201.623766:0:14647:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3222, 88 off273152 00000004:00080000:2.0:1746065201.623768:0:14647:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 800914952790ns, next at 737095943431ns, rc = 0 00000004:00010000:3.0:1746065201.694536:0:14647:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f2c6d80 reply state ffff8800934bf000 transno 8589944476 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14647 initiator: MDT0 00000100:00100000:3.0:1746065201.694550:0:14647:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746065201.694559:0:14647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065201.694562:0:14647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065201.694569:0:14647:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ad3b1c00/0x14b4f8542d4ff1dc lrc: 0/0,0 mode: --/PW res: [0x200000403:0x30c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61f5a expref: 250 pid: 14645 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746065201.694674:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944475 is committed 00000100:00100000:3.0:1746065201.694687:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32270:x1830881263451008:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 81759us (82484us total) trans 8589944476 rc 0/0 00000001:00080000:1.0:1746065201.694692:0:14720:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944476 is committed 00000100:00100000:3.0:1746065201.694696:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4407 00000004:00080000:1.0:1746065201.694697:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2502 committed 00000004:00080000:1.0:1746065201.694703:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2489 committed 00000004:00080000:1.0:1746065201.694708:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2488 committed 00000004:00080000:1.0:1746065201.694710:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2487 committed 00000004:00080000:1.0:1746065201.694711:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2486 committed 00000004:00080000:1.0:1746065201.694713:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2501 committed 00000004:00080000:1.0:1746065201.694715:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2485 committed 00000004:00080000:1.0:1746065201.694717:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2500 committed 00000004:00080000:1.0:1746065201.694718:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2484 committed 00000004:00080000:1.0:1746065201.694720:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2499 committed 00000004:00080000:1.0:1746065201.694721:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2498 committed 00000004:00080000:1.0:1746065201.694723:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2497 committed 00000004:00080000:1.0:1746065201.694724:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2483 committed 00000004:00080000:1.0:1746065201.694725:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2482 committed 00000004:00080000:1.0:1746065201.694726:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2496 committed 00000004:00080000:1.0:1746065201.694727:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2495 committed 00010000:00010000:3.0:1746065201.694729:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14647 initiator: MDT0 00000004:00080000:1.0:1746065201.694729:0:14720:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2481 committed 00010000:00010000:3.0:1746065201.694735:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065201.694741:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065201.694746:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c395200 already unused, calling callback (ffffffffa134b690) 00010000:00010000:3.0:1746065201.694749:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065201.694755:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065201.694765:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f49ff00) 00010000:00010000:3.0:1746065201.694767:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065201.694770:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14647 initiator: MDT0 00010000:00010000:3.0:1746065201.694774:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c395200/0x14b4f8542d4ff2c3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14647 initiator: MDT0 00000100:00100000:3.0:1746065201.694912:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260498944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.694950:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065201.694993:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260499456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.695008:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065201.695022:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065201.695025:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260499072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.695037:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065201.695048:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260499584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.695058:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065201.695072:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260499968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065201.695087:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.695095:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260498944 00000100:00100000:3.0:1746065201.695098:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260500480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065201.695103:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260498944 00000100:00100000:3.0:1746065201.695108:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065201.695119:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746065201.695123:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260500096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065201.695135:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.695135:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499456 00000100:00100000:2.0:1746065201.695137:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499456 00000100:00100000:3.0:1746065201.695146:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260500608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065201.695150:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499072 00000100:00100000:2.0:1746065201.695152:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499072 00000100:00100000:3.0:1746065201.695156:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.695168:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499584 00000100:00100000:2.0:1746065201.695170:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499584 00000100:00100000:3.0:1746065201.695176:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499968 00000100:00100000:3.0:1746065201.695181:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499968 00000100:00100000:2.0:1746065201.695181:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260500480 00000100:00100000:2.0:1746065201.695183:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260500480 00000100:00100000:2.0:1746065201.695192:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260500096 00000100:00100000:2.0:1746065201.695194:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260500096 00000100:00100000:3.0:1746065201.695200:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260500608 00000100:00100000:3.0:1746065201.695201:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260500608 00000100:00100000:2.0:1746065201.695206:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15467 00000100:00100000:2.0:1746065201.695213:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3297:x1830881260498944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.695252:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260498816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.695293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.695308:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260499328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.695322:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.695328:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260499840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.695345:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.695351:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260500352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.695363:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.695373:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746065201.695377:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260498688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.695391:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.695399:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260499200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.695411:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.695417:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260499712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.695429:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.695435:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260500224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.695448:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.695468:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260498816 00000100:00100000:0.0:1746065201.695471:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260498816 00000100:00100000:1.0:1746065201.695623:0:8851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499328 00000100:00100000:1.0:1746065201.695627:0:8851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499328 00002000:00010000:2.0:1746065201.696202:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb size from disk: 5012160 -> 5012160 00002000:00010000:2.0:1746065201.696205:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.696207:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.696209:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb ctime from disk: 1746065202 -> 1746065202 00002000:00010000:2.0:1746065201.696211:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x383:0x0] updating lvb blocks from disk: 5769 -> 5769 00000100:00100000:2.0:1746065201.696249:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881260498944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1036us (1297us total) trans 21474841072 rc 0/0 00000100:00100000:3.0:1746065201.697390:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499840 00000100:00100000:3.0:1746065201.697399:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499840 00000100:00100000:0.0:1746065201.697412:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260500352 00000100:00100000:0.0:1746065201.697418:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260500352 00000100:00100000:3.0:1746065201.697424:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260498688 00000100:00100000:3.0:1746065201.697427:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260498688 00000100:00100000:0.0:1746065201.697434:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499200 00000100:00100000:0.0:1746065201.697437:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499200 00000100:00100000:3.0:1746065201.697438:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260499712 00000100:00100000:3.0:1746065201.697439:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260499712 00000100:00100000:0.0:1746065201.697446:0:2463:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260500224 00000100:00100000:0.0:1746065201.697449:0:2463:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260500224 00000100:00100000:3.0:1746065201.697453:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15468 00000100:00100000:3.0:1746065201.697460:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260499456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.697462:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15469 00000100:00100000:0.0:1746065201.697469:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260499072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.697595:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15470 00000100:00100000:3.0:1746065201.697601:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3297:x1830881260499584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.697655:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15471 00000100:00100000:1.0:1746065201.697674:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881260500480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.697839:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881260500480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (2728us total) trans 17179873780 rc 0/0 00000100:00100000:1.0:1746065201.697846:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15471 00000100:00100000:1.0:1746065201.697866:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15472 00000100:00100000:1.0:1746065201.697871:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881260499968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065201.697943:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065201.697945:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:1.0:1746065201.697947:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:1.0:1746065201.697949:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb ctime from disk: 1746065202 -> 1746065202 00002000:00010000:1.0:1746065201.697951:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x389:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746065201.697969:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881260499968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (2881us total) trans 17179873781 rc 0/0 00000100:00100000:1.0:1746065201.697973:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15472 00000100:00100000:1.0:1746065201.697983:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15473 00000100:00100000:1.0:1746065201.697988:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881260500096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065201.698053:0:8851:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065201.698056:0:8851:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb mtime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065201.698058:0:8851:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb atime from disk: 1746065139 -> 1746065139 00002000:00010000:1.0:1746065201.698060:0:8851:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb ctime from disk: 1746065140 -> 1746065140 00002000:00010000:1.0:1746065201.698062:0:8851:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x386:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746065201.698081:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830881260500096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (2944us total) trans 17179873782 rc 0/0 00000100:00100000:1.0:1746065201.698087:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15473 00000100:00100000:1.0:1746065201.698096:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15474 00000100:00100000:1.0:1746065201.698101:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830881260500608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065201.698213:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15467 00000100:00100000:2.0:1746065201.698231:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15475 00000100:00100000:2.0:1746065201.698237:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260498816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.698594:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881260499072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1125us (3554us total) trans 21474841073 rc 0/0 00000100:00100000:0.0:1746065201.698600:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15469 00000100:00100000:0.0:1746065201.698612:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15476 00000100:00100000:0.0:1746065201.698616:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260499840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065201.698699:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065201.698702:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065201.698704:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065201.698705:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb ctime from disk: 1746065202 -> 1746065202 00002000:00010000:0.0:1746065201.698707:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x388:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746065201.698732:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881260499840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (3386us total) trans 17179873784 rc 0/0 00000100:00100000:0.0:1746065201.698736:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15476 00000100:00100000:0.0:1746065201.698746:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15477 00000100:00100000:0.0:1746065201.698750:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260500352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.698841:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881260500352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (3476us total) trans 17179873785 rc 0/0 00000100:00100000:0.0:1746065201.698846:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15477 00000100:00100000:0.0:1746065201.698862:0:2463:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15478 00000100:00100000:0.0:1746065201.698866:0:2463:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881260498688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.699413:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881260499584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1806us (4348us total) trans 21474841075 rc 0/0 00000100:00100000:3.0:1746065201.699422:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15470 00000100:00100000:3.0:1746065201.699449:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15479 00000100:00100000:3.0:1746065201.699457:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881260499200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.699540:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260499200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (4126us total) trans 21474841076 rc 0/0 00000100:00100000:3.0:1746065201.699545:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15479 00000100:00100000:3.0:1746065201.699560:0:21998:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15480 00000100:00100000:3.0:1746065201.699566:0:21998:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260499712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065201.700911:0:21235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15481 00000100:00100000:2.0:1746065201.700921:0:21235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881260500224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065201.700930:0:21998:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065201.700934:0:21998:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:3.0:1746065201.700936:0:21998:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:3.0:1746065201.700938:0:21998:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb ctime from disk: 1746065202 -> 1746065202 00002000:00010000:3.0:1746065201.700939:0:21998:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x387:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746065201.700945:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260500608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2842us (5786us total) trans 17179873783 rc 0/0 00000100:00100000:1.0:1746065201.700951:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15474 00000100:00100000:1.0:1746065201.700966:0:8851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15482 00000100:00100000:3.0:1746065201.700971:0:21998:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260499712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1404us (5539us total) trans 17179873786 rc 0/0 00000100:00100000:1.0:1746065201.700972:0:8851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830881260499328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.700977:0:21998:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15480 00000004:00080000:3.0:1746065201.701035:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b4a80/2, rc 0, transno 17179873782 00000100:00100000:3.0:1746065201.701040:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260500096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065201.701049:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5500/2, rc 0, transno 17179873783 00000100:00100000:2.0:1746065201.701051:0:21235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260500224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (5601us total) trans 17179873787 rc 0/0 00000100:00100000:3.0:1746065201.701052:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260500608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065201.701060:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b7480/2, rc 0, transno 17179873781 00000100:00100000:2.0:1746065201.701061:0:21235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15481 00000100:00100000:3.0:1746065201.701063:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260499968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.701066:0:8851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260499328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (5743us total) trans 21474841077 rc 0/0 00000004:00080000:3.0:1746065201.701070:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b5c00/2, rc 0, transno 17179873780 00000100:00100000:1.0:1746065201.701071:0:8851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15482 00000100:00100000:3.0:1746065201.701073:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260500480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065201.701083:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cddc00/2, rc 0, transno 21474841073 00000100:00100000:3.0:1746065201.701093:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260499072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065201.701100:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdf100/2, rc 0, transno 21474841075 00000100:00100000:3.0:1746065201.701103:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260499584:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065201.701110:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdc700/2, rc 0, transno 21474841072 00000100:00100000:3.0:1746065201.701113:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260498944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.701177:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260500736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065201.701210:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135cddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3297:x1830881260499456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3750us (6200us total) trans 21474841074 rc 0/0 00000100:00100000:1.0:1746065201.701213:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065201.701216:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15468 00000100:00100000:3.0:1746065201.701230:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260500736 00000100:00100000:3.0:1746065201.701235:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260500736 00002000:00010000:0.0:1746065201.701256:0:2463:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746065201.701257:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15483 00002000:00010000:0.0:1746065201.701259:0:2463:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065201.701261:0:2463:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00000100:00100000:3.0:1746065201.701262:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881260500736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065201.701263:0:2463:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb ctime from disk: 1746065202 -> 1746065202 00002000:00010000:0.0:1746065201.701265:0:2463:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x380:0x0] updating lvb blocks from disk: 1969 -> 1969 00000100:00100000:0.0:1746065201.701286:0:2463:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260498688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2419us (5893us total) trans 21474841078 rc 0/0 00000100:00100000:0.0:1746065201.701292:0:2463:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15478 00000100:00100000:3.0:1746065201.701379:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3295:x1830881260500736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (165us total) trans 21474841079 rc 0/0 00000100:00100000:3.0:1746065201.701385:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15483 00002000:00010000:2.0:1746065201.701393:0:8427:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065201.701396:0:8427:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.701397:0:8427:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:2.0:1746065201.701399:0:8427:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb ctime from disk: 1746065202 -> 1746065202 00002000:00010000:2.0:1746065201.701400:0:8427:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x382:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:3.0:1746065201.701406:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cded80/2, rc 0, transno 21474841074 00000100:00100000:3.0:1746065201.701409:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260499456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065201.701421:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3296:x1830881260498816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3185us (6128us total) trans 21474841080 rc 0/0 00000100:00100000:2.0:1746065201.701427:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15475 00000004:00080000:1.0:1746065201.701495:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fc5bb80/2, rc 0, transno 21474841079 00000100:00100000:1.0:1746065201.701506:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fc5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260500736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.701909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000004:00080000:0.0:1746065201.701950:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdf480/2, rc 0, transno 21474841078 00000100:00100000:0.0:1746065201.701955:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260498688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.701963:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdea00/2, rc 0, transno 21474841076 00000100:00100000:0.0:1746065201.701966:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260499200:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.701974:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b6d80/2, rc 0, transno 17179873786 00000100:00100000:0.0:1746065201.701976:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260499712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.701984:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b7100/2, rc 0, transno 17179873787 00000100:00100000:0.0:1746065201.701992:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260500224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.702001:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdd500/2, rc 0, transno 21474841080 00000100:00100000:0.0:1746065201.702003:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260498816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.702010:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135cdc000/2, rc 0, transno 21474841077 00000100:00100000:0.0:1746065201.702013:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135cdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260499328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.702020:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b7b80/2, rc 0, transno 17179873784 00000100:00100000:0.0:1746065201.702022:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260499840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.702029:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e8b6a00/2, rc 0, transno 17179873785 00000100:00100000:0.0:1746065201.702032:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e8b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260500352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.702110:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451264 00000100:00100000:1.0:1746065201.702116:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451264 00000100:00100000:1.0:1746065201.702148:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 10179 00000100:00100000:1.0:1746065201.702152:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+247:32270:x1830881263451264:12345-192.168.202.46@tcp:101:lfs.0 00010000:00010000:1.0:1746065201.702169:0:14645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.702185:0:14645:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2b2200/0x14b4f8542d4ff2ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x77388b02a2e61fc3 expref: -99 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.702233:0:14645:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2b2200/0x14b4f8542d4ff2ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fc3 expref: 248 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.702245:0:14645:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2b2200/0x14b4f8542d4ff2ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x30c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.46@tcp remote: 0x77388b02a2e61fc3 expref: 248 pid: 14645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.702260:0:14645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x30c:0x0].0x0 (ffff88009f715500) 00010000:00010000:1.0:1746065201.702263:0:14645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065201.702266:0:14645:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2b2200, rc 0) 00000100:00100000:1.0:1746065201.702307:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:32270:x1830881263451264:12345-192.168.202.46@tcp:101:lfs.0 Request processed in 154us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.702313:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 10179 00000100:00100000:2.0:1746065201.714578:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.46@tcp (source: 12345-192.168.202.46@tcp) 00000100:00100000:0.0:1746065201.714722:0:14647:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263451520 00000100:00100000:0.0:1746065201.714730:0:14647:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263451520 00000100:00100000:0.0:1746065201.714763:0:14647:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.46@tcp, seq: 4408 00000100:00100000:0.0:1746065201.714769:0:14647:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+248:32270:x1830881263451520:12345-192.168.202.46@tcp:35:lfs.0 00000100:00100000:0.0:1746065201.715568:0:14647:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7471aa0c-7b2a-4d2f-bfd9-d331bc906f82+249:32270:x1830881263451520:12345-192.168.202.46@tcp:35:lfs.0 Request processed in 797us (996us total) trans 8589944477 rc 0/0 00000100:00100000:0.0:1746065201.715576:0:14647:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.46@tcp, seq: 4408 00000100:00100000:1.0:1746065201.860502:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830881260501120:0@lo:400:kworker.0 00000100:00100000:2.0:1746065201.860504:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260501248:0@lo:400:kworker.0 00000100:00100000:0.0:1746065201.860603:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3296:1830881260500864:0@lo:400:kworker.0 00000100:00100000:3.0:1746065201.860829:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830881260500992:0@lo:400:kworker.0 00000100:00100000:2.0:1746065201.860885:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.860958:0:8427:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260501248 00000100:00100000:2.0:1746065201.860965:0:8427:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260501248 00000100:00100000:2.0:1746065201.861000:0:8427:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1746065201.861007:0:8427:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881260501248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065201.861051:0:8427:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830881260501248:12345-0@lo:400:kworker.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.861056:0:8427:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1746065201.861098:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830881260501248:0@lo:400:kworker.0 00000100:00100000:1.0:1746065201.861392:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.861442:0:14644:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260501120 00000100:00100000:1.0:1746065201.861447:0:14644:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260501120 00000100:00100000:3.0:1746065201.861576:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065201.861592:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830881260501504:0@lo:400:kworker.0 00000100:00100000:3.0:1746065201.861607:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1746065201.861625:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065201.861635:0:14643:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260500992 00000100:00100000:3.0:1746065201.861665:0:14643:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260500992 00000100:00100000:2.0:1746065201.861722:0:14645:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260501504 00000100:00100000:0.0:1746065201.861723:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065201.861726:0:14645:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260501504 00000100:00100000:0.0:1746065201.861748:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260501376:0@lo:400:kworker.0 00000100:00100000:0.0:1746065201.861766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.861796:0:14642:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260500864 00000100:00100000:0.0:1746065201.861798:0:14642:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260500864 00000100:00100000:1.0:1746065201.862032:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1746065201.862077:0:14642:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1746065201.862083:0:14642:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3296:x1830881260500864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065201.862120:0:14642:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee7f5432-ce07-43db-9a5a-08fa28fc98de+18:3296:x1830881260500864:12345-0@lo:400:kworker.0 Request processed in 38us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.862125:0:14642:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1746065201.862161:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ee7f5432-ce07-43db-9a5a-08fa28fc98de:3296:1830881260500864:0@lo:400:kworker.0 00000100:00100000:1.0:1746065201.862201:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830881260501120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065201.862231:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830881260501120:12345-0@lo:400:kworker.0 Request processed in 32us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.862674:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830881260501120:0@lo:400:kworker.0 00000100:00080000:0.0:1746065201.862742:0:7089:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065201.862787:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1746065201.862806:0:14644:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1746065201.862812:0:14644:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830881260500992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065201.862853:0:14644:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830881260500992:12345-0@lo:400:kworker.0 Request processed in 42us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.862858:0:14644:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1746065201.862907:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830881260500992:0@lo:400:kworker.0 00000100:00100000:2.0:1746065201.863029:0:14645:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1746065201.863039:0:14645:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830881260501504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065201.863109:0:14645:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830881260501504:12345-0@lo:400:kworker.0 Request processed in 73us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.863116:0:14645:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1746065201.863141:0:25185:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260501376 00000100:00100000:2.0:1746065201.863145:0:25185:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260501376 00000100:00100000:2.0:1746065201.863172:0:25185:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1746065201.863177:0:25185:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260501376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065201.863215:0:25185:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260501376:12345-0@lo:400:kworker.0 Request processed in 38us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065201.863220:0:25185:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1746065201.863255:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260501376:0@lo:400:kworker.0 00000100:00100000:3.0:1746065201.863776:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830881260501504:0@lo:400:kworker.0 00000100:00100000:3.0:1746065201.876608:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065201.876633:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260501632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746065201.876719:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.876802:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260501632 00000100:00100000:0.0:1746065201.876811:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260501632 00000100:00100000:0.0:1746065201.876881:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1746065201.876889:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881260501632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065201.876928:0:8430:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 434569216 pending 1703936 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746065201.876969:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3297:x1830881260501632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.876974:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1746065201.877157:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830881260501632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065201.924054:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065201.924079:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260501760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065201.924153:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.925438:0:8431:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881260501760 00000100:00100000:0.0:1746065201.925450:0:8431:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881260501760 00000100:00100000:0.0:1746065201.925498:0:8431:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1746065201.925506:0:8431:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260501760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065201.925543:0:8431:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 431030272 pending 1703936 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746065201.925589:0:8431:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830881260501760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.925594:0:8431:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1746065201.927609:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830881260501760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1746065202.040071:0:8443:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746065202.580015:0:4917:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:1.0:1746065203.043716:0:14603:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69455 lines, 69455 kept, 0 dropped, 0 bad.